About this role
Role Overview
This position focuses on designing, evaluating, and enhancing the interaction of AI systems with tools, APIs, and users across various locales. As an AI Prompt & Policy Specialist, you will work at the intersection of prompt engineering, policy design, and safety, ensuring that AI-driven workflows are accurate, compliant, and user-friendly.
Your expertise in API/JSON literacy, SQL basics, policy creation, and critical reasoning will be essential as you review, refine, and design prompts and behaviors for AI systems interacting with products like Slack, PayPal, and other third-party tools. Strong communication skills and an awareness of safety and content filtering across a wide range of languages and locales are crucial for success in this role.
Key Responsibilities
- Design, review, and refine prompts and instructions for AI systems interacting with tools, APIs, and external services.
- Read and understand API/JSON schemas and arguments to ensure correct parameter usage and tool behavior.
- Apply SQL basics to validate data, perform simple checks, and support analysis of AI or tool behavior.
- Create, document, and maintain policies and guidelines governing AI interactions, content handling, and tool workflows.
- Develop workflow knowledge for specific tools (e.g., Slack, PayPal) and encode that into prompts and policies.
- Ensure safety and compliance by applying content filtering guidelines and detecting unsafe or non-compliant outputs.
- Evaluate AI responses for critical reasoning quality, correctness of parameters, and adherence to policies.
- Support multilingual use cases by validating prompts and responses across multiple locales, with attention to nuance and clarity.
- Collaborate with product, engineering, and safety teams to iterate on prompts, policies, and workflows based on evaluation findings.
- Document edge cases, decision rationales, and recommendations with clear, concise written communication.
Qualifications
- 3, 6 years of experience in any combination of AI operations, content review, QA, product operations, policy, or technical support roles.
- Strong API/JSON literacy: ability to read schemas, understand arguments, and verify correct parameter usage.
- SQL basics: ability to run simple queries to validate data, investigate issues, or support analysis.
- Demonstrated experience with prompt engineering or writing clear, structured instructions for AI or automation systems.
- Proven policy creation skills: drafting, interpreting, and applying guidelines or policies in an operational setting.
- Familiarity with tool-specific workflows (e.g., Slack, PayPal, or similar SaaS platforms).