Senior AI Trainer

Help improve next-generation AI systems by evaluating chat and search experiences, producing structured feedback, and creating realistic prompts that test how models reason and respond.

This remote contract role supports a customer-driven AI training and evaluation project. You will apply hands-on familiarity with AI products and generalist expertise to help shape model quality through accurate, real-world evaluation data.

• Evaluate AI chat and search tools using standardized, repeatable test conditions.
• Grade, rank, and annotate model responses according to detailed guidelines, providing structured feedback to improve performance.
• Write, refine, and stress-test prompts across varied scenarios, edge cases, and user intents.
• Check evaluations for consistency and accuracy, resolving discrepancies between ratings and project rubrics.
• Use AI training and video annotation tools to document findings and submit evaluation datasets in line with project standards and milestones.
• Work with trainers and contributors to clarify guidance, refine evaluation practices, and maintain team-wide consistency.
• Participate in quality reviews and incorporate feedback to uphold rigorous training and annotation standards.

• Exceptional attention to detail and accuracy when reviewing AI-generated content.
• Strong written and verbal communication skills for collaboration, reporting, and timely progress updates.
• Excellent time-management and self-organization skills for independent remote work.
• Analytical problem-solving ability and a proactive approach to evaluation challenges.
• Experience with AI model training, RLHF, data labeling, video annotation, or comparable data-centric evaluation work is preferred.
• Familiarity with AI products and tools, prompt engineering, and model capabilities and limitations is preferred.
• Experience developing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety is preferred.
• A background in AI training, machine learning data preparation, or LLM-focused projects is strongly preferred.

• Remote contractor engagement.
• Available to candidates located in Northern America or Germany.

$14 to $36 per hour.

Apply using the available application option, including email or supported account-based sign-in. Submitting an application confirms your acknowledgement of the candidate terms and privacy policy.