AI Model Evaluation Specialist

Help improve next-generation AI systems by creating rigorous, research-backed evaluations that test how well advanced models learn, reason, and respond across diverse subjects.

This remote contractor role focuses on turning real-world research and analytical expertise into high-quality training data, evaluations, and feedback for advanced AI models. Prior AI experience is not required.

• Develop original, challenging question-and-answer pairs across a range of subjects.
• Conduct thorough research and triangulate multiple sources to produce accurate, comprehensive, well-documented answers.
• Create multi-step questions that require synthesis and analytical reasoning rather than simple single-source lookups.
• Test questions with AI models, assess results, and adjust difficulty as needed.
• Document research methods with clear citations and logical explanations.
• Revise content in response to reviewer feedback while following project guidelines and quality standards.

• Strong independent research skills and the ability to critically assess information from multiple sources.
• Excellent attention to detail and precise written English. English fluency is required, though English does not need to be your first language.
• Ability to write nuanced, well-structured questions that assess deep understanding.
• Analytical thinking, self-direction, reliability, and accountability in remote independent work.
• Interest in advanced AI and evaluating current model capabilities.
• Recent graduates, advanced-degree holders, and candidates from any academic or professional background are welcome if they demonstrate strong research and writing expertise.
• Experience with AI training, evaluation, or content creation is helpful but not required.

• Remote contract engagement.
• Work is paid on an output basis for tasks that meet project specifications; completion time varies by experience and workflow.
• Minimum task-submission requirements apply each week.
• Candidates should be ready to begin promptly. Selected candidates are expected to complete onboarding and start their first tasks within 24 to 48 hours afterward.

Compensation is listed at $20 to $60 per hour, with payment determined by completed tasks that meet project requirements.