About this role
Role Overview
Apply humanities expertise to help train and evaluate next-generation AI systems through rigorous, real-world analytical work. You will create challenging materials that shape how AI models interpret, reason, and respond. Prior AI experience is not required.
Key Responsibilities- Develop original, high-difficulty question-and-answer pairs covering interpretation, argument, context, and analytical reasoning in the humanities.
- Research and verify answers using primary texts and reputable sources, with authoritative citations and clearly documented reasoning.
- Design prompts that require deep analytical or interpretive insight rather than factual recall.
- Test questions with AI models and refine them to improve difficulty, clarity, and correctness.
- Write precise, unambiguous questions and well-supported answers.
- Incorporate reviewer feedback and follow project quality standards.
- Advanced academic background or professional experience in history, literature, philosophy, linguistics, classics, art history, journalism, or another humanities discipline.
- Strong research, source-triangulation, analytical-thinking, close-reading, analytical-writing, and question-formulation skills.
- Exceptional attention to detail, written precision, and ability to document sources and reasoning clearly.
- Experience creating nuanced questions that assess understanding beyond surface-level facts.
- Self-direction and reliability when completing remote work independently.
- Familiarity with AI model training or evaluation is helpful but not required.
- Remote contract engagement.
- Compensation is output-based and paid for each task that meets project specifications. Time required per task varies by experience and workflow.
- Minimum submission requirements apply, including a minimum number of tasks each week.
- Selected candidates should be prepared to begin their first tasks within 24 to 48 hours after completing onboarding.
$40 to $90 per hour.
Application ProcessApply through the online application and complete the required onboarding steps. Continuing the application indicates agreement to the applicable terms and privacy policies.