About this role
Role Overview
Apply humanities expertise to help research teams evaluate advanced AI systems. Your scholarly standards will inform the questions, reference answers, and evaluation criteria used to assess model performance.
This is an ongoing talent pool for future humanities AI training and evaluation projects, not a specific active opening. Projects may begin on short notice, and qualified participants are contacted when a suitable assignment becomes available.
Key Responsibilities
- Create field-specific questions that include relevant sources, context, interpretive challenges, and reference answers.
- Evaluate AI-generated interpretations and arguments for source accuracy, reasoning quality, and appropriate historical or cultural context.
- Identify polished but unreliable outputs, including textual misreadings, oversimplified scholarly debates, and fabricated citations.
Qualifications
- Graduate degree in a humanities discipline, or equivalent scholarly or professional experience.
- Strong written communication skills and the ability to clearly explain evaluative reasoning.
- Comfort working with ambiguity and raising unclear instructions when needed.
- Ability to distinguish a strong scholarly reading from one that is only plausible, and to explain precisely where the weaker reading falls short.
Relevant Fields
- History and classics
- Philosophy, ethics, and logic
- Literature
- Religious studies and cultural studies
Work Terms
- Remote, hourly engagement.
- Individual project listings will specify the rate, hours, and client.
- Timing depends on project availability and may range from approximately one week to several months after joining the pool.
- This standing listing does not make hiring decisions or provide an acceptance or rejection outcome. Matching candidates are invited to separate project-specific opportunities.
Compensation
Projects in this field have offered $45 to $60 per hour, with final rates determined by each project''s scope and depth.
Eligibility
Complete registration once to be considered across all qualifying networks. Completing the domain-expert interview and joining each network for which you qualify can improve the likelihood of being matched.
Application Process
- Submit a resume and confirm your work location.
- Complete a short AI interview, approximately 20 minutes total.
- Your background is verified before you are added to the humanities talent pool.
- When a project aligns with your field, you may receive an invitation to apply to that specific assignment.