Generalist for AI Training and Evaluation

Help evaluate and improve advanced AI systems by applying careful human judgment to everyday questions and general reasoning. This standing opportunity is for generalists interested in AI training and evaluation work; it is not tied to a specific active project and remains open as new projects begin.

Projects can begin on short notice. Qualified generalists are maintained in a talent pool and invited to relevant project-specific opportunities when they become available.

• Write prompts and reference answers for everyday questions with objectively correct answers, including the context a strong response must consider.
• Assess AI responses for correctness, instruction-following, completeness, and unnecessary padding.
• Identify responses that are confidently incorrect, internally contradictory, or answer a different question than the one asked.

• Careful reading and sound judgment gained through a professional or academic background in any field.
• Clear written communication and the ability to explain reasoning precisely.
• Comfort working with ambiguous tasks and flagging unclear instructions.
• No specific credential is required; the key requirement is the ability to identify and clearly explain why an answer is incorrect.

• Remote, hourly engagements.
• This pool is intended for people whose experience does not fit a single specialist area or spans several areas.
• Project invitations depend on current client demand and may arrive within a week or several months.
• This listing itself does not make hiring decisions or issue acceptance or rejection outcomes. Any hiring decision is made through the specific project opportunity.
• Each project invitation identifies its rate, expected hours, and client.

Most contracts in this field have paid $40 to $70 per hour, with rates set by project scope and depth.

Complete registration once to be eligible for matching across all networks for which you qualify. Completing the domain-expert interview and joining each relevant network may improve the likelihood of being matched.

• Submit a resume and confirm your work location.
• Complete a short AI interview, approximately 20 minutes.
• Your background is verified before you are added to the generalist pool for future matching.