Psychologist for AI Model Evaluation

Psychology experts apply clinical and research knowledge to design psychology-focused prompts, assess large language model responses, and help improve AI understanding of psychological concepts and reasoning.

• Develop domain-specific prompts and tasks that probe psychological knowledge and reasoning.
• Evaluate and rate LLM outputs for accuracy, clarity, clinical relevance, and ethical considerations.
• Research psychology topics as needed to inform prompt design and evaluations, using AI tools as an aid.
• Contribute to structured annotation and quality assurance activities for model training and validation.
• Collaborate asynchronously with small, project-based teams selected for disciplinary expertise.

• Exceptional master students and graduates in Psychology are encouraged to apply.
• Must have a masters degree from a U.S. institution.
• Comfortable performing primarily asynchronous work and communicating findings in writing.
• Confidence that your subject-matter expertise can exceed current AI performance in explaining and reasoning about key concepts in psychology.
• Selection for each project is competitive, with small cohorts chosen for disciplinary and research strengths.
• Interest in learning new skills while contributing to AI research across psychology subdomains.

• Remote, asynchronous engagement, work from any location.
• Flexible schedule with no minimum weekly hour commitment.
• Placement into specific projects varies by domain and depends on project availability; the program runs year-round but project openings fluctuate.

• Up to $55/hr (depending on the project)

• F-1 students who are eligible for CPT or OPT may qualify for participation in projects. Confirm your eligibility with your Designated School Official.
• If your institution requires enrollment in a CPT course for authorization, this program may not meet that requirement.
• STEM OPT is not supported.
• Refer to the program help resources for additional details on supported work authorizations.

• Create an account on the program portal and complete required profile information.
• Complete identity verification as instructed.
• Review available projects, enroll in relevant project onboarding, and complete any project-specific onboarding steps.
• Begin contributing to assigned projects and receive payment for approved work.