Psychologist for AI Model Evaluation

Psychology experts apply clinical and research knowledge to design, test, and evaluate psychology-focused prompts and responses for large language models, helping improve their accuracy and reasoning in psychological domains.

• Develop domain-specific prompts and tasks that probe psychological knowledge and reasoning.
• Evaluate and rate model outputs for correctness, nuance, and safety in psychology-related scenarios.
• Research topics of interest within psychology, using AI tools as an adjunct to your subject-matter expertise.
• Collaborate asynchronously with small, discipline-specific cohorts on project-based work.
• Contribute to iterative improvements of model behavior by completing assigned evaluation and authoring tasks.

• Doctoral students or graduates in Psychology are encouraged to apply, with demonstrated research or clinical experience in the field.
• Must hold a master’s degree from a US institution.
• Comfortable working primarily asynchronously, providing written evaluations and completing tasks independently.
• Confident that your expertise can exceed current AI systems in understanding and explaining key psychological concepts.
• Willingness to learn new skills while contributing across interdisciplinary AI research projects.

• Part-time, remote, asynchronous work.
• Flexible hours, with no minimum hourly commitment required.
• Project placement is contingent on current project availability; the program runs year-round but opportunities vary by domain.
• Selection for individual projects is limited to small cohorts chosen for disciplinary and research expertise.

• Up to $85/hr (depending on the project).

• F-1 students who are eligible for CPT or OPT may be eligible for projects. Work with your Designated School Official to confirm eligibility, since institutional CPT course requirements may prevent participation.
• STEM OPT is not supported.
• Additional eligibility conditions may apply depending on project requirements and sponsor policies.

• Create a candidate profile on the program portal and complete identity verification.
• Indicate your areas of expertise and onboard into relevant project streams once approved.
• When matched to a project cohort, complete onboarding steps for that project and begin task work to earn compensation.