Psychiatrist for AI Model Evaluation

Psychiatrists apply clinical and diagnostic expertise to evaluate AI-generated content, develop prompts that reflect psychiatric practice, and provide clear, structured feedback that improves model behavior for mental health tasks. No prior AI experience is required. Projects run year-round and new opportunities open periodically across specialties.

• Review and assess outputs produced by AI models for accuracy, clinical appropriateness, and language used in psychiatric practice.
• Design and refine prompts that reflect real-world psychiatric tasks, clinical scenarios, and documentation needs.
• Provide concise, structured feedback on model responses to help developers align outputs with professional standards and workplace language.
• Use your professional judgment to evaluate diagnoses, treatment recommendations, medication management, and interdisciplinary care planning as presented by the model.
• Complete assignments asynchronously and independently according to project instructions and timelines.

• Minimum 4 years of professional experience in psychiatry or closely related clinical work.
• Relevant experience may include, but is not limited to: administering psychotherapeutic treatments and medications while maintaining comprehensive patient records; collaborating with multidisciplinary teams to design individualized care plans and evaluate treatment outcomes; conducting diagnostic assessments and providing expert testimony for mental health evaluations.
• Comfort working asynchronously and providing detailed, professional feedback.

• Remote, asynchronous work from any location.
• Part-time, hourly, temporary engagements; flexibility to work independently without a fixed schedule.
• No minimum weekly commitment, though most contributors average 5 to 20 hours per week.
• Placement into specific projects depends on project availability, and additional projects become available periodically throughout the year.

Up to $200/hr (depending on the project)

• F-1 visa holders may be eligible if they have valid CPT or OPT authorization. Consult your Designated School Official to confirm eligibility. If your school requires enrollment in a CPT course, this type of project may not satisfy that requirement.
• STEM OPT is not supported for these projects.

• Create an account on the research platform and complete your profile.
• Upload your resume and verify your identity as part of onboarding.
• Be matched to relevant projects based on your background and availability, complete onboarding for each project, then begin assignments and receive payment.