Physician for AI Model Evaluation

Join a pioneering initiative to enhance AI capabilities in healthcare by becoming a Medical Expert. In this role, you will design realistic clinical scenarios and evaluate AI model outputs against evidence-based standards, contributing to the advancement of AI reasoning in patient care.

• Design clinically realistic prompts and scenarios based on your specialty, including diagnostic reasoning, treatment planning, risk stratification, and guideline concordance.
• Write "golden" reference responses that meet attending-level quality.
• Grade AI-generated responses using structured rubrics.
• Provide written feedback to the research team to improve model behavior.
• Participate in onboarding office hours and specialty calibration sessions.

• Attending Physicians: Must be board certified with a current, active, unrestricted medical license.
• Resident Physicians: Must be in the final year of residency (recent graduates must be board-eligible).
• Fellows: Must be board-certified/board-eligible in primary specialty and have a current active, unrestricted medical license.

• Remote, 100% asynchronous.
• Default commitment of 20 hours per week, with potential for increased hours after onboarding based on demand.
• Engagement starts on a rolling basis after onboarding sign-off.
• Ongoing duration, with monthly reviews.

Hourly rates range from $130 to $180, set per specialty and seniority tier, benchmarked accordingly. Specific rates will be confirmed in your offer.

This opportunity is open to physicians in various specialties, including those not currently listed. If your specialty has a dedicated listing, please apply through that specific listing to see the applicable rate.