Applied Health & Medicine Benchmark Specialist

Develop rigorous academic assessment content that helps evaluate AI capabilities across health and medicine. In this remote, hourly role, you will either create original expert-level multiple-choice questions or verify and strengthen existing questions for accuracy, clarity, and rigor.

Work may focus on Clinical Medicine and Surgery, Medical Imaging and Diagnostics, Pharmacovigilance, Healthcare Management and Economics, Rehabilitation, and Allied Health.

• Create original, challenging health and medicine questions that assess deep conceptual understanding rather than simple recall.
• Ensure every question is self-contained, unambiguous, precisely defined, and includes all information needed to solve it.
• Assign a difficulty rating of Medium, for introductory undergraduate level, Hard, for advanced undergraduate level, or Expert, for postgraduate level and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives designed to challenge expert-level solvers.
• Write clear, concise, step-by-step reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals and clinical guidelines.
• For verification assignments, review pre-written questions for clarity, completeness, precision, accuracy, and solvability; make needed edits and explain the changes.
• For authoring assignments, create questions within your medical specialty, rate their difficulty, and submit them for review.

• MD, DO, PhD, or current doctoral candidacy in Medicine, Biomedical Sciences, Public Health, or a closely related field.
• A master''s degree may be considered for candidates with exceptional expertise in a specific subdomain.
• Strong graduate-level medical knowledge, clinical reasoning ability, and understanding of biomedical research methodology.
• Board certification, clinical experience, or health-related research publications are strong advantages.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

• Fully remote, asynchronous work.
• Expected commitment of at least 10 hours per week.
• Hourly employment.

$94 to $119 per hour.