Health and Medicine Assessment Specialist
$40–$90/hr
About this role
Join a team of expert medical and health science professionals to create and review high-quality academic assessment content for an AI research initiative. In this role, you will write and verify rigorous multiple-choice questions across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks that advance AI capabilities.
You will be assigned to one of two task types:
- Question Authoring — Create original, challenging multiple-choice questions in your area of medical expertise, rate their difficulty, and submit them for review.
- Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.
Clinical Specialties & Practice, Anatomy & Physiology, Nutrition & Dietetics, Public Health & Epidemiology, Medical Genetics, Virology & Infectious Disease, Human Aging & Gerontology, Immunology, Physical Therapy, Pharmacology, Pathology, Miscellaneous Health & Medicine.
Key Responsibilities- Author original health and medicine questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
- Rate each question''s difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines).
- For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.
- MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field.
- Master''s degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology.
- Board certification, clinical experience, or research publications in health fields is a strong plus.
- Excellent written English and ability to express complex ideas clearly and concisely.
Expected commitment: 10+ hours/week. This is an asynchronous, fully remote position.