About this role
Role Overview
Evaluate and improve how clinical AI systems reason about real medical problems by designing evaluations and clinical scenarios that reveal strengths and gaps in model decision making. This role works directly with research teams to translate clinical expertise into systematic assessment methods that reflect real-world practice.
Key Responsibilities- Design systematic evaluation frameworks for medical AI systems
- Create clinical scenarios that test AI reasoning and decision making capabilities
- Develop assessment methods that capture the nuance of clinical practice
- Identify gaps in AI medical knowledge and clinical reasoning
- Collaborate with AI researchers to iterate on and improve model performance
- MD or DO, or advanced doctoral study such as PhD in a relevant discipline
- Active medical license and practicing physician status, any specialty
- Demonstrated experience with clinical decision making and evidence based medicine
- Interest in how AI can support clinical practice and patient care
- Strong analytical skills and clear written and verbal communication
- Location: Remote
- Engagement type: Contract
- Time commitment: Flexible engagement, up to 30 hours per week
- Duration: Initial 1 month assignment, with potential extensions based on performance and fit
- Schedule: Flexible, can be arranged around ongoing clinical commitments
- Must be a licensed, actively practicing physician (any specialty)
- Acceptable credentials include MD, DO, or advanced doctoral study such as a PhD
- Ability to work remotely and commit to the stated weekly hours and duration