Medical Research Scientist for AI Evaluation

Lead the design and evaluation of AI systems that support healthcare, clinical, and biomedical workflows. This research-focused role builds rigorous evaluation frameworks, benchmark datasets, and clinical-quality rubrics to measure medical reasoning, evidence synthesis, and decision support. You will perform applied research, analyze safety and failure modes in medical use cases, and help define standards for trustworthy healthcare AI.

• Design and own evaluation frameworks for AI systems in healthcare and medical domains, including benchmarks, scoring methodologies, clinical quality rubrics, and validation protocols.
• Conduct research on medical reasoning, evidence-based decision making, clinical workflows, and healthcare information synthesis.
• Develop benchmark datasets and evaluation environments based on real-world healthcare and biomedical scenarios.
• Collaborate with researchers, clinicians, and engineers to evaluate and improve healthcare-focused AI systems.
• Analyze performance, safety considerations, reasoning quality, and failure patterns in medical use cases.
• Produce research reports, evaluation methodologies, and best-practice guidelines.
• Stay current with advancements in medicine, healthcare delivery, biomedical research, and AI.
• Contribute to the development of industry standards for healthcare AI evaluation and reliability.

• Advanced degree in Medicine, Public Health, Nursing, Pharmacy, Biomedical Sciences, Epidemiology, Health Economics, or a related healthcare field, for example MD, DO, PhD, MPH, PharmD.
• Deep expertise in clinical practice, healthcare operations, biomedical research, public health, healthcare analytics, or evidence-based medicine.
• Demonstrated experience conducting medical, clinical, or healthcare research.
• Strong understanding of research design, evidence evaluation, and healthcare decision-making processes.
• Exceptional analytical reasoning and scientific communication skills.
• Experience working in multidisciplinary environments involving research, healthcare, technology, or policy stakeholders.
• Required skills: Medical or health research, enterprise AI benchmarking, agentic medical workflows, and related evaluation methodologies.

• Experience with digital health, clinical decision support systems, healthcare analytics, or health technology assessment.
• Familiarity with healthcare quality measurement, clinical guidelines, evidence synthesis, or healthcare benchmarking.
• Published research in medical, clinical, healthcare, or biomedical fields.
• Experience participating in clinical studies, systematic reviews, or healthcare evaluation initiatives.

• Employment type: Full-time.
• Location: Remote.
• Role focus: Ongoing, research-focused position contributing to evaluation development and applied medical AI research.

• Listed total compensation range: $400, 000 to $800, 000 per year.
• National pay range for this full-time position, reported for base salary, is $200, 000 to $250, 000 per year.
• All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, subject to role and company policies.
• The employer provides a comprehensive benefits package, including up to 100% reimbursement for health-insurance premiums, paid time off, and a 401(K).

All employees are eligible for equity compensation, and may be eligible for performance-based bonuses depending on role and company policy. Applicants should be able to work remotely on a full-time basis. No specific visa or sponsorship details were provided in the source description.