Multilingual Inpatient Hospitalist, AI Evaluation

Role Overview

Apply your active inpatient medicine expertise to improve the accuracy, safety, and clinical usefulness of AI-powered clinical documentation and decision-support tools. You will review, annotate, and evaluate hospital documentation and AI-generated outputs using the standards of a practicing hospitalist.

Key Responsibilities

• Review inpatient H&Ps, daily progress notes, and discharge summaries for accuracy, completeness, and clinical soundness.
• Assess AI-generated inpatient notes and summaries against real-world hospitalist documentation practices.
• Annotate inpatient encounter data according to detailed guidelines.
• Identify omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated content.
• Provide structured written feedback for engineering and product teams.
• Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.
• Raise clarifying questions when guidance is ambiguous and help refine the guidelines.

Qualifications

• MD hospitalist or internal medicine physician with at least 2 years of post-residency experience and a current inpatient practice.
• Based in the United States.
• Hands-on experience writing and reading at least one of the following: H&Ps, progress notes, or discharge summaries.
• Fluent English plus advanced C1 or higher speaking, listening, and writing proficiency in at least one additional language: Spanish, Mandarin Chinese, Cantonese Chinese, Tagalog, Russian, Haitian Creole, Korean, Arabic, Portuguese, Polish, Japanese, Turkish, Italian, Ukrainian, Romanian, Finnish, French, Danish, Catalan, Hungarian, Czech, German, Bulgarian, Indonesian, or Dutch.

Preferred Qualifications

• 5 or more years of post-residency experience.
• Familiarity with Epic.
• Previous AI or machine-learning annotation or model-evaluation experience with strong performance reviews.
• Experience documenting patient care in a language other than English.

Work Terms

• Remote, part-time hourly engagement.
• Minimum commitment of 10 hours per week.
• Flexible scheduling designed to fit around an active clinical practice.
• This opportunity is part of a multilingual cohort and requires the additional-language proficiency described above.

Compensation

• $170 per hour.