Radiologist for AI Model Evaluation

Radiology professionals apply clinical imaging and diagnostic expertise to evaluate AI model outputs, create realistic prompts, and deliver structured, actionable feedback that improves how models handle radiology tasks and language.

• Evaluate AI-generated responses to radiology prompts for clinical accuracy, completeness, and appropriate terminology.
• Develop and refine prompts that reflect real-world radiology workflows and cases.
• Provide clear, structured feedback that helps models learn correct imaging interpretation, documentation, and communication practices.
• Identify and report errors, edge cases, and safety concerns in model outputs related to radiology practice.
• Collaborate asynchronously with research teams to iterate on tasks and improve evaluation criteria.

• Minimum 4 years of professional experience as a radiologist.
• Clinical experience that may include, but is not limited to: conducting and interpreting diagnostic and interventional imaging (MRI, CT, PET, ultrasound, nuclear medicine); ensuring image quality; managing complications; and documenting procedures.
• Experience providing clinical guidance and communication, such as delivering diagnostic findings, advising clinicians on imaging and radionuclide use, counseling patients, and coordinating care across medical teams.
• Experience maintaining safety, quality, and professional standards, including radiation protection oversight, dosage preparation, quality-control procedures, staff instruction, continuing education, and departmental improvement efforts.
• Ability to work asynchronously and independently with research teams.

Remote and asynchronous, work independently from any location. Part-time, hourly, temporary engagement with flexible scheduling and no minimum weekly commitment. Most contributors average 5 to 20 hours per week. Placement on specific projects depends on project availability; the program runs year-round and new project opportunities open periodically.

Up to $300/hr (depending on the project), paid hourly.

• Must meet the professional experience requirement above.
• F-1 students with eligible CPT or OPT may be able to participate, but you must confirm eligibility with your Designated School Official. If your school requires enrollment in a CPT course, this program may not satisfy that requirement. STEM OPT is not supported.

• Create a candidate account and complete your profile.
• Complete identity verification as requested.
• Review and accept onboarding materials for projects that match your expertise.
• Begin assigned tasks, submit deliverables per project instructions, and receive hourly payment.