Physicist for AI Model Evaluation

Physics experts apply advanced physics training to evaluate AI-generated scientific content, design domain-relevant problems, and give detailed feedback that helps AI models improve physical reasoning, mathematical modeling, theoretical analysis, and technical problem solving.

• Design rigorous, domain-relevant questions and prompts that test core physics concepts and quantitative reasoning.
• Review AI-generated responses for scientific accuracy, logical consistency, and physical validity.
• Provide clear, evidence-based feedback, corrections, and annotations highlighting errors, incorrect assumptions, or modelling flaws.
• Identify ambiguous or poorly-specified problems and suggest ways to improve prompt clarity and evaluation criteria.
• Document recurring failure modes, edge cases, and examples that illustrate strengths and limitations of model outputs.

• Doctoral students or graduates, including those currently enrolled in a PhD program or in postdoctoral positions, in Physics or closely related fields.
• Strong background in advanced physical reasoning, mathematical modeling, theoretical analysis, and quantitative problem solving across areas such as classical mechanics, electromagnetism, quantum mechanics, statistical mechanics, or related subdisciplines.
• No prior AI or technical experience required; the role leverages domain expertise in physics rather than prior machine learning work.

• Engagement is part-time, hourly contract work that is fully remote and asynchronous.
• There is no minimum hour requirement; when participating in an active project, most contributors work approximately 5 to 20 hours per week.
• This is an ongoing, project-based arrangement intended to be compatible with research, teaching, postdoctoral appointments, or industry employment.
• Placement on specific projects depends on current project needs, with the possibility of consideration for future projects as they become available.

• Up to $75/hr (depending on the project).

• F-1 students who are eligible for CPT or OPT may be able to participate, but you must consult your Designated School Official to confirm eligibility for contractual, paid work.
• If your school requires enrollment in a CPT course for eligibility, this engagement may not meet that requirement.
• STEM OPT is not supported for this type of engagement.

• Create an account on the engagement platform and complete the profile information requested.
• Complete identity verification as required for participation.
• Browse or be invited to relevant projects that match your expertise, complete any project-specific onboarding, and accept assignments.
• Begin contributing to project tasks and receive compensation according to the project terms.