Physicist for AI Benchmark Authoring and Verification

Role Overview

Develop rigorous academic physics assessments that help benchmark AI capabilities. This fully remote role involves either authoring original multiple-choice problems or verifying existing questions across advanced physics domains.

Physics Domains

Semiconductor Physics, Nanoelectronics and Spintronics, Photonics, Quantum Optics and Ultrafast Physics, Quantum Sensing and Metrology, Plasma Physics and Fusion Energy, Nonlinear Dynamics and Turbulence, and Geophysics and Reservoir Simulation.

Key Responsibilities

• Complete one of two task types: question authoring or question verification.
• For authoring assignments, create original, challenging multiple-choice questions in your physics specialty, assess their difficulty, and submit them for review.
• For verification assignments, evaluate pre-written questions for accuracy, clarity, rigor, completeness, precision, and solvability; revise them as needed and document the rationale for changes.
• Design questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is self-contained, unambiguous, and precisely defined, with all necessary information included in the problem statement.
• Classify question difficulty as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives suitable for challenging expert-level solvers.
• Write step-by-step solutions with clear, concise intermediate reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

Qualifications

• PhD or current doctoral candidacy in Physics, Applied Physics, Astrophysics, or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific physics subdomain.
• Strong command of graduate-level physics concepts and mathematical formalism.
• Experience designing rigorous academic problems or writing physics olympiad questions is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Remote, asynchronous hourly engagement.
• Expected commitment of at least 10 hours per week.

Compensation

$61 to $77 per hour.