Physicist for AI Benchmark Authoring and Review

Develop rigorous physics assessment content that helps evaluate and advance AI capabilities. This fully remote, asynchronous role focuses on creating and validating expert-level multiple-choice benchmarks across specialized areas of physics.

You will be assigned to one of two workstreams: question authoring or question verification. Authors create original, challenging multiple-choice questions in their physics specialty, assess their difficulty, and submit them for review. Verifiers assess pre-written questions for accuracy, clarity, rigor, and solvability, then edit and document changes where needed.

Semiconductor Physics, Nanoelectronics and Spintronics, Photonics, Quantum Optics and Ultrafast Physics, Quantum Sensing and Metrology, Plasma Physics and Fusion Energy, Nonlinear Dynamics and Turbulence, and Geophysics and Reservoir Simulation.

• Write original questions that measure deep conceptual understanding rather than surface-level recall.
• Ensure every question is unambiguous, self-contained, and precisely defined, with all required information included in the problem statement.
• Assign a difficulty rating of Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives designed to challenge expert-level solvers.
• Create clear, concise step-by-step solutions with intermediate reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.
• For verification assignments, identify and explain issues involving clarity, completeness, precision, or solvability.

• PhD or doctoral candidacy in Physics, Applied Physics, Astrophysics, or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific physics subdomain.
• Strong command of graduate-level physics concepts and mathematical formalism.
• Experience designing rigorous academic problems or writing physics olympiad questions is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

• Fully remote, asynchronous hourly work.
• Expected commitment of at least 10 hours per week.

$61 to $77 per hour.