About this role
Role Overview
Apply advanced physics knowledge to design and solve challenging problems that probe and help fine-tune large language models. Produce clear, step-by-step solutions and work with researchers to build evaluation benchmarks covering topics from early undergraduate through PhD level. This role emphasizes rigorous analytical reasoning, strong English comprehension, and the chance to learn how to use AI to enhance your analytical workflow.
Key Responsibilities
- Design physics problems that test limits of large language models, focusing on abstraction, multi-step reasoning, and symbolic manipulation.
- Provide clear, high-quality, step-by-step solutions with well-articulated reasoning and justification.
- Collaborate with LLM researchers to align problem sets and solutions with evaluation objectives and model weaknesses.
- Help define new evaluation benchmarks based on physics curricula spanning early undergraduate to PhD-level topics.
- Deliver detailed annotations and constructive feedback on model outputs and problem designs.
Qualifications
- Strong analytical and research skills, demonstrated in physics problem solving.
- Ability to break down complex physics concepts into simple, clear explanations using structured reasoning, and where appropriate, visuals.
- Experience or aptitude for providing constructive, detailed annotations and feedback.
- Creative and lateral thinking skills for designing novel evaluation problems.
- Excellent written communication and collaboration ability in a remote setting.
- Self-motivated and able to manage work independently.
- Access to a desktop or laptop with a reliable internet connection.
- Preferred: currently pursuing a Master’s, PhD, or postdoctoral position in Physics, Applied Physics, or a closely related field, with the ability to analyze and solve complex physics problems in a structured, logical way.
Work Terms
- Location: fully remote.
- Engagement type: contractor assignment, freelancer status.
- No employer-provided medical or paid leave is included under this contractor arrangement.
- Work is project-based, with potential for contract extension depending on performance and project needs.
Compensation
Compensation is not specified in this listing.
Eligibility
- Candidates who are currently pursuing a Master’s degree, PhD, or postdoctoral appointment in Physics, Applied Physics, or a related field are eligible and encouraged to apply.
- Candidates must be able to work remotely and provide their own computing equipment and internet connectivity.