About this role
Role Overview
Apply your physical sciences expertise to create high-quality evaluation materials that help improve how next-generation AI systems learn, reason, and perform. This remote contract role focuses on realistic scientific challenges, experimental reasoning, quantitative analysis, and precise technical documentation. Prior AI experience is not required.
Key Responsibilities
- Design and write advanced physical sciences evaluation tasks covering experimental analysis, computational modeling, and technical reasoning.
- Source, synthesize, and curate authentic research artifacts, including CSVs, spreadsheets, computational results, datasets, and scientific references.
- Create scenarios and problem statements that reflect real technical challenges rather than simplified textbook examples.
- Define rigorous methodologies and quantitative solutions for each task.
- Develop detailed grading rubrics with 35 or more items to assess technical rigor, numerical accuracy, interpretation quality, and scientific-protocol adherence.
- Document protocols and experimental reasoning clearly to support reproducibility and rubric fidelity.
- Work with project leads to ensure tasks meet standards for methodological integrity and benchmark relevance.
Qualifications
- Bachelor''s or Master''s degree in physics, chemistry, materials science, or a closely related field.
- At least 2 years of hands-on research experience or applied technical project work in a physical sciences discipline.
- Strong methodological rigor, experimental reasoning, quantitative analysis, and technical documentation skills.
- Ability to communicate complex technical procedures and findings clearly in professional written English.
- Commitment to consistent protocol adherence and rubric fidelity.
- Experience creating or evaluating scientific assessments or rubrics is preferred.
- Familiarity with high volumes of technical data and formats such as PDFs and spreadsheets is preferred.
Work Terms
- Remote, independent-contractor engagement.
- Work is completed on a per-task basis, and completion time varies based on experience and workflow.
- Minimum submission requirements apply, including a minimum number of tasks per week.
- Selected candidates should be prepared to begin their first tasks within 24 to 48 hours after completing the required onboarding steps.
Compensation
- $30 to $50 per hour.
- Compensation is output-based and paid per task that meets project specifications.