About this role
Role Overview
Apply advanced mathematical reasoning, problem-solving, computational thinking, and clear written communication to improve and evaluate large language models. This remote contract role combines challenging mathematics, model evaluation, Python-based computational work, and formal proof tasks in Lean.
Key Responsibilities
- Create original, challenging mathematics problems that test large language model reasoning, including multi-step, abstract, and proof-based problems.
- Solve problems independently and produce detailed, logically structured solutions with clear justifications.
- Review model-generated solutions, identify mathematical errors and missing arguments, and provide precise feedback, annotations, and corrections.
- Help define evaluation benchmarks covering mathematics curricula from early undergraduate through Ph.D.-level topics.
- Design precise, closed-ended prompts for computational projects, write reliable Python code, verify numerical answers, and provide clear rationales.
- Develop and validate Python solutions for computational tasks using approved scientific libraries.
- Complete Lean theorem-prover tasks, including translating mathematical problems and proofs into formal language and confirming that formal proofs compile correctly.
Qualifications
- Strong mathematical foundation at engineering entrance-exam, graduate, or Ph.D. level.
- Research and analytical skills, with the ability to solve complex mathematics problems through a structured, logical approach.
- Ability to explain complex mathematical concepts clearly using simple language, visuals, and examples.
- Ability to provide constructive feedback and detailed annotations.
- Creative and lateral thinking skills.
- Excellent structured communication and collaboration skills in a remote environment.
- Self-motivated, independent work style.
- A desktop or laptop and reliable internet connection.
Eligibility
Candidates pursuing a Master’s, Ph.D., or postdoctoral degree in Mathematics, Applied Mathematics, Statistics, or a related field are eligible and encouraged to apply.
Work Terms
- Fully remote contractor assignment.
- Choose a commitment of 20, 30, or 40 hours per week.
- Commit at least 4 hours per day and maintain 4 hours of overlap with Pacific Time.
- This independent contractor engagement does not include medical benefits or paid leave.