Mathematician for AI Model Evaluation

This role offers an exciting opportunity to engage in projects that enhance and evaluate large language models through advanced mathematical reasoning, problem-solving, and computational thinking. As a Mathematics Expert, you will leverage your expertise to design original mathematical challenges, develop precise computational solutions, and contribute to the future of AI in a fully remote environment.

• Design original and challenging mathematics problems that test the reasoning limits of large language models, particularly in multi-step, abstract, and proof-based contexts.
• Solve problems independently and write detailed, logically structured solutions with clear justifications.
• Review model-generated solutions, identify mathematical errors or missing arguments, and provide precise feedback, annotations, and corrections.
• Contribute to defining new evaluation benchmarks based on Mathematics curricula from early undergraduate to PhD-level topics.
• Develop and validate Python-based solutions for computational tasks using approved scientific libraries.
• Work on theorem-prover tasks using Lean, translating mathematical problems and proofs into formal language and verifying that formal proofs compile correctly.

• Strong analytical skills with a solid foundation in mathematics, particularly at the level expected in engineering entrance exams and graduate or PhD-level programs.
• Ability to provide constructive feedback and detailed annotations.
• Creative and lateral thinking abilities.
• Excellent structured communication and collaboration skills in a remote setting.
• Self-motivated and able to work independently.
• Technical setup with a desktop/laptop and a reliable internet connection.

• Candidates pursuing a Master’s/Ph.D./Postdoctoral degree in Mathematics, Applied Mathematics, Statistics, or a related field are encouraged to apply.
• Ability to analyze and solve complex math problems with a structured and logical approach.
• Ability to explain math concepts clearly using simple language, visuals, and examples.

Contract position with a fully remote work environment.

Competitive compensation based on experience and project needs.

Open to candidates with the required educational background and skills.

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.