Biologist for AI Model Evaluation

Use deep biology knowledge to design, solve, and document challenging biology problems that probe and improve large language models. Work remotely as a contractor to produce clear, step-by-step solutions, annotations, and evaluation benchmarks spanning early undergraduate through PhD-level biology topics. This role emphasizes rigorous reasoning, strong English comprehension, and the ability to simplify complex concepts for model evaluation and training.

• Design and solve challenging Biology problems intended to reveal limitations and failure modes of large language models.
• Create high-quality, step-by-step solutions with clear, rigorous reasoning suitable for model fine-tuning and evaluation.
• Break down complex biological concepts into simple, pedagogical explanations, including text, visuals, or simulations when appropriate.
• Collaborate with LLM researchers to align problem types and solutions with evaluation goals, focusing on areas where models struggle such as conceptual abstraction, multi-step reasoning, and data interpretation.
• Contribute to defining new evaluation benchmarks based on Biology curricula from early undergraduate to PhD-level topics.
• Provide constructive feedback and detailed annotations on model outputs and task designs.

• Solid foundation in Biology at levels expected for engineering entrance exams and graduate or PhD-level programs.
• Strong analytical and research skills, with a structured approach to solving complex biological problems.
• Excellent written English comprehension and the ability to communicate complex ideas clearly and concisely.
• Experience or aptitude for giving detailed, constructive feedback and annotations.
• Creative and lateral thinking to craft novel problem types and evaluation scenarios.
• Self-motivated and able to work independently in a fully remote environment.
• Technical setup: reliable desktop or laptop and a good internet connection.
• Preferred: currently pursuing or holding a Master’s, PhD, or Postdoctoral degree in Biology, Biotechnology, Biochemistry, or a closely related field.

• Location: Remote.
• Engagement type: Contractor assignment / freelancer.
• No employer-provided medical or paid leave as part of this contractor engagement.
• Work is project-based, with the potential for contract extension based on performance and project needs.

• Candidates pursuing a Master’s, PhD, or Postdoctoral degree in Biology, Biotechnology, Biochemistry, or a related field are eligible and encouraged to apply.

Candidates who meet the qualifications and eligibility criteria should apply as instructed in the job posting. Applications from those currently pursuing or holding advanced degrees in relevant fields are encouraged. Applicants will be evaluated against the listed responsibilities and qualifications.