Machine Learning Engineer, Model Evaluation & Experimentation

Help advance frontier AI models by creating rigorous, agentic machine learning evaluation tasks. You will turn open-ended research ideas into complete experiments, establish what a correct solution looks like, and identify where models succeed or fall short.

• Translate real machine learning research ideas, such as modifying a reinforcement learning reward calculation, into clear multi-step evaluation tasks.
• Implement technical changes, configure and run training experiments, and analyze results end to end.
• Create tasks involving reinforcement learning concepts, including reward functions and training behavior.
• Evaluate how frontier models approach assigned tasks and document where and why their performance falls short.
• Work closely with researchers and other subject-matter experts to keep tasks consistent, rigorous, and fair.

• Master''s degree or PhD in machine learning, computer science, or another STEM discipline, or equivalent practical experience in a research-intensive domain.
• At least 1 year of experience in a research or research-engineering role.
• Hands-on experience training and evaluating ML models, including experiment setup, execution, and analysis.
• Strong understanding of large language model capabilities, limitations, and evaluation methods.
• Working proficiency with Python and Git, including scripting and notebook-based workflows.
• Basic knowledge of reinforcement learning, including reward functions and policy training, is preferred.
• Experience with AI training, model evaluation, or benchmark or task authoring is preferred.
• Excellent attention to detail, creativity in task design, strong written communication, and the ability to work independently through ambiguous problems.

• Remote role open to candidates located in the United States.
• Full-time W-2 employment, approximately 35 hours per week.
• Tasks typically require one to two days of continuous, focused work and involve implementation, experiment execution, and rigorous analysis.
• The employer of record provides payroll, benefits, and compliance support, with placement on a client team and integration into standard enterprise workflows.

$60 to $90 per hour.

Opportunities may be discovered through a separate platform. Employment, onboarding, payroll, and benefits are administered by the employer of record.

Equal employment opportunity is provided without discrimination based on race, religion, color, national origin, sex, pregnancy, childbirth, reproductive health decisions, related medical conditions, sexual orientation, gender identity or expression, age, protected veteran status, disability, genetic information, political views or activity, or any other legally protected characteristic. Reasonable accommodations are available for qualified individuals with disabilities and disabled veterans throughout the application process.