About this role
Role Overview
AI Evaluation Specialists test and evaluate large language models, applying academic knowledge and careful judgment to improve model responses and behavior while collaborating with leading AI research labs.
Key Responsibilities- Work remotely and independently on short-term AI training projects that involve reviewing, rating, or editing model outputs.
- Apply your coursework, domain knowledge, and reasoning skills to assess model performance on real tasks.
- Follow detailed instructions and quality guidelines to produce consistent, high-quality evaluations.
- Complete a brief training module and a single assessment before beginning paid work.
- Contribute feedback that helps researchers refine model behavior and training data.
- Current student pursuing an Associate’s, Bachelor’s, or Master’s degree, or a holder of those degrees.
- Strong attention to detail and the ability to follow step-by-step instructions accurately.
- Comfortable working asynchronously in a remote environment and collaborating with external AI research teams.
- No prior AI or specialized technical experience required; training will be provided.
- All disciplines and majors are welcome to apply.
- Part-time, remote engagement with flexible scheduling.
- Short-term projects with no minimum hourly commitment.
- Independent work, completed asynchronously according to project timelines.
- Up to $17/hr (depending on the project)
- Open to students and graduates holding Associate’s, Bachelor’s, or Master’s degrees as described above.
- Successful performance on initial projects may make you eligible for additional paid projects in the future, subject to project availability.
- Create a candidate profile and submit basic information.
- Verify your identity as part of eligibility checks.
- Complete onboarding for projects that match your profile, including the provided training and the required assessment.
- Begin assigned tasks and receive payment for completed work.