About this role
Role Overview
STEM PhDs based in Latin America apply advanced scientific and technical expertise to evaluate and improve large language models. Contributors design domain-specific prompts, assess model outputs, and research topics with AI assistance while helping shape LLM behavior across disciplines. Project placement varies by discipline and openings are offered periodically throughout the year.
Key Responsibilities- Develop and refine domain-specific prompts and tasks for LLM evaluation.
- Evaluate and annotate LLM responses against clear criteria, documenting strengths and failure modes.
- Translate complex technical knowledge into concise, structured instructions and evaluation rubrics.
- Conduct independent research on topics of interest with the support of AI tools.
- Learn and apply new skills relevant to AI evaluation and model development.
- Doctoral students or graduates, including current PhD candidates and postdoctoral researchers, in Mathematics, Chemistry, Biology, Physics, or Engineering.
- Strong written communication skills, with demonstrated ability to convert advanced research concepts into clear tasks and evaluation criteria.
- Confidence that your domain knowledge exceeds current AI systems in explaining and reasoning about key concepts in your field.
- Willingness to learn new techniques and contribute to interdisciplinary AI work.
- Status: Independent contractor, this is not a full-time employee role.
- Location: Fully remote, must reside in Latin America.
- Schedule: Flexible and asynchronous. Expected commitment when assigned is approximately 10 to 20 hours per week, though there is no formal minimum. Contributors commonly work about 5 to 20 hours per week on active projects.
- Program timing: Projects run year-round, but availability varies by discipline. Placement on a project depends on current project needs, and contributors may be considered for future projects as they open.
Up to $30/hr (depending on the project)
Eligibility and Work Authorization- Applicants must reside in Latin America.
- F-1 students may be eligible if they have appropriate CPT or OPT authorization. Consult your Designated School Official to confirm eligibility, because if your institution requires enrollment in a CPT course, this remote contractor work may not meet that requirement.
- STEM OPT is not supported for this work.
- Create an account on the program portal and complete the requested profile information.
- Complete identity verification as part of eligibility checks.
- Browse and join relevant projects, then complete any project-specific onboarding steps.
- Begin assigned project work and receive compensation according to each project`s terms.