About this role
Role Overview
STEM PhDs based in Latin America apply their research expertise to evaluate and refine large language models for specialized scientific and technical domains. You will create and assess domain-specific prompts, evaluate model outputs, and help shape high-quality evaluation criteria that improve LLM performance in mathematics, chemistry, biology, physics, and engineering.
Key Responsibilities- Develop domain-specific prompts and tasks for large language models.
- Evaluate LLM responses for accuracy, completeness, and alignment with domain knowledge.
- Translate complex research concepts into clear, structured instructions and objective evaluation criteria.
- Perform topic research, using AI tools as an assistant, to inform prompt design and evaluations.
- Learn and apply new skills while contributing to AI development across scientific disciplines.
- Accept project assignments as they become available; placement depends on current project needs.
- Doctoral students or graduates, including current PhD candidates and postdoctoral researchers, in Mathematics, Chemistry, Biology, Physics, or Engineering.
- Strong written communication, with the ability to convert advanced research knowledge into clear tasks and measurable evaluation rubrics.
- Confidence that your domain expertise exceeds current AI systems in explaining and reasoning about key concepts in your field.
- Status: Independent contractor, not a full-time employee.
- Location: Fully remote, must reside in Latin America.
- Schedule: Flexible and asynchronous. The role does not impose a minimum hour requirement.
- Typical commitment when assigned to an active project is approximately 10 to 20 hours per week, though many contributors work about 5 to 20 hours per week on active projects.
- Duration and availability: The program runs year-round, with projects opening periodically by discipline. Placement into specific projects depends on current project availability, and contributors may be considered for future projects as they become available.
- Pay rate: Up to $30/hr (depending on the project).
- Residents of Latin America only.
- F-1 students who are eligible for CPT or OPT may qualify to participate, subject to your school and Designated School Official confirmation. If your school requires enrollment in a CPT course, this program may not meet that requirement.
- STEM OPT is not supported.
- Create a contributor profile on the platform and provide required identification information.
- Complete identity verification so you can be matched to projects.
- Onboard into relevant projects by completing any project-specific instructions or assessments.
- Begin assigned project work and receive payment according to the project terms.