About this role
Join a dynamic team as a Bilingual Portuguese STEM Expert, where your expertise in biology, physics, or chemistry will play a crucial role in developing high-quality reasoning questions to evaluate AI models. This position offers the opportunity to ensure scientific accuracy and instructional quality in assessment items while working remotely.
Key Responsibilities- Design and Optimize STEM-Based Prompts (Bilingual): Create detailed prompts in Portuguese and/or English that adhere to multiple constraints and maintain scientific accuracy.
- Define and Document Evaluation Standards: Establish expectations for correct responses in STEM contexts and develop comprehensive rubrics that ensure scientific rigor and linguistic clarity, using regionally appropriate terminology.
- Conduct Model Testing and Grading (Bilingual): Run prompts through AI models, assessing outputs for scientific accuracy, reasoning quality, and clarity, while comparing responses in Portuguese and English as necessary.
- Support Benchmarking and Quality Assurance: Collaborate in quality assurance processes to ensure that prompt tasks and rubrics meet scientific standards and maintain consistency across Portuguese-language benchmarks.
- Native-level fluency in Portuguese (written), specifically from Brazil or Portugal.
- Strong reading and writing proficiency in English.
- BS or BA in Biology, Physics, or Chemistry.
- Familiarity with undergraduate-level topics in biology, physics, or chemistry.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- 2+ years of experience in teaching, research, or an applied STEM discipline.
- Experience with academic terminology and STEM educational standards specific to Brazil or Portugal.
- Expected commitment: Minimum 20 hours per week.
- Work environment: Structured project setting with defined goals and tools.
- Hourly rate: $18 - $42.
- Remote work opportunity.