About this role
Join a dynamic team as a Bilingual Italian STEM Expert, where your expertise in biology, physics, or chemistry will play a crucial role in developing and refining high-quality reasoning questions for AI model evaluation. This position offers a unique opportunity to ensure scientific accuracy and instructional quality in assessment items while working remotely.
Key Responsibilities- Design and Optimize STEM-Based Prompts (Bilingual): Create detailed prompts in Italian and/or English with multiple constraints and scientifically accurate instructions.
- Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts and develop comprehensive rubrics that account for scientific rigor and linguistic clarity, using regionally appropriate terminology and academic tone.
- Conduct Model Testing and Grading (Bilingual): Run prompts through AI models and assess preliminary outputs for scientific accuracy, reasoning quality, and clarity, comparing Italian and English responses as needed.
- Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards, maintaining consistency and reliability across Italian-language benchmarks.
- Native-level fluency in Italian (written), specifically from Italy or Italian-speaking Switzerland.
- Strong reading and writing proficiency in English.
- BS or BA in Biology, Physics, or Chemistry.
- Familiarity with undergraduate-level biology, physics, or chemistry topics.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- 2+ years of experience in teaching, research, or an applied STEM discipline.
- Experience working with Italian or Swiss secondary/university STEM curricula.
- Expected commitment: Minimum 20 hours per week.
- Work environment: Structured project setting with defined goals, tools, and review processes.
- Hourly rate: $38 - $43.
- Must be a native speaker from Italy or Italian-speaking Switzerland.