About this role
Role Overview
Help evaluate how advanced AI systems handle chemistry-related requests, distinguishing legitimate technical questions from requests with meaningful misuse potential. This writing-intensive, remote role relies on expert judgment to assess where the boundary lies between chemical mechanisms and actionable procedures.
Key Responsibilities
- Create challenging single-turn chemistry prompts categorized as benign, dual-use, or adversarial.
- Evaluate model responses against a defined policy standard and determine whether each response was handled appropriately.
- Write reference answers that show what a correct response should include, along with clear technical reasoning.
- Provide written rationales that non-specialists can understand.
Qualifications
- Hands-on experience in chemical synthesis, analytical chemistry, or chemical safety.
- Relevant backgrounds may include chemical defense research; synthetic or process chemistry; analytical chemistry; industrial hygiene or process safety engineering; and forensic or toxicological chemistry.
- Technical writing experience, published research, or expert witness experience is strongly valued. Include a writing sample or link with your application.
- Prior AI red-teaming or model-evaluation experience is preferred but not required.
Work Terms
- Remote, per-task engagement.
- The work involves reading and writing about chemistry misuse scenarios for sustained periods. You will be briefed in advance and may pause or step away at any time without penalty.
Compensation
65 to 75 per task.
Eligibility
- Do not use or draw on classified, export-controlled, NDA-covered, or prepublication-review information.
- Applicants with these obligations may still be considered if they disclose them in their application so the work can be appropriately scoped.