About this role
Help strengthen AI security training by assessing vulnerability reproduction and remediation tasks for technical accuracy, realism, and completeness. You will evaluate CVE reproductions, proposed fixes, verification methods, and Docker-based lab environments, then provide clear written feedback using defined rubrics.
Key Responsibilities- Review vulnerability reproduction and remediation tasks used to train and evaluate advanced AI models.
- Assess whether CVE reproductions faithfully represent the underlying vulnerability and exploitable conditions.
- Evaluate the soundness of remediation approaches and the rigor of verification logic.
- Review Docker and Docker Compose environments to confirm they accurately recreate multi-container vulnerability scenarios.
- Deliver clear, rubric-based written feedback on quality, fidelity, and completeness.
- 3+ years of hands-on experience in application security, penetration testing, or vulnerability research.
- Strong knowledge of CVE taxonomy and severity frameworks, including CVSS, CWE, and CAPEC.
- Demonstrated secure-coding and remediation expertise across SQL injection, command injection, buffer overflow, deserialization, SSRF, misconfigurations, and privilege escalation.
- Experience designing or evaluating two-part verification approaches that include functionality tests and vulnerability tests.
- Proficiency with Docker and Docker Compose for multi-container vulnerability reproduction environments.
- Offensive-security certifications such as OSCP, GPEN, GWAPT, or an equivalent are preferred.
- Experience with CVE disclosure, responsible vulnerability reporting, or maintaining exploit proof-of-concept code is preferred.
- Experience in DevSecOps, CI/CD security gating, SAST/DAST tooling, technical content review, assessment design, or QA for security-focused engineering tasks is preferred.
- Remote role, available to candidates located in the United States.
- Hourly engagement.
$70 to $90 per hour.