Senior Cybersecurity Professional for AI System Evaluation

Role Overview

Create sophisticated evaluation tasks that test how AI systems handle security operations, incident response, and risk management in high-stakes enterprise environments. You will develop scenarios, reference materials, and scoring rubrics across either the U.S. standards track, NIST Cybersecurity Framework and SOC 2, or the international standards track, ISO 27001 and the EU NIS2 Directive.

Key Responsibilities

• Design cybersecurity scenarios covering security operations center monitoring, incident response and forensics, vulnerability management, and security architecture design.
• Build tasks involving threat detection, digital forensics, vulnerability and penetration testing, security architecture and engineering, and governance, risk, and compliance.
• Create scenarios using enterprise tools such as Splunk, Microsoft Sentinel, CrowdStrike, Tenable, Qualys, and GRC platforms.
• Apply threat modeling, incident response playbooks, and risk-assessment methods to the applicable standards track.
• Produce reference incident reports, security assessments, architecture designs, and compliance documentation.
• Write rubrics that identify authentic senior-level security judgment rather than generic textbook or certification-level knowledge.

Qualifications

• At least 5 years of experience as a security engineer or CISO at a major company or security firm, such as Mandiant or CrowdStrike, or as an in-house CISO or security lead.
• Direct ownership of incident response programs, security architecture, or compliance initiatives.
• Strong command of security tooling, regulatory frameworks, and the current threat landscape.
• CISSP, CISM, or a comparable international credential is strongly preferred.
• Previous rubric-writing or training-content authorship is a plus.

Work Terms

• Remote, hourly engagement.

Compensation

• $80 to $90 per hour.

Eligibility

• Professionals qualified in the U.S. track, the international track, or both are encouraged to apply.