Cybersecurity Professional for AI Model Evaluation

Join a dynamic project aimed at enhancing AI systems'' capabilities in cybersecurity. This role invites experienced cybersecurity professionals, including security analysts, penetration testers, incident responders, threat intelligence specialists, and security architects, to leverage their expertise in threat detection, vulnerability assessment, and security operations. Your contributions will play a crucial role in evaluating and improving AI performance on cybersecurity-specific tasks.

• Review and evaluate AI-generated outputs related to threat analysis, vulnerability assessment, security incident triage, and security architecture recommendations.
• Create realistic scenarios based on cybersecurity workflows, including incident response runbooks, threat hunting queries, penetration testing reports, security control assessments, and SOC analyst decision trees.
• Annotate, label, and validate data across various cybersecurity use cases, such as CVE classification accuracy, attack vector identification, SIEM alert triage, and malware behavior analysis.
• Provide structured feedback on AI accuracy in cybersecurity frameworks (NIST CSF, MITRE ATT&CK, CIS Controls, ISO 27001), threat intelligence standards (STIX/TAXII), and industry-specific security terminology.
• Collaborate asynchronously with research teams to refine evaluation frameworks for cybersecurity AI.

• 3+ years of professional experience in cybersecurity within an enterprise organization, managed security service provider (MSSP), consultancy, or government/defense environment.
• Expertise in one or more areas, including:
• Security operations center (SOC) analysis or incident response (DFIR).
• Penetration testing or red team operations.
• Threat intelligence or threat hunting.
• Security architecture, cloud security (AWS/Azure/GCP), or zero-trust design.
• Governance, risk, and compliance (GRC), NIST, ISO 27001, SOC 2, FedRAMP.
• Professional certifications are a plus (CISSP, CISM, CEH, OSCP, GIAC certifications, Security+).
• Strong analytical thinking with the ability to translate security operations and architecture workflows into structured evaluation tasks.
• Clear written communication skills and attention to detail.

• Task Completion Pay: Competitive, based on task quality (~$1, 750, $2, 150 per completed task, subject to change as the project evolves).
• Performance Bonus: Top performers receive a weekly bonus incentive on top of their per task rate.
• Hourly Opportunity: Top performers may be invited to transition to an hourly compensation model based on sustained quality and throughput.