Cybersecurity Expert for AI Model Evaluation

Cybersecurity professionals apply offensive and defensive security expertise to design domain-specific prompts and evaluate large language model outputs for AI research projects, improving model behavior, safety, and relevance in security-related scenarios.

• Develop domain-specific prompts, test cases, and evaluation criteria for LLMs focused on security use cases.
• Evaluate and annotate LLM responses for technical accuracy, safety, and potential misuse.
• Identify unsafe model behaviors, incorrect guidance, and vulnerabilities exposed by model outputs.
• Provide clear, actionable feedback and examples to guide model improvement.
• Learn new skills while contributing across security and adjacent domains as project needs arise.

• At least 3 years of professional experience in security engineering or offensive security in roles such as Security Engineer, Penetration Tester, Red Team Engineer, Malware Analyst, Threat Hunter, Threat Intelligence Analyst, Offensive Security Engineer, Vulnerability Researcher, or Security Consultant.
• Hands-on experience with one or more of the following tools: Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat.
• Ability to work independently in a remote, asynchronous setting and to document findings clearly in writing.

• Remote, asynchronous work from any location.
• Part-time engagement with flexible hours, and no minimum weekly time commitment.
• The program runs year-round, however placement into specific projects depends on project availability by domain.

Up to $65/hr (depending on the project)

• F-1 students with CPT or OPT may be eligible, subject to your school’s rules. Confirm eligibility with your Designated School Official. If your school requires a CPT course, this program may not satisfy that requirement. STEM OPT is not supported.

• Create an account and complete your profile on the program site.
• Complete the required identity verification.
• Apply to or join projects that match your expertise and complete project-specific onboarding.
• Begin contributing to project work and receive payment for your participation.