Firefighting Captain for AI Model Evaluation

Firefighting supervisors apply their command, prevention, and emergency-response expertise to evaluate AI-generated content and provide structured feedback that improves how AI models understand firefighting work and terminology.

• Develop field-relevant prompts for AI models and evaluate their responses.
• Assess AI-generated content related to firefighting and deliver clear, structured feedback.
• Draw on experience supervising firefighting and prevention personnel, coordinating rescue and fire-suppression deployment, conducting drills and training, maintaining equipment, evaluating performance, managing fire-code compliance, and handling budgeting and reporting responsibilities.

• At least 4 years of professional experience in firefighting supervision or related work.
• Ability to work asynchronously in collaboration with leading AI labs.

• Remote, part-time, asynchronous, project-based work that can be performed alongside primary employment.
• Flexible schedule with no minimum commitment. Most projects average 5 to 20 hours.
• Projects are available throughout the year and open periodically across areas of expertise. Placement depends on current project availability; additional projects may become available if a suitable project is not immediately available.

Up to $100/hr (depending on the project)

• F-1 students who are eligible for CPT or OPT may be eligible for projects. Consult your Designated School Official to confirm eligibility.
• If your school requires a CPT course, this work may not meet that requirement. STEM OPT is not supported.

• Create an account, complete identity verification, and complete onboarding for relevant projects before beginning paid work.