Firefighting Supervisor for AI Model Evaluation
Up to $100/hr (depending on the project)
RemotePart-timetechnology
Apply NowAbout this role
Role Overview
Firefighting Captains and Supervisors apply incident command, training, compliance, and operational experience to evaluate AI-generated content and improve model behavior for firefighting and emergency response tasks. In this project-based, part-time role you will use your professional judgment to assess model outputs, create realistic prompts based on real-world scenarios, and provide clear, structured feedback that helps AI systems better reflect firefighting practices.
Key Responsibilities- Evaluate AI model outputs related to firefighting, rescue, medical care, hazardous materials, and emergency procedures for accuracy, safety, and applicability.
- Create and refine prompts or scenarios that reflect real workplace tasks and language in firefighting and prevention work.
- Provide detailed, structured feedback on model responses to correct mistakes, clarify procedures, and improve situational reasoning.
- Use examples from your supervisory experience to judge appropriate tactics, personnel deployment, equipment use, and safety compliance.
- Work independently on asynchronous assignments and communicate findings or corrections to project teams.
- At least 4 years of professional experience in firefighting, fire prevention, or related supervisory roles.
- Relevant experience may include duties such as supervising and coordinating firefighting and prevention personnel, directing strategic deployment for rescue and fire suppression, conducting training and drills in firefighting and medical care, managing hazardous materials responses, maintaining equipment, evaluating personnel performance, ensuring compliance with fire safety codes, and handling administrative tasks like budgeting and reporting.
- Ability to complete asynchronous work with external AI research teams and to translate operational knowledge into clear, actionable feedback for model improvement.
- Employment type: Part-time, project-based, independent contributor.
- Location: Remote, asynchronous work from any location where you are authorized to work.
- Hours: Flexible, no minimum commitment, most participants average 5 to 20 hours per week.
- This role can be performed alongside primary employment.
- Placement depends on project availability; projects run year-round and new opportunities open periodically across different specialties.
- Up to $100/hr (depending on the project).
- Payments are made per the terms of each project engagement.
- F-1 students with eligible CPT or OPT authorization may be able to participate. Consult your Designated School Official to confirm eligibility.
- If your institution requires a CPT course enrollment, this project-based work may not meet those requirements.
- STEM OPT is not supported for this program.
- Refer to the program help documentation for full details on supported work authorizations and any additional eligibility requirements.
- Create an account with the program and complete the candidate profile.
- Complete identity verification as required for onboarding.
- Review and join projects that match your experience, complete any onboarding steps for those projects, and begin assignments.
- Begin performing tasks and receive compensation according to each project''s payment terms.