Insurance Professional for AI Model Evaluation

Role Overview

Apply deep insurance expertise to help develop advanced large language models by bringing real-world underwriting, claims, and risk-assessment judgment to AI training and evaluation work.

Key Responsibilities

• Partner with research and engineering teams to address knowledge gaps in underwriting, claims, and risk-assessment reasoning.
• Create challenging insurance-focused tasks and accurate, well-reasoned solutions grounded in practical underwriting and claims experience.
• Evaluate AI model responses using structured rubrics and provide clear written feedback on accuracy, judgment, and reasoning quality.
• Develop and improve evaluation guidelines and scoring rubrics for insurance tasks.
• Work with fellow subject-matter experts to maintain consistent, accurate training data.

Qualifications

• At least 8 years of dedicated professional insurance experience in underwriting, claims, actuarial work, or risk management at a recognized top-tier organization.
• Required hands-on experience evaluating LLM or AI model outputs against rubrics or structured scoring criteria. Applicants should describe this experience in their application.
• Demonstrated career progression, such as advancing from Underwriter to Senior Underwriter to VP of Underwriting.
• Strong verbal and written communication, problem-solving, and interpersonal skills.

Work Terms

• United States-based, hourly W-2 employment.
• Reliable weekday availability of at least 35 hours per week is required.

Compensation

$60 to $80 per hour.

Equal Opportunity

Employment decisions are made without discrimination based on any legally protected characteristic.