About this role
Role Overview
Help shape AI evaluation work for legal matters encountered by Fortune 500 and large public companies. You will create realistic enterprise legal scenarios, develop model reference work, and write scoring rubrics that distinguish rigorous legal judgment from superficial responses across complex, high-stakes matters.
Key Responsibilities- Create enterprise legal scenarios spanning in-house counsel, regulatory, transactional, and litigation work.
- Draft and review materials based on enterprise compliance frameworks, including FCPA, SOX, GDPR, HIPAA, and regulations affecting banking, healthcare, pharmaceutical, and insurance organizations.
- Develop tasks involving large-scale commercial agreements, including MSAs, SOWs, DPAs, and licensing arrangements, as well as Fortune 500 M&A diligence.
- Create ERM- and COSO-aligned risk scenarios, board-level reporting materials, and regulated-industry investigation scenarios.
- Write detailed, criterion-based rubrics reflecting the judgment expected of a senior Fortune 500 attorney.
- At least 2 years of experience as in-house counsel at a Fortune 500 or large public company, or as a partner or senior associate at an AmLaw 100 firm representing Fortune 500 clients.
- Deep experience in one or more enterprise practice areas, including M&A, securities, regulatory, employment, intellectual property, privacy, or large-scale commercial contracting.
- Familiarity with CLM platforms such as Ironclad, Agiloft, or Icertis, along with enterprise GRC tools.
- JD and active bar admission.
- Experience authoring rubrics, examinations, or training content is preferred.
- Remote, hourly engagement.
- Minimum commitment of 20 hours per week.
- Complete a paid calibration program before beginning live work, designed to align contributors with the required quality standards.
- High-performing contributors may advance to reviewer, lead, and domain subject-matter expert roles with higher rates.
$110 to $150 per hour, determined by demonstrated expertise.