Litigator for AI System Evaluation

Help build AI evaluation tasks that reflect the judgment, procedural rigor, and evidentiary demands of high-stakes civil litigation and complex disputes. You will create realistic litigation scenarios, model strong work product, and define the standards that distinguish experienced legal analysis from general legal knowledge.

This work supports two standards tracks: a U.S. track covering the Federal Rules of Civil Procedure, Federal Rules of Evidence, and comparable state court rules; and an international track covering the English Civil Procedure Rules and arbitration frameworks including ICC and LCIA rules. Candidates qualified in either track, or both, are encouraged to apply.

• Create litigation scenarios covering pre-trial discovery, motion practice, trial strategy, settlement, and arbitration.
• Develop tasks across commercial, complex, and class action litigation; discovery and evidence management; trial advocacy; and appellate practice.
• Incorporate tools used on major matters, including e-discovery platforms such as Relativity and Everlaw, litigation management software, and deposition and trial-preparation tools.
• Apply the relevant U.S. or international procedural standards to case strategy, discovery and evidence analysis, and motion drafting.
• Produce reference pleadings, discovery responses, motions, and trial memoranda.
• Write rubrics that evaluate authentic senior-litigator judgment rather than law school or bar exam-level recall.

• At least 5 years of experience as a litigator or trial attorney at a major litigation firm or corporate litigation department, such as Quinn Emanuel, Gibson Dunn, Boies Schiller Flexner, Kirkland & Ellis, or as in-house litigation counsel.
• Direct responsibility for complex commercial litigation matters, including trial or arbitration experience.
• Fluency with litigation tools and methodologies, along with practical knowledge of court procedure, discovery, and evidentiary rules.
• A recognized professional credential is strongly preferred, including a JD with bar admission or an international equivalent such as Barrister or Solicitor with advocacy rights.
• Prior experience authoring rubrics or training materials is a plus.

• Remote, hourly engagement.

• $90 to $100 per hour.

Professionals qualified for the U.S. track, the international track, or both are encouraged to apply.