Litigation Attorney for AI Model Evaluation

Turing invites Litigation and Civil Procedure experts to join projects that fine-tune AI models like ChatGPT. You will apply your expertise in trial strategy, motion practice, discovery, and procedural rules to evaluate how AI handles complex litigation scenarios. If you enjoy analyzing case strategy, identifying procedural deficiencies, and providing rigorous legal feedback, this is your opportunity. No prior AI experience is required, your background in U.S. litigation practice is exactly what’s needed.

Key Responsibilities

• Review and evaluate AI-generated responses to U.S. litigation hypotheticals, including motion to dismiss arguments, summary judgment analyses, discovery disputes, and trial strategy questions.
• Apply a structured legal rubric to assess issue spotting, procedural accuracy under the Federal Rules of Civil Procedure, and proper application of case law and evidentiary standards.
• Identify gaps in AI reasoning around standing, jurisdiction, burden of proof, pleading standards (Twombly/Iqbal), and remedies.
• Provide detailed, high-quality annotations and written feedback to refine AI models.
• Collaborate with researchers and project managers to align evaluation standards and project goals.

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school; Bar admission (active/inactive).
• 3+ years of U.S. legal practice in civil litigation, commercial litigation, or appellate work.
• Strong reasoning skills across the Federal Rules of Civil Procedure, evidence, and trial advocacy.
• Excellent written communication and attention to detail.
• High ethical standards; interest in AI is a plus.

Work Terms

• Commitment: Flexible, 10, 30 hrs/week.
• Duration: ~1 month, with the possibility of extension based on performance and project needs.

Compensation

• Competitive compensation.

Eligibility

• Fully remote work arrangement.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Learn how to use AI to advance the legal field.