Legal Professional for AI Model Evaluation

Role Overview

Experienced legal professionals are invited to evaluate and enhance the capabilities of AI systems in managing legal research, contracts, litigation workflows, and legal operations. This role leverages your expertise with tools such as LexisNexis, Litify, DocuSign, and NetDocuments to create realistic legal scenarios, assess AI outputs, and improve model accuracy.

Key Responsibilities

• Create legal workflow prompts and synthetic case/contract scenarios.
• Evaluate AI-generated legal reasoning, citations, and workflows.
• Identify edge cases such as missed deadlines, hallucinated citations, contract conflicts, and billing discrepancies.
• Build evaluation rubrics and expert reasoning traces.

Qualifications

• 4, 9+ years in legal research, litigation, contracts, legal operations, or legal systems.
• Strong experience with LexisNexis, Litify, DocuSign, and/or NetDocuments.
• Excellent legal writing and analytical skills.
• Familiarity with AI tools like ChatGPT or Claude.
• JD, paralegal certification, or legal operations experience preferred.

Nice to Have

• AI evaluation or RLHF experience.
• Experience with Clio, Westlaw, Relativity, Ironclad, or iManage.
• Understanding of legal ethics, privilege, and AI compliance.

Work Terms

• Commitments Required: 40 hours per week with 4 hours overlap with PST.
• Engagement Type: Contractor assignment (no medical/paid leave).
• Duration of Contract: 4 weeks; expected start date is next week.

Perks of Freelancing

• Work in a fully remote environment.