About this role
Role Overview
Apply your legal writing judgment to help improve next-generation AI systems. This remote contract engagement focuses on evaluating and analyzing AI-generated legal and technical content, rather than providing legal advice or representation. No attorney-client relationship is created, and no prior AI experience is required.
Key Responsibilities
- Evaluate and compare AI-generated responses to legal and technical prompts for clarity, tone, and instruction compliance.
- Assign quality scores and write detailed rationales for assessments.
- Identify authoritative-sounding content that lacks precision, includes unsupported claims, or overstates conclusions.
- Detect inconsistencies, ambiguities, and factual inaccuracies in digital content.
- Assess whether writing is appropriately qualified and tailored for legal, regulatory, client, or public audiences.
- Document findings carefully in online review platforms.
- Collaborate asynchronously with project managers and reviewers to maintain consistent evaluation standards.
- Independently manage deliverables and deadlines according to project requirements.
Qualifications
- English as a first language or fully equivalent written fluency.
- A qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Experience drafting briefs, motions, memoranda, legal opinions, or regulatory submissions.
- Experience reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals.
- Strong technical writing, content evaluation, legal drafting, document review, editing, critical analysis, written communication, and attention-to-detail skills.
- Ability to work independently and collaborate virtually.
- Experience with digital document review platforms or annotation tools is preferred. Familiarity with model evaluation or RLHF is helpful but not required.
Work Terms
- Remote, independent contractor engagement.
- Work involves evaluation and analysis of written content, not legal representation or legal advice.
Compensation
$90 to $140 per hour.
Application
Apply using email or Google sign-in and complete the required terms and privacy-policy acknowledgement.