About this role
Role Overview
Evaluate how accurately AI systems answer real Australian law questions by testing identical legal prompts across two AI platforms. You will compare the responses, assess them using a standardized rubric, and provide concise written feedback.
Key Responsibilities- Run the assigned prompts through two AI language-model platforms.
- Compare both outputs side by side for each prompt.
- Score each response against the provided standardized rubric.
- Submit concise written feedback for every evaluation.
- Qualified to practise law in Australia, with strong knowledge of Australian litigation and procedural law.
- At least 2 years of law-firm or barristers'' chambers experience in litigation, disputes, or other contentious practice, with 3 or more years preferred.
- Current in-house lawyers are eligible only if they moved in-house within the past 2 years and previously worked at a law firm or barristers'' chambers.
- Native or fluent English, with precise written communication skills.
- Ability to work independently, follow a rubric, and meet deadlines.
- Remote role based in Australia.
- Hourly engagement.
- Initial commitment of approximately 10 hours, with potential for additional work.
- All work is subject to a non-disclosure agreement.
$100 to $120 per hour.
EligibilityThis opportunity is for lawyers qualified to practise in Australia.