Australian In-House Counsel for Legal AI Evaluation

Evaluate AI-generated answers to practical Australian legal questions, applying your in-house legal judgment to help assess quality, accuracy, and usefulness.

In this remote, hourly engagement, you will review responses from two AI language model platforms and assess their performance on Australian law questions.

• Run an identical set of prompts through two AI language model platforms.
• Compare the resulting answers side by side.
• Score each response using a standardized rubric provided for the engagement.
• Provide concise written feedback for every evaluation.

• At least 5 years of experience practising as in-house legal counsel in Australia.
• Strong knowledge of Australian law, particularly commercial and contract matters.
• Excellent attention to detail and precise written English.
• Ability to work independently, follow a rubric, and meet deadlines.

• Remote role based in Australia.
• Hourly engagement with an initial commitment of approximately 10 hours.
• All work is subject to a confidentiality agreement.

$100 to $120 per hour.