About this role
Role Overview
Evaluate and compare how two large language models answer real questions of Spanish law, scoring their outputs against a provided rubric and delivering concise written feedback. This remote role focuses on practical assessment of AI legal responses, with an initial short engagement and potential for additional assignments.
Key Responsibilities- Run the same set of legal prompts through two AI LLM platforms.
- Compare the outputs from both platforms side by side.
- Score each AI response using a standardized rubric that will be provided.
- Submit concise written feedback for every evaluation.
- Minimum 5 years experience as in-house legal counsel practising in Spain.
- Strong command of Spanish law, with particular expertise in commercial and contract matters.
- High attention to detail, and precise written communication skills.
- Ability to work independently, follow a rubric, and meet deadlines.
- Engagement type, hourly.
- Remote work, candidate must be based in Spain.
- Initial time commitment approximately 10 hours, with strong potential for additional work.
- All work is subject to a confidentiality agreement, an NDA will be required.
Rate: 140 - 150 hourly.
Eligibility- Must have practised as in-house counsel in Spain for at least 5 years.
- Must be able to review and sign an NDA and comply with confidentiality requirements.