In-House Counsel for AI Legal Evaluation

Evaluate how well AI systems answer practical questions of German law by running the same prompts through two large language models, comparing their outputs, and scoring responses against a standardized rubric. You will produce concise written feedback for each evaluation. This is a remote role for lawyers practicing in Germany.

• Run an identical set of prompts across two AI (LLM) platforms
• Compare the outputs from both platforms side by side
• Score each response using a standardized rubric provided to you
• Submit concise written feedback for every evaluation

• Minimum 5 years experience as in-house legal counsel practising in Germany
• Strong knowledge of German law, particularly commercial and contract matters
• Excellent attention to detail and clear, precise written communication
• Able to work independently following a rubric and meeting deadlines

Remote, Germany-based engagement. Initial commitment of approximately 10 hours, with strong potential for additional work. All evaluations are covered by a confidentiality agreement that you must sign.

Rate: 140 - 150 per hour.

• Must be based in Germany and have the required in-house counsel experience listed above
• Must be willing and able to sign and comply with a nondisclosure agreement for the work