In-House Counsel for Japanese Legal AI Evaluation
$140–$150/hr
RemoteJapan (remote)Contractlegal
Apply NowAbout this role
Role Overview
Evaluate how AI systems respond to real Japanese-law questions by testing identical prompts on two large language model platforms, comparing the results, and applying a standardized scoring rubric. This role draws on practical in-house legal experience, with particular relevance to commercial and contract matters in Japan.
Key Responsibilities
- Run the same set of legal prompts through two AI platforms.
- Review and compare the two outputs side by side.
- Score each response using the provided standardized rubric.
- Provide concise written feedback for every evaluation.
Qualifications
- At least 5 years of experience practicing as in-house legal counsel in Japan.
- Strong knowledge of Japanese law, especially commercial and contract matters.
- Excellent attention to detail and precise written communication skills.
- Ability to work independently, follow a rubric, and meet deadlines.
Work Terms
- Remote, Japan-based hourly engagement.
- Initial commitment of approximately 10 hours, with potential for additional work.
- All work is subject to a non-disclosure agreement.
Compensation
140 to 150 per hour.