About this role
Join a groundbreaking initiative to build realistic enterprise environments for training and evaluating frontier AI agents. This role invites experienced legal-operations and legal-technology professionals from AmLaw 100 firms, Fortune 500 in-house legal departments, and major legal-tech vendors to recreate the digital workspaces they manage daily. Your expertise will be pivotal in designing tasks that genuinely challenge state-of-the-art AI.
Key Responsibilities- Construct a realistic digital workspace using the Drive folders you utilize regularly, including process maps, intake forms, matter-management reports, CLM rollouts, e-discovery plans, vendor-evaluation decks, and email threads, while representing the platforms that support these tasks (e.g., Icertis, HotDocs, Relativity, Clio/MyCase).
- Design multi-step tasks based on your actual workflows that require navigating multiple applications, files, and stakeholders, effectively challenging frontier AI agents.
- Collaborate with fellow legal-operations and legal-tech experts to shape the environment, define task scope, and review scenarios for realism and rigor.
- Work asynchronously with research teams to refine task designs and establish evaluation criteria for legal-tech agent benchmarks.
- Contribute to frontier AI research and benchmarking, with your work directly influencing how leading labs train and evaluate the next generation of AI systems.
- 3+ years of full-time experience in legal operations or legal technology at an AmLaw 100 firm, Fortune 500 in-house legal department, or major legal-tech vendor.
- Experience in one or more of the following areas:
- Legal operations, process improvement, and legal-spend management
- E-discovery and review workflows
- Contract lifecycle management
- Matter management and e-billing
- Legal intake, knowledge management, and enterprise-wide legal program design
- CLOC / ACC Legal Ops involvement is a plus.
- Familiarity with Relativity, Icertis, HotDocs/Contract Express, and Clio/MyCase in day-to-day operations.
- Strong analytical thinking and writing skills, with the ability to translate legal-ops workflows into structured task specifications.
This project will initially offer an effective hourly rate, transitioning to a compensation model based on the throughput of quality work rather than a flat hourly rate.
About UsWe are a talent marketplace connecting top experts with leading AI labs and research organizations, supported by prominent investors. Thousands of professionals across various domains contribute to projects that shape the next generation of AI systems.