About this role
Role Overview
Join a talent network that will support future research projects evaluating how well AI systems perform real-world consulting tasks. In this role you will help define assessment standards and judge consulting outputs, ensuring evaluations are rigorous, reproducible, and defensible. There is no immediate project opening; accepted applicants will be considered for relevant opportunities as they arise.
Key Responsibilities- Design task-specific grading rubrics for consulting deliverables, including market analyses, strategy recommendations, financial models, client-ready presentations, and implementation roadmaps
- Evaluate AI-generated and human-created consulting work against established criteria
- Provide detailed written justifications for evaluations and scores
- Apply consistent, evidence-based judgment so assessments are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate on submitted work
- Note: specific responsibilities will vary by project
- Minimum 1+ years of professional management consulting experience
- Prefer experience at a leading strategy or management consulting firm, such as McKinsey, Bain, BCG, or equivalent
- Strong skills in structured problem solving, market sizing, financial modeling, business-case development, and executive-level presentation creation
- Exceptional written communication skills
- Detail-oriented and consistent approach to evaluating complex deliverables
- Comfortable receiving feedback and calibrating judgment against established standards
- Location: Remote
- Employment type: hourly
100 - 150 hourly
Eligibility and Availability- There is no immediate project opening; qualified applicants may be contacted when relevant opportunities become available
- Placement in projects depends on future project availability and fit