Management Consultant for AI Evaluation

Engage in a unique opportunity to shape the future of AI in consulting by evaluating the performance of AI systems in real-world scenarios. This role focuses on defining excellence in consulting deliverables and creating robust grading criteria, rather than producing deliverables yourself.

• Design precise, task-specific grading criteria for real-world consulting deliverables, including market analyses, strategy recommendations, financial models, client-ready slide decks, and implementation roadmaps.
• Score AI-generated and human work samples against established criteria, providing detailed written justifications for every score.
• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

• 5+ years of professional management consulting experience.
• Background at a top-tier strategy or management consulting firm (e.g., McKinsey, Bain, BCG, or equivalent).
• Deep fluency in structured problem solving, market sizing, financial modeling, business-case building, and slide-based executive communication.
• Exceptionally strong written communication skills.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.

This is a remote, hourly position.

The hourly compensation ranges from $150 to $220.

Qualified applicants may be asked to complete a brief assessment or submit additional information as part of the application process.