About this role
Role Overview
You will define and evaluate excellence in real-world marketing work for an AI evaluation project, creating task-specific grading criteria and scoring AI and human-generated marketing samples with rigorous, evidence-based written justifications rather than producing marketing deliverables yourself.
Key Responsibilities- Design precise, task-specific grading criteria for marketing deliverables, including creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, and client-ready presentations
- Score AI-generated and human work samples against those criteria, providing detailed written justifications for every score
- Apply consistent, evidence-based judgment so scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on grading rubrics and scoring
- 5+ years of professional experience in marketing or advertising
- Background as a creative director, account lead, or brand strategist at top-tier global creative agencies, or senior brand marketing roles at leading consumer companies
- Deep fluency in the day-to-day craft: writing and evaluating creative briefs, developing campaigns across channels, setting brand positioning and messaging, and judging creative work against a brief and business objectives
- Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar
- Detail-oriented and consistent, comfortable having your judgment reviewed and calibrated against peers
- Prior experience with AI training, evaluation, or human-data projects is a strong plus
- No specialized media-planning or measurement background is required for this role
- Location: Remote
- Employment type: Hourly engagement
Pay range: USD 80 - 150 per hour
Application Process- Submit your resume or a summary of relevant professional experience to begin
- Qualified candidates may be asked to complete a brief assessment or provide additional information