Marketing Professional for AI Evaluation

Join a leading AI research organization as a marketing expert, where you will play a pivotal role in evaluating the performance of AI systems in real-world marketing scenarios. Instead of producing marketing deliverables, you will define excellence by designing grading criteria and rigorously scoring completed work samples with well-reasoned justifications.

• Design precise, task-specific grading criteria for various marketing deliverables, including creative briefs, campaign concepts, brand positioning frameworks, ad copy, and client-ready presentations.
• Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your assessments.

• 5+ years of professional experience in marketing or advertising.
• Experience as a creative director, account lead, or brand strategist at top-tier global creative agencies, or in senior brand marketing roles at leading consumer companies.
• Deep understanding of the marketing craft, including writing and evaluating creative briefs, campaign development, and brand messaging.
• Exceptional written communication skills, with the ability to articulate why a piece of work meets or does not meet the standards.
• Detail-oriented and consistent, with a comfort level in having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.
• No specialized media-planning or measurement background is required.

This position is remote and is offered on an hourly basis.

The hourly compensation ranges from $80 to $150.

Applicants must have the required qualifications and experience as outlined above.