About this role
Role Overview
Help shape realistic brand marketing simulations that evaluate and improve AI agents performing real marketing work. These environments mirror a marketing organization’s working tools, including email, file storage, CRM, project management, social media management, web analytics, AEO/SEO, advertising, CMS, product analytics, and support systems. They include realistic documents, dashboards, personas, and intentionally embedded issues that test professional judgment.
Key Responsibilities
- Create brand marketing task briefs based on work you have personally performed, defining the underlying issue and the decision an experienced practitioner should make.
- Specify the documents, dashboards, personas, and tool states needed to make each task realistic.
- Develop or review reference answers and evaluation criteria that distinguish strong responses from answers that sound plausible but are incorrect.
- Assess AI agent attempts against the quality standard you establish.
- Support scenarios involving messy or conflicting data analysis, prioritization and tradeoffs, planning and execution, quality assurance and reconciliation, triage and escalation, research and evaluation, reporting, and multi-step work across several tools.
Brand Marketing Scope
Work may cover brand and share-of-voice analysis, maintaining messaging consistency across regions and channels, distinctive asset management, and channel and tactic decisions.
Qualifications
- Hands-on brand marketing experience, including ownership of positioning, brand tracking, and brand investment decisions.
- Comfort interpreting brand tracking studies, share-of-voice data, and Google Analytics 4.
- Experience building AI training environments, reinforcement learning environments, or simulated case studies is strongly preferred.
- Rubric Academy or Rubric Bootcamp certification is strongly preferred.
- Strong written reasoning skills, with the ability to clearly explain why a decision is correct.
Compensation
$60 to $100 per hour.
Screening
Applicants complete a short, multiple-choice knowledge screening assessment focused on this brand marketing specialty before their application is reviewed.