About this role
Role Overview
Shape realistic simulated marketing work environments that evaluate and improve AI agents. These environments mirror a marketing organization''s day-to-day toolset, including email, file storage, CRM, project management, social media management, web analytics, AEO and SEO, advertising, CMS, product analytics, and support systems, with realistic documents, dashboards, personas, and intentionally embedded issues.
Key Responsibilities
- Create marketing analytics task briefs based on work you have personally performed, defining the embedded issue and the conclusion a strong practitioner should reach.
- Specify the documents, dashboards, personas, and tool conditions needed to make each scenario realistic.
- Write or review reference answers and scoring criteria that distinguish strong responses from answers that sound credible but are incorrect.
- Review AI agent submissions and assess them against professional marketing analytics standards.
- Develop scenarios involving messy or conflicting data diagnosis, prioritization and tradeoffs, planning and execution, quality assurance and reconciliation, triage and escalation, research and evaluation, reporting, and multi-step work across several tools.
- Apply expertise in anomaly detection, channel performance synthesis, cross-source reconciliation, attribution and incrementality analysis, and decision-supporting reporting.
Qualifications
- Hands-on marketing analytics experience, with direct ownership of the work rather than only management oversight.
- Fluency with Google Analytics 4, a product analytics platform such as Amplitude, a CRM such as Salesforce, and advertising platform reporting.
- Clear written reasoning and the ability to explain why a decision is correct.
- Experience building AI training environments, reinforcement learning environments, or simulated case studies is strongly preferred.
- Rubric Academy or Rubric Bootcamp certification is strongly preferred.
Compensation
Hourly compensation ranges from $60 to $100 per hour.
Application Process
Applicants complete a short multiple-choice knowledge screening assessment focused on marketing analytics before their application is reviewed.