Lifecycle Marketer for AI Agent Evaluation

Shape realistic lifecycle marketing scenarios that help evaluate and improve AI agents performing real-world marketing work. These high-fidelity simulated environments mirror a marketing organization’s tools, including email, storage, CRM, project management, social media management, web analytics, AEO/SEO, advertising, CMS, product analytics, and support systems, using realistic documents, dashboards, personas, and intentionally planted issues.

Role Overview

You will design and pressure-test Lifecycle environments, defining the briefs, supporting artifacts, practitioner judgment calls, and errors that distinguish strong lifecycle marketing work from weaker responses.

Key Responsibilities

• Create task briefs based on lifecycle or CRM marketing work you have personally performed, including the underlying issue being tested and the decision a strong practitioner should make.
• Define the documents, dashboards, personas, and tool states required for a realistic task environment.
• Write or review reference answers and evaluation criteria that distinguish strong responses from plausible but incorrect ones.
• Review AI agent attempts and assess them against the standards you establish.
• Develop scenarios covering diagnosis from messy or conflicting data, prioritization and tradeoffs, planning and execution, QA and reconciliation, triage and escalation, research and evaluation, reporting, and multi-step coordination across several tools.

Lifecycle Scope

• Contact strategy
• Milestone campaigns
• Customer communications
• Deliverability and list health
• Lifecycle portfolio optimization

Qualifications

• Hands-on experience in lifecycle, CRM, or retention marketing, including ownership of a sending program and its incrementality, rather than solely managing others who perform the work.
• Comfort working across an ESP, a CRM such as Salesforce, and product analytics tools such as Amplitude.
• Experience building AI training environments, reinforcement learning environments, or simulated case studies is strongly preferred.
• Rubric Academy or Rubric Bootcamp certification is strongly preferred.
• Clear written reasoning, with the ability to explain why a decision is correct.

Work Terms

• Hourly engagement.

Compensation

• $60 to $100 per hour.

Application Process

Applicants complete a brief multiple-choice knowledge screening assessment specific to lifecycle marketing before their application is reviewed.