Product Marketer for AI Agent Evaluation

Shape realistic product marketing simulations that help evaluate and improve AI agents performing complex, tool-based marketing work. You will turn hands-on product marketing experience into high-fidelity scenarios, artifacts, and evaluation standards that distinguish strong professional judgment from plausible but incorrect responses.

The work centers on simulated marketing organizations with realistic email, file storage, CRM, project management, social media, web analytics, AEO/SEO, advertising, CMS, product analytics, and support tools. These environments include authentic-looking documents, dashboards, personas, and intentionally embedded issues.

• Create product marketing task briefs based on work you have personally performed, identifying the embedded issue and the decision an effective practitioner should make.
• Define the documents, dashboards, personas, and tool states needed to make each scenario realistic.
• Write or review reference answers and scoring criteria that separate strong work from plausible but incorrect work.
• Review AI agent attempts and assess them against the established quality standard.
• Develop scenarios involving messy or conflicting data analysis, prioritization and tradeoffs, planning and execution, QA and reconciliation, triage and escalation, research and evaluation, reporting, and multi-step work across several tools.

• Win/loss analysis
• Positioning
• Launch readiness and launch execution
• Adoption analysis
• Competitive response

• Hands-on product marketing experience, including ownership of launches, positioning, and enablement, rather than only managing others who perform this work.
• Comfort working with a CRM such as Salesforce, product analytics such as Amplitude, and a project tracker such as Asana or Linear.
• Experience building AI training environments, reinforcement-learning environments, or simulated case studies is strongly preferred.
• Rubric Academy or Rubric Bootcamp certification is strongly preferred.
• Clear written reasoning and the ability to explain why a decision is correct.

• Hourly engagement.

• $60 to $100 per hour.

Applicants complete a short, multiple-choice knowledge screening assessment specific to product marketing before their application is reviewed.