About this role
Role Overview
Help create realistic simulated marketing environments that evaluate and improve AI agents performing social media work. You will shape the briefs, artifacts, tool states, judgment calls, and quality standards that distinguish expert social media practice from plausible but incorrect work.
Key Responsibilities
- Create social media task briefs based on your hands-on experience, identifying the underlying issue and the decision an experienced practitioner should make.
- Define the documents, dashboards, personas, and states across relevant tools needed to make each scenario realistic.
- Write or review reference answers and evaluation criteria that separate strong responses from weaker ones.
- Assess AI agent attempts against the standards you establish.
- Develop scenarios involving messy or conflicting data analysis, prioritization and tradeoffs, planning and execution, QA and reconciliation, triage and escalation, research and evaluation, reporting, and multi-step work across tools.
- Focus on social inbox management, campaign and publishing execution, share-of-voice analysis, and response decisions for owned brand channels.
Qualifications
- Hands-on experience operating brand social media accounts and managing social inboxes.
- Fluency with a social media management platform such as Sprout Social, plus comfort interpreting native platform analytics.
- Clear written reasoning and the ability to explain why a decision is correct.
- Experience building AI training environments, reinforcement learning environments, or simulated case studies is strongly preferred.
- Rubric Academy or Rubric Bootcamp certification is strongly preferred.
Work Terms
- Hourly engagement.
Compensation
- $60 to $100 per hour.
Application Process
Applicants complete a short multiple-choice knowledge screening assessment for this social media specialty before their application is reviewed.