About this role
Role Overview
Apply hands-on production expertise to create realistic evaluation materials that help advance next-generation AI systems. This remote contract role focuses on translating real-world film, television, digital, and live-event production judgment into high-quality tasks, documentation, solutions, and assessment criteria. Prior AI experience is not required.
Key Responsibilities
- Design and write evaluation tasks based on realistic production-management scenarios, including budget reconciliation, schedule changes, and vendor or crew coordination.
- Source, create, and curate authentic production artifacts, such as budgets, contracts, call sheets, delivery schedules, and crew assignments.
- Define complete solutions and sound decisions that account for multiple production constraints and reflect genuine industry complexity.
- Develop detailed, multi-item rubrics with 35 or more criteria to assess decision-making, constraint management, and reasoned judgment on production deliverables.
- Document production processes and workflows in clear, precise written English for benchmarking and technical review.
- Collaborate with the project team to refine task design and align work with current industry practices.
- Contribute insight into real production challenges to maintain authentic, rigorous evaluation standards.
Qualifications
- At least 5 years of credited project experience in film, television, digital, or live-event production.
- Demonstrated production mastery, including direct responsibility for managing and reconciling production budgets, call sheets, and contracts.
- Proven vendor and crew coordination experience in constrained environments, balancing time, cost, and resource needs.
- Strong multi-constraint judgment, analytical ability, and commitment to realistic, high-standard industry benchmarks.
- Exceptional written and verbal communication skills, especially for production documentation and technical materials.
- Experience creating or evaluating multi-criteria rubrics or technical assessment tools.
- Ability to work independently and proactively in a remote, asynchronous engagement.
Work Terms
- Remote contract engagement.
- Work is paid on an output basis for tasks that meet project specifications. Time required may vary by experience and workflow.
- Minimum submission requirements apply, including a minimum number of task submissions each week.
- Roles are typically filled within 48 hours. Selected candidates should be ready to begin their first tasks within 24 to 48 hours after completing onboarding.
Compensation
$45 to $85 per hour.
Application Process
Submit an application and complete the required screening and onboarding steps. Selection enables access to initial project tasks.