About this role
Role Overview
As a Product & UX Design Expert, you will collaborate with leading AI labs to enhance frontier agent evaluations in product design. Your primary responsibility will be to create long-horizon product design tasks that reflect your existing work, each accompanied by a deterministic rubric to assess agent performance against verifiable ground truth. Tasks must yield checkable answers, ensuring clarity and precision in evaluation.
Key Responsibilities- Develop scenarios focusing on:
- Flow completeness: Design user flows that encompass all necessary states, including empty, loading, error, permissions, and success.
- Design system fidelity: Utilize components and tokens from a defined design system instead of one-off values.
- Spec handoff: Create annotated specifications that include a required-field checklist, accessibility annotations, and measurable copy constraints.
- Engage in challenging tasks that require extended periods of focused work.
- Minimum of 3 years of experience as a product or UX designer in a SaaS or consumer product environment.
- A portfolio showcasing shipped flows rather than concept work.
- Proficiency in one or more of the following areas: advanced Figma (auto-layout, variables, components), design-system development, WCAG and accessibility standards, prototyping, and spec annotation and handoff.
- Ability to read and produce various product design artifacts, including flows, mocks, specs, and design system audits.
- Strong written communication skills, capable of articulating reasoning step by step and encoding it into deterministic rubrics.
- Must be located in the United States or Canada.
This is a remote, hourly position.
CompensationCompensation ranges from $85 to $115 per hour, depending on domain expertise and prior experience. High-performing contributors will have opportunities for promotion based on the quality of tasks completed and throughput.