About this role
Role Overview
Create high-quality evaluation tasks that reflect the judgment required in senior product design and AI-assisted development. This role focuses on rapid prototyping, product design, and human-AI collaborative coding, with work calibrated to the complexity, user experience stakes, and scope of major product development and design systems initiatives.
You may contribute through the Vibecoding track, focused on natural-language-driven software development and rapid prototyping, the Design track, focused on product, UX/UI, and visual design systems, or both.
Key Responsibilities
- Design scenarios covering rapid prototyping and iteration, design system development, and cross-functional collaboration among product, design, and engineering teams.
- Create tasks for AI-assisted application development, natural-language-to-code workflows, and rapid prototyping in the Vibecoding track.
- Create tasks for UX/UI design, design systems and component libraries, user research, and usability testing in the Design track.
- Develop scenarios using AI coding assistants such as Cursor, Claude Code, v0, and Replit, as well as Figma, Framer, prototyping tools, and design systems tooling.
- Apply iterative, prompt-driven development methods for Vibecoding and human-centered design principles and heuristic evaluation for Design.
- Produce reference prototypes, code artifacts, design specifications, and usability evaluation reports.
- Write rubrics that distinguish senior-level product judgment from generic, tutorial-level, or template-based work.
Qualifications
- At least 5 years of experience as a product designer, design lead, or AI-native engineer or vibecoder at a major product-focused or design-focused company, such as Figma, Airbnb, Notion, Linear, or a notable independent or startup product builder.
- Experience directly owning product design systems or AI-assisted development workflows that shipped to production.
- Fluency with vibecoding or design tools, along with an understanding of user-centered design and rapid prototyping practices.
- A portfolio of shipped work is strongly preferred in place of a formal credential.
- Experience authoring rubrics, training materials, or design critiques is a plus.
Work Terms
- Remote, hourly engagement.
- Experts qualified in either the Vibecoding or Design subdomain, or both, are encouraged to apply.
Compensation
- $70 to $80 per hour.
Application Process
Apply if your experience aligns with the Vibecoding track, the Design track, or both areas of expertise.