About this role
Role Overview
Help evaluate and improve frontier AI coding agents by applying professional backend engineering judgment to realistic software engineering workflows and structured technical assessments. This role focuses on testing and analyzing model-generated code, identifying failure modes, and comparing outputs from multiple state of the art coding models rather than shipping product features.
Key Responsibilities- Use frontier AI coding agents to complete complex backend engineering tasks and assessments.
- Review model-generated code for correctness, quality, maintainability, and performance.
- Identify bugs, edge cases, and failure modes in model outputs.
- Compare outputs from multiple frontier models, documenting strengths and weaknesses for each.
- Apply professional engineering judgment to realistic backend scenarios, including APIs, distributed systems, microservices, backend platforms, and databases.
- Contribute to structured technical assessments that help improve frontier AI coding models.
- Minimum 2 years of professional backend engineering experience.
- Hands-on experience building or operating APIs, distributed systems, microservices, backend platforms, or databases.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated code, identify bugs and architectural tradeoffs, and reason about edge cases and failure modes.
- Experience with large-scale production systems is preferred.
- Location: Remote.
- Engagement type: Hourly contractor.
- Time commitment: Sprint based project work, running in 12 to 24 hour stretches based on client requirements.
- Availability: Spots are limited and filled on a first come, first served basis.
- Listed hourly rate: $85 per hour.
- Project pay: $400 per accepted task.
- Typical task duration: Approximately 2 to 3 hours after ramp-up.
- Payment is tied to accepted work.