About this role
Role Overview
Design and build competitive programming problems, reference solutions, and robust checkers that train and evaluate next-generation AI models. You will create unique problems not found on existing online judges, implement C++ checkers that handle multiple valid outputs and edge cases, and produce well-documented artifacts that guide model training and evaluation. No prior AI experience is required, your competitive programming expertise is the primary qualification.
Key Responsibilities- Create novel competitive programming problems and corresponding Reinforcement Learning environments that test model reasoning and problem solving.
- Author reference solutions and comprehensive test suites that cover edge cases and varied solution strategies.
- Design and implement checkers for problems with multiple valid outputs, ensuring correctness and robustness.
- Evaluate and validate participant or model submissions against complex problem statements sourced from platforms such as Codeforces.
- Collaborate with the customer or product team to refine problem requirements and resolve ambiguous scenarios.
- Write clear, maintainable C++ code to assess diverse outputs efficiently.
- Document checker logic, describe intricacies and edge cases in writing and verbally, and provide actionable feedback to problem setters and reviewers.
- Keep up to date with competitive programming standards and incorporate best practices into checker and test design.
- Proven expertise in competitive programming, including problem analysis and test case design.
- Advanced proficiency in C++, demonstrated by the ability to implement robust checker solutions and reference implementations.
- Strong analytical skills to interpret complex constraints and account for multiple correct solution paths.
- Excellent written and verbal communication skills, able to explain technical details clearly.
- High attention to detail for code validation and output consistency.
- Experience working independently in a remote, collaborative environment.
- Ability to deliver high quality, well documented code under tight deadlines.
- Preferred, but not required: prior work as a problem setter, tester, or checker on major competitive programming platforms.
- Engagement type, independent contractor.
- Remote position.
- Minimum commitment, 15 hours per week or more.
- Listed pay range, $45 to $65 per hour.
- Compensation structure is output based; experts are paid per task that meets project specifications.
- Time to complete tasks may vary by experience and workflow.
- Minimum submission requirements apply. The source notes, experts must submit a minimum of tasks per week, the specific minimum was not provided in the source.
- Candidates will be identified and vetted as part of the selection process, including use of an automated recruiter system referenced in the source.
- Roles are typically filled within 48 hours of selection.
- If selected, you are expected to begin your first tasks within 24 to 48 hours after completing onboarding.