Software Engineer for AI Code Evaluation
Up to $90/hr (depending on the project)
RemotePart-timetechnology
Apply NowAbout this role
Role Overview
Software Engineers apply their development expertise to evaluate AI-generated code and technical content, providing structured feedback that helps improve AI understanding of programming tasks, system design, and engineering best practices. This is an ongoing, project-based, part-time contract role that can be performed remotely alongside your primary employment.
Key Responsibilities- Design job-related coding questions and prompts that reflect real-world engineering problems.
- Review AI-generated code and technical explanations for correctness, efficiency, clarity, and alignment with production engineering practices.
- Provide structured, detailed feedback and corrections according to provided technical guidelines.
- Document common failure modes, edge cases, and recommended improvements to prompts or evaluation criteria.
- 4+ years of professional software engineering experience, internships excluded.
- Experience as a Software, Backend, Frontend, Full-Stack, or Systems Engineer.
- Strong coding skills in at least one major language, such as Python, Java, C++, JavaScript, Go, or similar.
- Experience building and debugging production-level code.
- Ability to work independently and follow detailed technical guidelines.
- Strong written communication skills and high attention to detail.
- Part-time, hourly contract engagement, remote and asynchronous.
- Flexible hours with no minimum required hours, suitable to be done alongside primary employment.
- Ongoing, project-based engagements. Placement into specific projects is dependent on project availability.
- Apply once to be considered; if qualified, you will be considered for part-time, project-based work as opportunities become available.
Up to $90/hr (depending on the project)
Eligibility- F-1 students who are eligible for CPT or OPT may be eligible for projects on the platform, subject to your school and Designated School Official approval.
- If your school requires enrollment in a CPT course for eligibility, these projects may not meet that requirement.
- STEM OPT is not supported.
- Create an account on the platform and complete identity verification.
- Complete the required coding assessment as part of the selection process.
- Onboard into relevant projects and review each projects instructions and evaluation guidelines.
- When placed on a project, begin reviewing AI outputs and submit evaluations to receive compensation.