About this role
Role Overview
Drive the creation of high-quality training and benchmark datasets that improve how large language models write, reason about, and verify code. You will curate examples, produce precise solutions, and correct code across multiple programming languages while working closely with researchers and engineering teams. The hiring organization is a San Francisco based research accelerator for frontier AI labs and a partner to enterprises, supporting customers by accelerating research with high-quality data and advanced training pipelines staffed by specialist researchers, and by turning AI proofs of concept into reliable, production intelligence that delivers measurable business impact.
Key Responsibilities
- Curate code examples, implement solutions, and correct code in Python, JavaScript including ReactJS, C and C++, Java, Rust, and Go as part of AI training pipelines.
- Evaluate and refine AI-generated code for efficiency, scalability, and reliability, and produce clear evaluation rationales.
- Collaborate with cross-functional research and engineering teams to improve AI-driven coding solutions against industry performance benchmarks.
- Design and build agents or automated tools that verify code quality and detect common error patterns.
- Formulate hypotheses about steps in the software engineering lifecycle, including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, and maintenance, and evaluate model capabilities on those steps.
- Design verification mechanisms that can automatically confirm a solution to a software engineering task.
Qualifications
- Several years of professional software engineering experience.
- At least 2 years of continuous full-time experience at a top-tier product company, for example Google, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, or IBM Research.
- Strong expertise building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, system design, development practices, debugging, and code quality assessment including code review.
- Excellent oral and written communication skills, able to produce clear, structured evaluation rationales.
Work Terms
- Location: Remote.
- Engagement type: Contractor, independent contractor relationship, no medical or paid leave provided.
- Time commitment: Flexible engagement, minimum 10 hours per week, up to 40 hours per week, with partial overlap required with Pacific Time working hours.
- Duration: 1 month starting next week, with potential extensions based on performance and fit.
Compensation
Not specified in the source material.
Eligibility
- Candidates must meet the experience requirements above, including the 2-plus years of continuous full-time experience at a top-tier product company where indicated.
- No specific work authorization or sponsorship information was provided in the source; candidates should be able to contract remotely under the stated contractor terms.