About this role
Role Overview
Create challenging codebase-exploration tasks that help train AI agents to investigate and reason about unfamiliar production Go repositories. This work centers on engineering questions that require cross-repository investigation, runtime evidence, and the practical judgment used by senior engineers.
Repositories include etcd, Traefik, Helm, Kustomize, CoreDNS, NATS Server, Temporal, Syncthing, restic, Authelia, BadgerDB, quic-go, gRPC-Go, Hugo, rclone, Trivy, cert-manager, and Pion WebRTC.
Key Responsibilities
- Select assignments from a pre-validated set of Go repositories pinned to specific git commits, with an engineering question, positive and negative rubrics, foils, and a reference solution.
- Investigate the relevant subsystem and associated pull request or issue history until you understand its runtime behavior.
- Refine questions so they challenge advanced coding agents while remaining specific and fairly answerable.
- Improve rubrics and foils to reward sound reasoning and reject credible but incorrect responses.
- Complete the full validation workflow, Check, Golden, Run, and Analyze, and iterate until each stage passes.
- Record work in the task README, submit it for expert review, and address feedback on returned tasks.
Qualifications
- At least 3 years of professional software engineering experience, including substantial production Go experience.
- Ability to navigate large, unfamiliar Go codebases and explain runtime behavior, not only static source code.
- Fluency with Go concurrency, interfaces, module boundaries, and the standard library, plus comfort reading generated code and build tooling.
- Experience with distributed systems, networking, storage engines, or Kubernetes ecosystem tooling is highly relevant. Task coverage is weighted toward architecture and system design, 42%, code onboarding, 26%, and root-cause analysis, 20%.
- Precise written English, as the questions and rubrics you produce are central deliverables.
- Comfort working with git at the commit level, containerized environments, and command-line tools.
Work Terms
- Remote, asynchronous, per-task contract work with expert leads across US, India, and Nigeria time zones.
- Work is completed in a dedicated workspace; time is tracked with Insightful and access is provisioned through Okta.
- Before receiving task access, contractors must complete identity verification, a background check, signed Terms of Work and CIIAA, a tax form, and a short calibration quiz.
- Each completed task is reviewed by a second engineer and a super reviewer before acceptance.
Compensation
- $130 per approved task.
Application Process
- Submit a resume or relevant technical background.
- Qualified applicants may be asked to complete a brief technical assessment or provide additional information.