Open Source Software Engineer for AI Evaluation

This role offers an exciting opportunity for an open source contributor with extensive expertise in programming languages such as Python, Java, C, JavaScript, or TypeScript. You will collaborate on impactful projects that have a global reach, leveraging your strong command of programming fundamentals and a history of high-quality contributions to leading open-source repositories.

• Design and oversee the creation of evaluations for a wide range of coding tasks across multiple languages, including JavaScript, TypeScript, Python, Java, and C.
• Develop test cases to accurately assess system performance in diverse engineering scenarios.
• Analyze system behavior based on real-world user use cases to uncover strengths and areas for improvement.
• Communicate evaluation results effectively to the research team to support ongoing development and optimization.

• A strong GitHub (or similar) presence with frequent, high-quality contributions to top open-source projects in the last 12 months.
• Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript.
• Deep familiarity with widely-used libraries, frameworks, and tools in your language(s) of choice.
• Excellent understanding of software architecture, performance tuning, and scalable code patterns.
• Strong collaboration skills and experience working within distributed, asynchronous teams.
• Confidence in independently identifying areas for contribution and executing improvements with minimal oversight.
• Comfortable using Git, CI/CD systems, and participating in open-source governance workflows.