Systems Engineer for AI Model Evaluation

This position offers a unique opportunity to contribute to a cutting-edge Frontier Code Agents project in collaboration with a leading AI research lab. As a Systems Engineer, you will play a crucial role in evaluating and enhancing frontier AI coding models through structured technical assessments, focusing on realistic systems engineering workflows and model evaluation.

• Utilize frontier AI coding agents to execute and assess complex engineering tasks.
• Review model-generated code, architecture decisions, and systems implementations.
• Identify bugs, edge cases, performance bottlenecks, and potential failure modes.
• Compare outputs from various frontier models, evaluating their strengths and weaknesses.
• Apply professional engineering judgment to realistic systems engineering scenarios.

This is a sprint-based project requiring a commitment of 12-24 hours based on client requirements.

Compensation is set at $400 per accepted task, with typical tasks taking approximately 2-3 hours after an initial ramp-up period. Payment is contingent on accepted work.

• Minimum of 2 years of professional systems engineering experience.
• Experience with distributed systems, networking, operating systems, storage systems, infrastructure software, or database internals.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Ability to evaluate model-generated systems designs and implementations.
• Preferred experience in building highly scalable and performance-critical systems.