Data Engineer for AI Coding Model Evaluation

Evaluate frontier AI coding agents on realistic data engineering work, helping improve how models reason about and implement data infrastructure.

This remote, hourly engagement centers on structured technical assessments of AI-generated data engineering solutions.

• Use AI coding agents to complete and evaluate complex data engineering tasks.
• Review model-generated implementations for ETL pipelines, data warehouses, analytics platforms, and distributed data systems.
• Identify bugs, edge cases, scalability concerns, and failure modes.
• Compare outputs from multiple frontier models and assess their relative strengths and weaknesses.
• Apply professional engineering judgment to realistic data engineering scenarios.

• At least 2 years of professional data engineering experience.
• Experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems.
• Regular experience using AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Ability to evaluate model-generated data infrastructure and pipeline implementations.
• Experience operating large-scale data platforms is preferred.

• Remote, hourly engagement.
• Work is organized into 12 to 24 hour sprints.

• $400 per accepted task.
• Typical tasks take about 2 to 3 hours after ramp-up.
• Payment is tied to accepted work.