STEM Professional for AI Coding Agent Evaluation

Role Overview

Apply your STEM and software development expertise to help improve next-generation AI coding agents through detailed, real-world feedback. You will document how tools such as Copilot support complex development work, helping AI systems learn, reason, and perform more effectively. Prior AI experience is not required.

Key Responsibilities

• Share technical insights and real-world examples of using AI coding agents in complex software development workflows.
• Document nuanced use cases involving large codebase navigation, difficult debugging, and architectural changes.
• Create comprehensive walkthroughs of end-to-end feature development and ambiguous technical problem-solving with AI tools.
• Explain your decision-making, the tools used, and how AI agents affected productivity or code quality.
• Provide structured feedback on the practical effectiveness of AI coding agent features and recommend improvements.
• Collaborate asynchronously with project stakeholders through clear written and verbal communication.

Qualifications

• Current STEM professional who uses AI coding agents in daily technical work.
• Demonstrated ability to use AI agents for sophisticated programming challenges, including large codebase navigation, debugging, and architectural refactoring.
• Experience creating detailed technical documentation or feedback in a collaborative setting.
• Strong written and verbal communication skills, with clarity and thoroughness.
• Familiarity with multiple AI coding tools and an understanding of their strengths and limitations.
• Comfort collaborating remotely and asynchronously with distributed teams.

Work Terms

• Remote contract engagement.

Compensation

• $80 to $100 per hour.