Data Analyst for AI Training and Evaluation

Role Overview

Apply your data judgment to help evaluate and improve advanced AI systems. Your professional standards and subject-matter expertise will inform the reference criteria used to assess AI-generated analysis.

This is an ongoing talent-pool listing for analytics and data practitioners interested in AI training and evaluation work, rather than a guarantee of an immediate project. New projects may begin with short notice, and qualified candidates are contacted when a suitable assignment becomes available.

Key Responsibilities

• Create analysis problems based on work you have delivered, including the data, business question, constraints, and a reference answer against which model responses can be evaluated.
• Review AI-written analyses and data pipelines, assessing whether queries answer the requested question, joins create unintended fan-out, and metrics support the conclusions claimed.
• Identify technically valid outputs that could still mislead decision-makers because of selection effects, data leakage, or metrics that do not reflect the intended outcome.

Qualifications

• Professional experience in analytics, data engineering, statistics, or machine learning.
• Experience delivering analyses that informed real decisions.
• Clear written communication and the ability to explain your reasoning.
• Comfort working through ambiguity and raising unclear instructions.

This opportunity may cover business intelligence, data engineering, statistics, and machine learning. Formal training background is less important than demonstrated ability to deliver decision-ready analysis.

Work Terms

• Remote, hourly engagement.
• This listing itself does not make hiring decisions or issue acceptances or rejections.
• If a project matches your specialty, you may receive an invitation to a separate project listing that specifies the client, rate, and hours. Hiring decisions are made for that individual project.
• Match timing depends on active client needs and may range from about one week to several months.

Compensation

$70 to $120 per hour. Specific project terms are provided in the matching project listing.

Eligibility

Complete registration once to be considered across all networks for which you qualify. Completing the domain-expert interview and joining each network you qualify for can improve the likelihood of being matched.

Application Process

• Submit your resume and confirm your work location.
• Complete a short AI interview, approximately 20 minutes.
• Your background is verified and, if appropriate, you are added to the data analysis talent pool for future project matching.