Data Analyst

Role Overview

Apply your data analysis expertise to evaluate AI assistants in realistic analytical workflows that use cloud data warehouses. Your work will provide high-quality real-world input that helps improve how next-generation AI systems learn, reason, and perform. No prior AI experience is required.

Key Responsibilities

• Complete structured evaluations that simulate analytical work such as anomaly investigations, KPI reporting, and data refreshes using AI-powered tools with cloud data warehouse connectivity.
• Verify AI-generated figures against source data by writing and running SQL queries.
• Assess the accuracy of data joins, filters, and time windows used in AI-generated analysis.
• Maintain, reset, and manage seeded Snowflake datasets to preserve data integrity and correct answer states for test scenarios.
• Manage warehouse roles, permissions, and access controls to support secure, repeatable evaluation environments.
• Configure and document connectivity and authentication processes across analytics and SaaS platforms.
• Investigate and document new or undocumented product behavior encountered during workflow execution.
• Participate in peer calibration sessions to maintain consistent, rigorous scoring and grading.

Qualifications

• At least 3 years of hands-on experience as a Data Analyst or Analytics Engineer.
• Advanced SQL skills and Snowflake expertise, including warehouses, access control, and query history.
• Experience auditing and reconciling reported metrics against raw data, including identifying subtle aggregation or logic errors.
• Experience using connectors across Claude and ChatGPT.
• Familiarity with business and finance analytics, including KPI definitions and reporting for leadership or external stakeholders.
• Experience administering database access, including roles, grants, authentication, and security protocols. Familiarity with OAuth or security integrations is beneficial.
• Working knowledge of SaaS collaboration tools such as Slack, Google Workspace, or Microsoft 365.
• Experience using AI assistants for analytics, with a critical approach to evaluating AI-generated SQL and outputs.
• Experience with rubric-based evaluation, QA, or data labeling, along with strong written and verbal communication and close attention to detail.

Work Terms

• Remote contract engagement.
• Work supports a confidential client project focused on AI-assistant evaluation in real-world analytics workflows.

Compensation

• $50 to $60 per hour.