Data Entry Keyer

Role Overview

Create realistic data entry and validation evaluations that help improve next-generation AI systems. You will turn real-world data quality challenges into expert tasks, datasets, answer states, and detailed grading standards.

Key Responsibilities

• Design expert evaluation tasks that reflect practical data entry and validation challenges for AI agents.
• Build and curate complex datasets, including CSV files, PDFs, spreadsheets, and technical documents containing malformed records, missing information, and inconsistent formatting.
• Define the precise corrected outcome for each task, including error cases and reconciliation requirements.
• Write detailed grading rubrics with 35 or more criteria to assess AI outputs for accuracy and completeness of error detection.
• Ensure tasks reflect the standards and complexity of regulated or audit-sensitive environments.
• Collaborate asynchronously through clear written and verbal communication to refine evaluation materials.

Qualifications

• Extensive data entry, quality assurance, or data validation experience, particularly in healthcare claims, finance back-office operations, legal operations, or another regulated or audit-sensitive setting.
• A demonstrated record of achieving and documenting high accuracy standards, including measurable error rates and outcomes.
• Strong ability to identify data inconsistencies, silent truncations, and formatting irregularities across file types.
• Proficient written English for drafting complex evaluation tasks and comprehensive grading rubrics.
• Exceptional attention to detail, accuracy discipline, error detection, format reconciliation, and a process-oriented working style.
• Experience in work where compliance, accuracy, or data integrity is critical is highly valued.
• Comfort working independently and communicating proactively in a remote, distributed environment.
• No prior AI experience is required.

Work Terms

• Remote contract engagement.
• Compensation is output-based and paid per task that meets project specifications; completion time varies by experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks submitted each week.
• Selected candidates should be ready to begin their first tasks within 24-48 hours after completing the required onboarding steps.

Compensation

Advertised compensation range: $20 to $35 per hour.