Data Entry Keyer

Apply data-entry and validation expertise to create realistic benchmark tasks that help improve how AI systems learn, reason, and perform. This remote contract role focuses on the accuracy, reconciliation, and error-detection standards used in regulated and audit-sensitive work.

• Design expert-level evaluation tasks that reflect real-world data-entry and validation challenges for AI agents.
• Create and curate complex CSV files, PDFs, spreadsheets, and technical documents containing realistic issues such as malformed records, missing data, and inconsistent formatting.
• Define the required final state for each task, including exact error cases and reconciliation requirements.
• Write detailed grading rubrics with 35 or more criteria to assess AI outputs for accuracy and completeness of error detection.
• Ensure tasks reflect the complexity and standards of highly regulated or audit-sensitive environments.
• Collaborate asynchronously through clear written and verbal communication to refine evaluation materials.

• Strong accuracy discipline, error-detection ability, format-reconciliation skills, and exceptional attention to detail.
• Extensive experience in data entry, quality assurance, or data validation, preferably in healthcare claims, finance back office, legal operations, or another regulated or audit-sensitive field.
• Ability to achieve and document high accuracy standards, including measurable error rates and outcomes.
• Ability to identify data inconsistencies, silent truncations, and formatting irregularities across multiple file types.
• Proficient written English for drafting complex evaluation tasks and comprehensive grading rubrics.
• A disciplined, process-oriented approach, comfort working independently, and proactive communication in a remote, distributed environment.
• Experience in work where compliance, accuracy, or data integrity carries high stakes is highly valued.
• No prior AI experience is required.

• Remote, independent contractor engagement.
• Work is output-based and time to complete tasks varies by experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks each week.
• Selected candidates should be ready to begin their first tasks within 24-48 hours after completing the required onboarding steps.

• $20 to $35 per hour equivalent, paid per task that meets project specifications.