About this role
Role Overview
Help improve next generation AI systems by providing high quality, real world evaluations, annotations, and feedback. You will assess how AI models learn, reason, and perform across a range of subject areas.
Key Responsibilities
- Evaluate and score AI generated responses against defined rubrics and metrics.
- Annotate and categorize datasets to improve model accuracy and reliability.
- Review content for relevance, coherence, and factual accuracy.
- Provide clear, actionable feedback that supports ongoing model improvements.
- Work with the customer team to interpret guidelines and help refine evaluation rubrics.
- Document findings and maintain precise records of annotations and evaluations.
- Critically read and analyze complex material in areas including business, finance, marketing, healthcare, and legal topics.
Qualifications
- Bachelor''s degree required.
- Exceptional attention to detail and accuracy in annotation and content evaluation.
- Strong critical reading and analytical abilities, including the ability to interpret and apply rubrics.
- Strong written and verbal communication skills, with the ability to explain nuanced feedback clearly.
- Experience evaluating or scoring high volumes of content against detailed criteria.
- Ability to work independently and collaboratively in a fully remote environment.
Preferred Qualifications
- Experience with AI training, machine learning data annotation, human in the loop systems, or quality assurance for AI generated content.
- Background in business, finance, legal, marketing, healthcare, or research.
- Familiarity with industry standard annotation tools or AI evaluation platforms.
Work Terms
- Remote contract engagement.
Compensation
- $20 to $80 per hour.