Video Annotator for AI Model Evaluation

Role Overview

A US-based AI company at the forefront of AI research is looking for a detail-oriented and analytically consistent Video Annotator to evaluate visual and creative content using structured rating frameworks and detailed guidelines. In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems. This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks.

Key Responsibilities

• Evaluate visual and media content using structured guidelines and predefined rating frameworks.
• Provide clear, well-structured written justifications to support evaluation decisions.
• Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks.
• Identify quality gaps related to realism, composition, motion, lighting, and overall production standards.

Qualifications

• 1+ years of professional work experience.
• Media/agency experience is nice to have.
• Hands-on experience working directly with designers, photographers, or videographers.
• Experience with AI image or video generation tools is a strong plus.
• Strong understanding of motion realism, lighting, camera movement, composition, and production quality.
• Strong analytical, logical reasoning, and research skills, along with excellent communication and collaboration abilities, with proficiency in English.
• Incorporate feedback from LLM performance metrics into training data creation.
• Ability to commit to 40 hours per week, with candidates who can join immediately preferred.

Nice to Have Qualifications

• Bachelor’s degree or higher in Design, Visual Communication, or Fine Arts.
• Film, Media, Animation, or VFX.
• Photography or Cinematography.
• Architecture or Industrial Design.
• Creative Writing or equivalent professional experience in content creation, media production, or content review.

Benefits

• Opportunity to work on cutting-edge AI projects.
• Competitive compensation.
• Flexible working hours and remote work environment.

Application Process

• Shortlisted candidates will complete an assessment.
• Successful candidates will be interviewed.
• Once the assessment is cleared, candidates can start.