Tagalog Audio Evaluator

Join a high-impact audio AI research project as a Tagalog Audio Generalist Evaluator Expert. This role focuses on transcription, annotation, and evaluation tasks that are essential for training and benchmarking advanced language models. Ideal candidates will have a strong academic or analytical background, fluency in Tagalog and English, and a passion for translating complex audio and visual information into precise, well-structured text.

• Transcribe and Optimize Audio & Video
  • Listen to, analyze, and transcribe audio and video content in Tagalog, adhering to detailed constraints and instructions.
  • Produce high-quality written outputs with supporting work in English when required.
  • Ensure clarity, accuracy, and adherence to formatting and stylistic guidelines.
• Define and Document Evaluation Standards
  • Establish clear expectations for correct and high-quality responses in general consumer audio contexts.
  • Develop detailed evaluation rubrics and grading guidelines in Tagalog and English.
  • Document standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing and Grading
  • Run prompts through language models and assess generated outputs.
  • Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance
  • Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet quality standards.
  • Maintain consistency and reliability before datasets are integrated into official benchmarks.
  • Collaborate with project leads to resolve ambiguities and improve task design.

• Minimum Qualifications
  • Strong writing, editing, and critical thinking skills.
  • Ability to work independently, manage time effectively, and meet deadlines.
  • Fluency in Tagalog and English (spoken and written).
• Preferred Qualifications
  • College students or recent graduates.
  • Background in linguistics, humanities, social sciences, or technical fields.
  • Prior experience with transcription, annotation, evaluation, or research workflows.
  • Interest in AI, language models, or applied research environments.

This is a short-term, structured engagement that provides hands-on exposure to real-world AI research and evaluation workflows.

The hourly compensation for this role is $50.

Applicants must be fluent in Tagalog and English and able to work independently.