Argentinian Spanish Audio Evaluator for AI Research

Join a high-impact audio AI research project as an Argentinian Spanish Audio Generalist Evaluator Expert. This role focuses on transcription, annotation, and evaluation tasks that are essential for training and benchmarking advanced language models. Ideal candidates will possess strong academic or analytical backgrounds, be fluent in Spanish (Argentina) and English, and have a passion for translating complex audio and visual information into precise, well-structured text.

• Transcribe and Optimize Audio & Video
  • Listen to, analyze, and transcribe audio and video content in Spanish (Argentina), adhering to detailed constraints and instructions.
  • Produce high-quality written outputs, providing support in English when required.
  • Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.
• Define and Document Evaluation Standards
  • Establish clear expectations for correct and high-quality responses in general consumer audio contexts.
  • Develop detailed evaluation rubrics and grading guidelines in Spanish (Argentina) and English.
  • Document standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing and Grading
  • Run prompts through language models and assess generated outputs.
  • Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance
  • Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet quality standards.
  • Maintain consistency and reliability before datasets are integrated into official benchmarks.
  • Collaborate with project leads to resolve ambiguities and improve task design.

• Strong writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Fluency in Spanish (Argentina) and English (spoken and written).
• Available to commit 10, 20 hours per week.

• College students or recent graduates.
• Background in linguistics, humanities, social sciences, or technical fields.
• Prior experience with transcription, annotation, evaluation, or research workflows.
• Interest in AI, language models, or applied research environments.

• Complete a short AI-led interview (approximately 15 minutes).
• If selected, you will be onboarded and invited to begin project work.

• Work in a structured, goal-oriented project environment with clear tooling, guidelines, and support.
• Gain hands-on exposure to real-world AI research and evaluation workflows.