Dutch Audio Evaluator

This role offers a unique opportunity for detail-oriented transcribing and writing experts to contribute to a high-impact audio AI research project with a leading lab. As a Dutch Audio Generalist Evaluator Expert, you will listen to and transcribe audio, annotate images, and evaluate videos to help train advanced language models. This short-term, flexible position is ideal for professionals with strong academic backgrounds who are fluent in both Dutch and English and possess a knack for instructional clarity.

• Create detailed audio and video transcriptions in Dutch, with supporting work in English as needed, adhering to multiple constraints and instructions.
• Establish high-level expectations for correct responses in general consumer audio contexts.
• Develop comprehensive evaluation rubrics and guidelines in both Dutch and English.
• Run prompts through models and assess preliminary outputs against defined expectations.
• Collaborate in QA review processes to ensure prompt tasks and rubrics meet high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks.

• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Fluent in Dutch and English.
• Able to work within GMT or PST working hours.

• College students or graduates.

Expected commitment of 3–6 months. You will work in a structured project environment with clear goals and tools.

Hourly rate of $50.

This role is open to independent contractors.