Russian Audio QA Specialist for Annotation & Diarization

This role focuses on building a highly accurate, evaluation-grade dataset of transcribed, multi-channel audio recordings aimed at assessing multilingual, multi-speaker AI systems. The project involves evaluating high-quality, realistic conversations that represent diverse dynamics, contexts, and demographics.

Role Overview:

As a QA Specialist, you will be the final line of defense in ensuring the quality of both audio recordings and human-verified annotations. Contributors will record unscripted group conversations, which will undergo initial transcription and diarization. Your responsibility will be to review the end-to-end quality of these recordings and annotations.

Key Responsibilities

Audio Quality Assurance:

• Evaluate multi-channel audio recordings to ensure they meet strict technical and fidelity requirements.
• Verify channel isolation, ensuring no audio bleed, and confirm that recordings were captured in appropriate, quiet environments free from disruptive background noise, clipping, or low gain.

Transcription & Diarization Verification:

• Review human-validated transcriptions to guarantee exceptionally high accuracy and adherence to strict low error-rate (WER) targets.
• Confirm that transcripts correctly capture spontaneous, unnormalized speech, preserving natural conversational dynamics such as overlaps, interruptions, and false starts.
• Validate the precision of turn-level and word-level timestamps, as well as speaker identification, paying special attention to complex, overlapping dialogue, while comfortably reading and validating the underlying JSON-formatted data to ensure accurate metadata tagging and timestamp logic.

Metadata & Content Review:

• Verify the accuracy of all applied metadata, including demographic markers, contextual domains, and specific conversational tags.
• Enforce strict safety and privacy standards by auditing sessions to ensure no Personally Identifying Information (PII), toxic, or sensitive content is present.
• Assess the end-to-end quality of the annotation task, assigning clear pass/fail or agree/disagree statuses during your review.
• Provide detailed, actionable comments and feedback whenever disagreeing with an annotator''s work.

Requirements & Qualifications

• Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping.
• Meticulous attention to detail for verifying word-level timestamps and strict, unnormalized verbatim transcription rules.
• Native proficiency in Russian.
• Ability to accurately assess complex multi-speaker dynamics.

Ideal Backgrounds include:

• Linguists/Phonetics Experts: Deep understanding of natural, unnormalized speech patterns. Expertise in accurately identifying and annotating complex conversational dynamics, including overlaps, false starts, and backchannels.