About this role
Role Overview
Evaluate generative musical AI models in partnership with a leading AI lab by listening to and analyzing AI-created songs and lyrics in Tamil and English. Provide detailed quality scores, structured annotations, and comparative ratings that use audio engineering terminology to inform model improvement.
Key Responsibilities- Listen to and evaluate AI model outputs, including lyrics and voice generation, across multiple music categories.
- Rate AI-generated music samples head-to-head on musicality, creativity, prompt adherence, vocal quality, and production and mix quality, using audio engineering terminology.
- Score the quality of musical training data used by models.
- Annotate songs in detail using a structured taxonomy, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics.
- Write music in the domain language listed in the title, and apply musical performance, theory, and lyrical knowledge to evaluations.
- Follow directions provided in English while performing evaluations and annotations.
- At least 3 years of professional experience as a music producer, audio engineer, or sound mixer.
- Demonstrable understanding of musical performance, theory, and lyrics.
- College degree in music that includes coursework or experience in performance, theory, and lyrics.
- Past experience writing lyrical music in Tamil.
- Native or near-native proficiency in Tamil and strong proficiency in English, sufficient to understand instructions and complete evaluations.
- Location, remote.
- Employment type, hourly.
- Start date, immediate.
- Duration, up to 6 months.
- Commitment, part-time, minimum 10 hours per week.
Pay range, 10.8 to 19.44 hourly.
Eligibility- Native or near-native Tamil language ability, and strong English comprehension to follow written and spoken directions.
- Ability to produce and assess lyrical music in Tamil.
- Submit a resume and complete the application form.
- Participate in a 25-minute conversational interview covering your background, experience, and motivations.
- Receive next steps and onboarding information within a few days after the interview.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.