About this role
Role Overview
Evaluate and annotate AI-generated music in English (US), providing expert assessments of lyrics, vocal synthesis, musicality, production, and data quality to inform improvements to generative music models.
Key Responsibilities- Listen to and evaluate AI model outputs, including lyrics, voice generation, instrumental performance, and overall production quality.
- Rate AI-generated music samples head-to-head on musicality, creativity, adherence to prompt, vocal quality, and production or mix quality, using audio engineering terminology.
- Score the quality of musical training data used to train models.
- Annotate songs in detail using a structured taxonomy, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics.
- Write and assess lyrical music in English (US) as required by evaluation tasks.
- Follow written and spoken directions provided in English during evaluation tasks.
- At least 3 years of professional experience as a music producer, audio engineer, and/or sound mixer.
- Demonstrable understanding of musical performance, music theory, and lyrics.
- College degree in music that included coursework or training in performance, theory, and lyric writing.
- Past experience writing lyrical music in English (US).
- Native or near-native proficiency in English, able to understand and follow directions in English.
- Location: Remote.
- Employment type: Hourly.
- Start date: Immediate.
- Duration: Up to 6 months.
- Time commitment: Part-time, minimum 10 hours per week.
$30 to $54 per hour.
Eligibility- Must be able to read, write, and follow directions in English (US).
- Must have the music-production and lyric-writing experience described above, including work in English (US).
- Submit your resume and complete the application form.
- Participate in a 25-minute conversational interview focused on your background, experience, and motivations.
- Receive next steps and onboarding details within a few days after the interview.
All qualified applicants will be considered without regard to legally protected characteristics, and reasonable accommodations are available on request.