About this role
Role Overview
Evaluate outputs from generative music AI models in Arabic and English, providing detailed, technical judgments on lyrics, vocal generation, and production quality. Your ratings and annotations will help improve model performance across genres and song types for a leading AI research engagement.
Key Responsibilities- Listen to and evaluate AI-generated music samples, including lyrics and voice generation.
- Rate samples head-to-head on musicality, creativity, prompt adherence, vocal quality, and production and mix quality, using audio engineering terminology.
- Score the quality of musical training data used by models.
- Annotate songs with detailed metadata, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics, following a provided structured taxonomy.
- Write music in the domain language named in the title and apply domain-specific judgment when evaluating outputs.
- Follow directions and evaluation instructions presented in English.
- At least 3 years of professional experience as a music producer, audio engineer, and/or sound mixer.
- Demonstrable understanding of musical performance, music theory, and lyrical composition.
- College degree in music that includes coursework or training in performance, theory, and lyrics.
- Prior experience writing lyrical music in Arabic.
- Native or near-native proficiency in Arabic and English, with the ability to understand and act on directions given in English.
- Start date: Immediate.
- Engagement length: Up to 6 months.
- Commitment: Part-time, 10 or more hours per week.
- Location: Remote.
- Employment type: Hourly.
Hourly pay range: 12 - 44.25 hourly.
Eligibility- Fluency requirement: Native or near-native Arabic, and strong English comprehension.
- Applicants will be considered without regard to legally protected characteristics, and reasonable accommodations are available on request.
- Submit your resume and complete the application form.
- Participate in a 25-minute conversational interview covering your background, experience, and motivations.
- Receive next steps and onboarding details within a few days after the interview.