Musician for AI Model Evaluation

Evaluate outputs from generative music AI models, providing detailed, technical judgments on lyrics, vocals, composition, and production. This role focuses on listening, scoring, and annotating AI-generated music in the domain language indicated in the job title, using industry terminology and structured taxonomies.

• Listen to and evaluate AI model outputs, including lyrics, voice generation, arrangement, and production quality.
• Rate AI-generated music samples head-to-head on musicality, creativity, adherence to the prompt, vocal quality, and mix or production quality, applying audio-engineering terminology.
• Score the quality of musical training data used to train models.
• Annotate songs in detail, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics, using a provided structured taxonomy.
• Write music in the domain language listed in the title as part of assessments when required.
• Follow directions provided in English and apply evaluation guidelines consistently.

• At least 3 years of professional experience as a music producer, audio engineer, and/or sound mixer.
• Demonstrable understanding of musical performance, music theory, and lyrics.
• College degree in music that includes coursework or training in performance, theory, and lyric writing.
• Past experience writing lyrical music in the domain language listed in the title.
• Native or near-native proficiency in English, and the ability to understand and follow directions in English.

• Location: Remote.
• Employment type: Hourly.
• Start date: Immediate.
• Duration: Up to 6 months.
• Commitment: Part-time, minimum 10+ hours per week.

Hourly rate between 9.63 and 17, paid according to the stated hourly arrangement.

• Ability to perform evaluations and write music in the domain language listed in the job title, English (India).
• Must be able to understand directions in English and demonstrate native or near-native English proficiency.

• Submit a resume and complete the application form.
• Participate in a 25-minute conversational interview covering your background, experience, and motivations.
• Receive next steps and onboarding information within a few days after the interview.

All qualified applicants will be considered without regard to legally protected characteristics, and reasonable accommodations are available upon request.