About this role
Role Overview
Evaluate outputs from generative music AI models in Turkish and English, judging lyrics, voice generation, and musical production. You will compare and score AI-generated samples, annotate detailed song characteristics, and assess the quality of musical training data in support of a research partnership with a leading AI lab.
Key Responsibilities- Listen to and evaluate AI-generated music samples across genres and styles in Turkish and English.
- Rate samples head-to-head on musicality, creativity, prompt adherence, vocal quality, and production and mix quality, using audio engineering terminology.
- Evaluate lyrics and voice generation against quality standards.
- Score the quality of musical training data used to train the models.
- Annotate songs in detail using a structured taxonomy, including genre and sub-genre classification, song structure, and vocal and instrumental characteristics.
- Produce and/or write music in Turkish as required for assessment tasks.
- Follow directions and evaluation guidelines provided in English.
- At least 3 years of professional experience as a music producer, audio engineer, or sound mixer.
- Demonstrable understanding of musical performance, music theory, and lyric composition.
- College degree in music that includes coursework or training in performance, theory, and lyrics is preferred.
- Proven experience writing lyrical music in Turkish.
- Native or near-native proficiency in Turkish and strong proficiency in English, including the ability to follow instructions in English.
- Location: Remote.
- Start date: Immediate.
- Duration: Up to 6 months.
- Commitment: Part-time, minimum 10 hours per week.
- Employment type: Hourly engagement.
- Hourly rate: 12 to 21.6 hourly.
- Submit your resume and complete the provided application form.
- Participate in a 25-minute conversational interview focused on your background, experience, and motivations.
- Receive next steps and onboarding details within a few days after the interview.
- You must be able to read, write, and produce music in Turkish and understand evaluation instructions in English.
- Placement on the project begins immediately when selected and is contingent on meeting the listed qualifications and completing the onboarding steps.
- All qualified applicants will be considered without regard to legally protected characteristics, and reasonable accommodations are available upon request.