About this role
Role Overview
Support a research program with a leading AI lab by benchmarking and improving state of the art language models. This part time role focuses on creating evaluation content, formulating research questions and answers, and producing clear, well summarized research outputs to help refine advanced AI systems.
Key Responsibilities- Design and produce high quality research questions, model answers, and evaluation materials for language model benchmarking.
- Perform targeted online research, gather information from diverse sources, and synthesize findings into concise summaries.
- Evaluate model outputs against established criteria and document results for research teams.
- Communicate findings clearly in written form and follow structured guidelines for task completion.
- Work under a defined, low pressure structure that is not equivalent to a high intensity internship or full time consulting engagement.
- Currently enrolled in or recently completed Masters studies, or 2 to 3 years of relevant experience plus a Bachelors degree from a reputable institution.
- Strong online research skills and excellent written communication.
- Ability to gather, distill, and clearly summarize information from multiple sources.
- Detail oriented, reliable, and able to follow structured task instructions.
- Interdisciplinary degree or background is a plus.
- Required device: a Macbook with an M series chip as described below.
- Engagement type: hourly, part time.
- Estimated commitment: approximately 10 to 20 hours per week.
- Location: remote.
- Preferred start: immediate.
- Tasks focus on research and evaluation for AI model improvement, with clearly defined deliverables and timelines.
- Pay rate: 50 to 60 hourly.
- Must have a Macbook device with an Apple Silicon based M series chip to perform tasks.
- Accepted Mac hardware includes Apple Silicon ARM Macs, M series MacBook Pro models, or MacBook Air models running macOS 15 or higher.
- Applicants should meet the educational or experience requirements listed under Qualifications.
- Submit your resume to apply.
- Complete a brief, 15 minute conversation with an AI interviewer that assesses research and reasoning skills.
- Take a short paid assessment to demonstrate fit for the role.
- Expect follow up communication within a few days about your application status and next steps.