About this role
This role offers a unique opportunity for native German speakers from Austria, Switzerland, or Germany to engage in a high-impact AI research project. As a contributor, you will create German/English prompt-golden answer pairs that are essential for training and evaluating advanced language models. Your expertise in local language usage, tone, and cultural context will be pivotal in ensuring the quality and relevance of the outputs.
Key Responsibilities- Multilingual Prompt Design & Optimization: Create detailed prompts in German and/or English that reflect natural phrasing and real-world relevance for users in Austria, Switzerland, and Germany.
- Define and Document Evaluation Standards: Establish expectations for correct responses in consumer contexts and develop rubrics that account for linguistic nuance and cultural conventions.
- Model Testing and Grading (Bilingual): Assess model outputs for accuracy, fluency, and cultural fit in German, comparing them with English outputs as necessary.
- Benchmarking & Quality Assurance: Collaborate in QA processes to ensure consistency and reliability across German-language benchmarks before they are integrated into evaluations.
- Native-level fluency in German, specifically tailored to Austria, Switzerland, or Germany, with strong reading and writing skills in English.
- Must be native to Austria, Switzerland, or Germany and have significant cultural and linguistic familiarity.
- BS or BA from a reputable institution (completed or in progress).
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- Familiarity with ChatGPT or similar tools.
- Based in Austria, Switzerland, or Germany, or able to produce culturally accurate German aligned with these regions.
- Experience in teaching, research, editing, or academic writing.
- Experience creating evaluation criteria, rubrics, or grading guidelines.
- Familiarity with LLMs, prompting, or model evaluation is helpful but not required.
- Contribute at least 20 hours per week.
- Commitment of approximately 2–4 months.
- Work in a structured project environment with clear goals and tools.
- Hourly rate of $25 - $30.
- Open to qualified applicants without regard to legally protected characteristics.
- Reasonable accommodations provided upon request.