Bilingual French Language Model Evaluator

Join a high-impact AI research project as a Bilingual French Generalist Evaluator Expert, where you will leverage your exceptional writing skills to create and evaluate French/English prompt-golden answer pairs that train advanced language models. This role is ideal for native French speakers from Canada, Belgium, Switzerland, or France who possess a deep understanding of local language usage and cultural context.

• Multilingual Prompt Design & Optimization: Create detailed prompts in French and/or English that reflect natural phrasing and real-world relevance for French-speaking users in Canada, Belgium, Switzerland, and France.
• Define and Document Evaluation Standards: Establish expectations for correct responses and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions specific to these regions.
• Model Testing and Grading (Bilingual): Assess model outputs for accuracy, fluency, and cultural fit in French, comparing results against English where necessary.
• Benchmarking & Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics maintain consistency and reliability across French-language benchmarks.

• Native-level fluency in French (written) specific to Canada, Belgium, Switzerland, or France, with strong reading/writing ability in English.
• Must be native to Canada, Belgium, Switzerland, or France and have lived in or spent significant time in-country.
• BS or BA from a reputable institution (completed or in progress).
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Familiarity with ChatGPT or similar tools.
• Based in Canada, Belgium, Switzerland, or France, or able to produce culturally accurate French aligned with one of these regions.

• Experience in teaching, research, editing, or academic writing.
• Experience creating evaluation criteria, rubrics, or grading guidelines.
• Familiarity with LLMs, prompting, or model evaluation (helpful but not required).

• Commitment of at least 20 hours per week.
• Project duration of approximately 2–4 months.
• Work in a structured project environment with clear goals and tools.

Hourly rate ranges from $25 to $37.

Open only to candidates who are native to Canada, Belgium, Switzerland, or France and have significant familiarity with local language and culture.