Bilingual Traditional Chinese Evaluator

Join a high-impact AI research project as a Bilingual Traditional Chinese Generalist Evaluator Expert, where your expertise in Traditional Chinese and English will play a crucial role in training and evaluating advanced language models. This position is ideal for native speakers from Hong Kong or Taiwan who possess exceptional writing skills and a deep understanding of local language nuances and cultural contexts.

• Multilingual Prompt Design & Optimization: Create detailed prompts in Traditional Chinese and/or English, ensuring natural phrasing and relevance for users in Hong Kong and Taiwan.
• Define and Document Evaluation Standards: Establish expectations for correct responses and develop comprehensive rubrics that reflect linguistic nuances and cultural conventions.
• Model Testing and Grading (Bilingual): Assess model outputs for accuracy and cultural fit in Traditional Chinese, comparing results with English as needed.
• Benchmarking & Quality Assurance: Collaborate in QA processes to ensure consistency and reliability across Traditional Chinese benchmarks before official evaluations.

• Native-level fluency in Traditional Chinese (written), specific to Hong Kong or Taiwan, with strong reading and writing skills in English.
• Must be native to Hong Kong or Taiwan and have significant in-country experience, with deep cultural and linguistic familiarity.
• BS or BA from a reputable institution (completed or in progress).
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Familiarity with ChatGPT or similar tools for personal use.
• Based in Hong Kong or Taiwan, or able to produce culturally accurate Traditional Chinese.

• Experience in teaching, research, editing, or academic writing.
• Experience creating evaluation criteria, rubrics, or grading guidelines.
• Familiarity with LLMs, prompting, or model evaluation is helpful but not required.

Contribute at least 20 hours per week in a structured project environment with clear goals and tools.

Hourly compensation ranges from $25 to $30.

This role is strictly limited to candidates who are native to Hong Kong or Taiwan.