About this role
Role Overview
Evaluate and compare AI chatbot responses for realistic small business scenarios, using Japanese business documents and practical operational knowledge to assess how well each response supports day-to-day business needs.
Key Responsibilities
- Create realistic business prompts based on defined user goals.
- Interact with multiple AI chatbots, with up to five turns per conversation.
- Assess responses for clarity, usefulness, and accuracy.
- Provide structured feedback and side-by-side evaluations.
- Submit conversation transcripts and completed evaluation results.
- Create engaging visual marketing content.
- Address and evaluate scenarios involving daily operations and customer interactions.
- Conduct market research and contribute ideas within your area of expertise.
- Use data to support analysis and financial planning.
- Work with spreadsheets, PDFs, images, and other input files as part of the evaluation workflow.
Qualifications
- You are a business owner or have a strong understanding of small business operations.
- You have business-related documents available in Japanese.
- You bring strong analytical and critical-thinking skills.
- You can follow structured evaluation guidelines.
- You are comfortable using AI tools.
Work Terms
- Remote contract engagement with a flexible work environment.
- Project-based work with a defined number of evaluation tasks.
- Each task includes comparing multiple chatbots and delivering a final assessment.
- Expected project duration is 16 weeks.
Opportunity
Contribute to high-impact AI work with global reach, including applications related to accounting and finance.