Small Business Owner for AI Response Evaluation (Japanese Documents)

Evaluate and compare responses from multiple AI chatbots for real-world small business scenarios in Japanese. You will generate realistic prompts, run short multi-turn conversations with several models, assess answer quality, and deliver structured comparative feedback and conversation records.

• Create realistic, business-related prompts based on defined user goals
• Interact with multiple AI chatbots, keeping conversations to a maximum of 5 turns each
• Assess response quality for clarity, usefulness, and accuracy
• Provide structured comparative evaluations and actionable feedback
• Submit conversation transcripts and evaluation results
• Review AI-generated outputs for small business needs, including day-to-day operations and customer interactions
• Work with input files and tools such as spreadsheets, PDFs, and images as part of the evaluation workflow
• Contribute to tasks such as creating visual marketing content ideas, conducting market research, and supporting data-driven analysis and financial planning

• Current small business owner, or demonstrable strong understanding of small business operations
• Access to business-related documents in Japanese, and ability to use those documents during evaluations
• Strong analytical and critical thinking skills
• Ability to follow detailed, structured evaluation guidelines accurately
• Comfortable interacting with AI tools and completing comparative assessments

• Location: Fully remote
• Engagement type: Contract, project-based, freelance
• Project structure: Defined number of evaluation tasks, each requiring comparison across multiple chatbots and a final assessment
• Conversation constraint: Maximum 5 turns per conversation
• Duration: 16 weeks

• Work remotely on projects at the intersection of AI and small business workflows, including accounting and finance-related use cases
• Flexible schedule consistent with a contract, project-based engagement
• Opportunity to influence AI behavior on practical, business-facing tasks

• Applicants must have business-related documents available in Japanese
• Best suited to small business owners or those with equivalent operational experience
• Engagement is for independent contractors; no employer sponsorship information is provided