Small Business Owner for AI Response Evaluation (Japanese Documents)

Evaluate and compare AI chatbot responses for realistic small business scenarios in Japanese, using your knowledge of small business operations and business documents to judge clarity, usefulness, and accuracy across multiple chat systems.

• Create realistic, business-related prompts tied to defined user goals.
• Conduct short multi-turn conversations with multiple AI chatbots, up to 5 turns per conversation.
• Assess each response for clarity, usefulness, and accuracy, and perform comparative evaluations across chatbots.
• Provide structured feedback and final assessments that identify strengths and weaknesses of responses.
• Submit conversation transcripts and evaluation results according to provided guidelines.
• Work with input files and tools such as spreadsheets, PDFs, and images as part of evaluations.
• Contribute real-world small business knowledge to tasks including marketing content ideas, operational and customer interaction scenarios, market research, and data-driven financial planning support.

• Current small business owner, or demonstrable, strong understanding of small business operations.
• Access to business-related documents in Japanese for use during evaluations.
• Strong analytical and critical thinking skills, with attention to detail.
• Ability to follow structured evaluation guidelines precisely.
• Comfortable interacting with AI tools and producing written evaluations in Japanese when required.

• Engagement type: contract, independent contractor, project-based work.
• Location: fully remote, flexible schedule.
• Project duration: 16 weeks.
• Each task comprises a multi-chatbot comparison followed by a final assessment, with a defined number of evaluation tasks per project.
• Expect to handle conversation transcripts, comparative scoring, and deliverable submission for each task.
• Perks: work at the intersection of AI and small business operations, flexible remote work, opportunity to contribute to globally relevant AI projects.

• Must be a business owner or have equivalent practical experience with small business operations.
• Must have business-related documents available in Japanese to use during evaluations.
• No specific work authorization or visa sponsorship details are provided, applicants should ensure they are eligible to work as independent contractors under local laws.