Small Business Owner for AI Response Evaluation (Korean Documents)

Role Overview:

Evaluate and compare responses from multiple AI chatbots on realistic small business scenarios in Korean, producing structured comparative feedback, conversation transcripts, and final assessments that help improve AI performance for real-world business use.

Key Responsibilities:

• Create realistic, business-focused prompts that reflect defined user goals and typical small business situations.
• Engage with multiple AI chatbots per scenario, using a maximum of 5 turns per conversation.
• Evaluate chatbot replies for clarity, usefulness, and accuracy, and provide comparative judgments across systems.
• Provide structured feedback and formatted evaluations following given guidelines.
• Submit complete conversation transcripts and evaluation results for each task.
• Use provided input files and tools during evaluation, including spreadsheets, PDFs, and images.

What Youll Work On:

• Develop marketing and visual content prompts and review AI outputs for marketing use cases.
• Assess AI assistance for day-to-day operations, customer interactions, and common small business workflows.
• Conduct basic market research and contribute subject-matter ideas relevant to your business area.
• Work with data to support analysis and simple financial planning scenarios.
• Review and rate AI-generated responses specifically for small business use cases in Korean.

Qualifications:

• Current small business owner, or demonstrable, strong understanding of small business operations.
• Must have business-related documents available in Korean to use as context during tasks.
• Strong analytical and critical thinking skills, with attention to detail.
• Ability to follow structured evaluation guidelines and deliver consistent, formatted feedback.
• Comfortable interacting with AI tools and performing comparative assessments across systems.

Work Terms:

• Engagement type: contract, project-based.
• Location: fully remote.
• Project duration: 10 weeks.
• Each assignment consists of a defined number of evaluation tasks; each task requires multi-chatbot comparisons and a final assessment.
• Expect to submit transcripts and evaluation results for every completed task.

Perks:

• Flexible, fully remote work with the opportunity to contribute to high-impact AI projects focused on small business needs.
• Work at the intersection of AI and practical business applications, including accounting and finance workflows.

Eligibility:

• Applicants must be small business owners or have equivalent practical experience with small business operations.
• Applicants must be able to provide and work with business-related documents in Korean during the engagement.