Retail Subject-Matter Expert for AI Model Evaluation

Shape how next-generation large language models understand and reason about retail by contributing deep domain expertise in merchandising, category management, buying, planning, and retail operations. In this role you will design realistic retail tasks, produce expert solutions grounded in real practice, and evaluate model outputs against structured rubrics to improve training data quality for a leading GenAI research team. Employment is W-2 through Cincinnatus LLC, with placement at the AI lab as part of their extended workforce.

• Advise research and engineering teams to close knowledge gaps in retail merchandising, category management, and operations reasoning.
• Design challenging, domain-relevant retail tasks and author accurate, well-reasoned model solutions based on real retail practice.
• Evaluate AI model outputs using structured rubrics, and provide clear written feedback on correctness, judgment, and reasoning quality.
• Develop and refine evaluation guidelines and scoring rubrics tailored to retail scenarios.
• Collaborate with other subject-matter experts to ensure consistency and accuracy across training data and evaluations.

• 8 or more years of professional retail experience in roles such as merchandising, category management, retail operations, buying, or planning at a recognized, top-tier organization, for example Amazon, Walmart, Target, Nike, Costco, Home Depot, or equivalent.
• Prior hands-on experience evaluating LLM or AI model outputs against rubrics or structured scoring criteria, mandatory, please describe this experience in your application.
• Demonstrable career progression, for example Category Manager to Senior Manager to Director of Merchandising.
• Strong verbal and written communication skills, problem-solving ability, and interpersonal skills.
• Ability to engage reliably for at least 35 hours per week during weekdays.

• Location: United States.
• Employment type: hourly, W-2 employee of Cincinnatus LLC acting as employer of record for placement at the client AI lab.
• Placement: You will be employed by Cincinnatus LLC and placed to work within the AI lab team as part of their extended workforce.
• Schedule requirement: reliably available for at least 35 hours per week on weekdays.

• Pay rate: $60.00 to $80.00 per hour.

• Please include details of your prior LLM or AI model evaluation experience when you apply, as this is a mandatory qualification.
• Cincinnatus LLC is the employer of record and provides payroll, benefits, and compliance for this engagement.
• Cincinnatus is an equal employment opportunity employer and does not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, gender identity, age, protected veteran status, disability, genetic information, political views, or any other legally protected characteristic.