About this role
Role Overview
Use your real-world retail, pharmacy, investigation, or operations expertise to evaluate AI-generated work for accuracy, realism, and practical usability. This is a review role: you assess completed AI work, you do not perform or redo the underlying task.
Key Responsibilities
- Review an AI agent''s full attempt at a realistic task from your profession, including the original task, the agent''s work, produced files, and an AI-generated scorecard.
- Assess whether the task reflects work that would genuinely arise in the role, identifying whether it is realistic, borderline, or contrived.
- Check domain-specific standards, figures, regulations, constraints, and terminology for accuracy and consistency.
- Review eleven yes-or-no grading checks, including format, fabricated figures, requirements completion, and terminology, and document any disagreements with clear reasons.
- Independently place the work in a usability band, such as whether a practitioner could use or accept it, then evaluate whether the reported score is justified.
- Provide a short written rationale for every judgment.
Qualifications
Apply only for the professional track that matches your hands-on experience:
- Pharmacist: active U.S. pharmacist license and at least 4 years of community or retail dispensing and counseling experience.
- Private Detective or Investigator: required state license and at least 4 years independently managing casework and writing reports.
- General and Operations Manager: at least 5 years owning a store or multi-site P&L, staffing, and inventory.
- First-Line Supervisor of Retail Sales Workers: at least 4 years supervising a sales floor, scheduling, and shrink.
- Near-native business English and the ability to write concise explanations for review decisions.
- Comfort reviewing spreadsheets or PDFs and verifying that figures reconcile.
Preferred Background
This work is best suited to practitioners who have identified errors before they reached a customer, such as a DUR intervention, an inaccurate surveillance report, or an inventory count that did not reconcile. Corporate category or merchandising professionals without location-management experience, and investigators focused entirely on public-records research, are less aligned with the role.
Work Terms
- Remote, hourly engagement.
- Expect approximately one hour per reviewed item.
Compensation
$55 to $65 per hour.
Application Process
Begin with a recorded interview of about 15 minutes focused on your area of expertise. After joining the project, complete a brief intake profile independently and without assistance.