About this role
Role Overview
Evaluate and define excellence in brand and design work for a leading AI research organization. Instead of creating design deliverables, you will create task-specific grading criteria and score AI-generated and human work samples, providing rigorous, evidence-based written justifications so assessments are reproducible and defensible.
Key Responsibilities- Design precise, task-level grading criteria for real-world brand design deliverables, including brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning
- Score AI-generated and human work samples against those criteria, supplying detailed written justifications for every score
- Apply consistent, evidence-based judgment so scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on criteria and scoring
- Minimum 5 years of professional experience in brand, visual, or graphic design
- Significant experience at world-class independent brand and design agencies, for example Pentagram, Wolff Olins, Landor, Collins, IDEO, note that agency experience is required rather than in-house or enterprise design teams
- Background in one of these core disciplines, such as Creative Director, Brand Designer focusing on logo and visual identity, Web Designer with UI/UX or web architecture expertise, or Graphic Designer
- Deep practical fluency in typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and delivering critique the way a creative director would in a review
- Exceptionally strong written communication, able to explain precisely why a piece of work does or does not meet the bar
- Detail-oriented and consistent, comfortable having your judgment reviewed and calibrated against peers
- Experience with copywriting and brand messaging, including audience research, competitor research, and positioning, is a strong plus
- Prior experience with AI training, evaluation, or human-data projects is a strong plus
- Location, remote
- Engagement type, hourly
- Rate: 80 to 150 hourly
To apply, submit your resume, portfolio, and relevant background information. Qualified applicants may be asked to complete an assessment or provide additional materials for evaluation.