Office Document Evaluation Specialist

Join a dynamic team dedicated to shaping the future of AI by evaluating and improving document generation models. As an Office Document Evaluation Specialist, you will assess and compare model-generated office artifacts in Excel, Word, and PowerPoint formats. Your expertise will directly influence how AI produces high-quality business documents, making this role both impactful and rewarding.

• Open and inspect downloaded office artifacts across Excel (.xlsx), Word (.docx), and PowerPoint (.pptx) formats.
• Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one.
• Evaluate both the content and the rendering of each document, including layout, formatting, visual structure, formulas, and overall presentation against task requirements.
• Grade AI-generated outputs against structured rubrics.
• Provide written feedback for the research team to enhance model behavior.
• Participate in onboarding office hours and calibration sessions.

• 3+ years of professional experience producing and reviewing office documents in roles such as analysts, operations and finance professionals, consultants, or administrative support specialists.
• Proficient in Excel, including financial modeling, data analysis, pivot tables, complex formulas, charts, and conditional formatting.
• Experienced in Word, with skills in long-form document drafting, formatting, styling, templates, tables, and track changes.
• Skilled in PowerPoint, focusing on slide design, layout, data visualization, and brand-consistent presentations.
• Fluent, hands-on familiarity with the full Microsoft Office suite.
• Able to independently open, navigate, and visually inspect downloaded office files on your own machine.
• Possess a sharp eye for formatting and presentation detail, ensuring documents meet intended outputs.
• Demonstrate excellent written communication skills with high attention to detail.

• Cross-format expertise across Excel, Word, and PowerPoint.
• Experience building reusable templates, style guides, or document standards.
• Background in finance, consulting, operations, or executive support where document quality is mission-critical.
• Familiarity with comparing or QA-ing documents for formatting fidelity and consistency.

• Minimum of 10 hours per week (ideally 20+).
• Fully remote position.
• Role starts immediately, with applications reviewed on a rolling basis.