Records Manager for AI Model Evaluation

Records Managers apply archival, collections, and library expertise to evaluate AI model outputs, craft prompts that reflect real-world records workflows, and provide structured feedback that improves model understanding of records management tasks and language. No prior AI experience is required.

• Design prompts and scenarios that reflect records management, archival, and library tasks.
• Evaluate AI-generated responses for accuracy, relevance, and alignment with professional standards in your field.
• Assess content related to records, archives, collections, and reference services, and provide clear, actionable feedback to improve model outputs.
• Document examples and edge cases from your day-to-day work to help train and refine models.
• Work asynchronously with research teams to complete assigned evaluation tasks.

• Minimum 4 years of professional experience in one or more of the following areas: archives, records management, collections management, librarianship, or information management.
• Relevant hands-on responsibilities may include:
• Managing and organizing archival records, developing classification systems, and maintaining databases to ensure access and retrieval.
• Providing reference services, authenticating and appraising historical documents, and coordinating educational or outreach programs.
• Directing staff in cataloguing and preserving collections, and researching and acquiring materials to enhance archives.
• Comfort with asynchronous collaboration and following task instructions in partnership with external research teams.

• Location: Remote, asynchronous work, perform tasks independently from your chosen location.
• Employment type: Part-time.
• Schedule: Flexible hours, no minimum weekly commitment; most contributors average 5 to 20 hours per week.
• Work activities include developing prompts that reflect your field and evaluating the responses produced by AI models.

Up to $75/hr (depending on the project)

• F-1 students who are eligible for CPT or OPT may be eligible to participate. Consult your Designated School Official to confirm whether participation meets your institution''s requirements.
• If your school requires a credit-bearing CPT course, this program may not satisfy that requirement.
• STEM OPT is not supported for this work.

Projects are available year-round and open periodically across different areas of expertise. Placement into a specific project depends on current project availability; if you are not immediately assigned to an active project, additional opportunities may open in the future.

• Create a profile on the program portal and submit any requested background information.
• Complete identity verification as required for participation.
• Review and enroll in projects that match your expertise, complete short onboarding for selected projects, and begin assigned evaluation tasks.
• Contribute to project work and receive payment according to the project terms.