Records Manager for AI Model Evaluation

Records Managers apply archival, library, and information management expertise to evaluate AI model outputs related to records, collections, and information services. You will use your professional judgment to assess model-generated content, create field-specific prompts, and provide clear, structured feedback that improves the model''s understanding of real-world records workflows and language. No prior experience with AI is required.

• Evaluate outputs produced by AI models for accuracy, relevance, and appropriateness within records management, archives, and library contexts.
• Develop prompts and scenarios that reflect real-world tasks, terminology, and decision points in your field.
• Assess and annotate model responses, identifying errors, omissions, and areas for improvement.
• Deliver clear, structured feedback that helps models better reflect workplace processes, policies, and language.
• Carry out work asynchronously and independently, following project-specific instructions and quality guidelines.

• Minimum 4 years of professional experience in one or more of the following areas: archival management, information management, collections management, or librarianship.
• Relevant real-world responsibilities may include one or more of the following: managing and organizing archival records, developing classification systems, and maintaining databases for access and retrieval; providing reference services, authenticating and appraising historical documents, and coordinating educational programs; directing staff in cataloguing and preserving collections, researching and acquiring materials to enhance archives.
• Ability to complete asynchronous remote work in collaboration with AI research teams and follow detailed task instructions.

• Part-time, remote, asynchronous engagement.
• Hours are flexible with no minimum commitment; most contributors average 5 to 20 hours per week.
• Work is hourly and temporary, with projects available periodically.
• Placement into specific projects depends on project availability; the program runs year-round with new project opportunities opening across different specialties.

• Up to $75/hr (depending on the project).

• F-1 students who are eligible for CPT or OPT may be eligible to participate. Consult your Designated School Official to confirm eligibility.
• If your school requires enrollment in a CPT course, this program may not meet that requirement.
• STEM OPT is not supported for this program.

• Create an account and complete your profile.
• Complete any required identity verification and eligibility checks.
• Browse and join projects that match your expertise, complete project-specific onboarding, and review instructions.
• Begin assigned tasks and receive hourly payment for completed work. If you are not immediately placed on a project, additional opportunities will open periodically.