Telephone Operator for AI Model Evaluation

Telephone Operators apply their switchboard, call-handling, customer-assistance, and directory-management experience to evaluate AI-generated outputs. You will create realistic prompts based on your professional practice, review model responses for accuracy and workplace relevance, and provide clear, structured feedback that helps improve how models handle telephone and call-center tasks. No prior AI experience is required.

• Develop prompts that reflect real-world telephone operator scenarios and workflows.
• Evaluate AI responses for correctness, clarity, and applicability to telephone operator tasks.
• Provide structured feedback to help models learn workplace terminology, procedures, and decision-making.
• Observe and document common call patterns and edge cases that affect model performance.
• Perform tasks similar to your professional duties to supply context for model evaluation, such as using directories, paging systems, or billing assistance scenarios.
• Maintain records of evaluations and any examples used for training.

• Minimum 4 years of professional experience in telephone operator, switchboard, or closely related roles.
• Relevant past responsibilities may include one or more of the following:
• Observe signal lights on switchboards, and dial or press buttons to make connections.
• Operate telephone switchboards and systems to advance and complete connections, including those for local, long distance, pay telephone, mobile, person-to-person, and emergency calls.
• Listen to customer requests, using alphabetical or geographical directories to answer questions and provide telephone information.
• Update directory information and suggest alternate spellings, locations, or listing formats when callers lack complete details.
• Perform clerical duties such as typing, proofreading, and sorting mail.
• Offer special assistance to persons unable to dial or who are in emergency situations.
• Operate paging systems or other notice systems to inform recipients of incoming calls.
• Monitor automated systems for collect calls and intervene to assist callers when needed.
• Interrupt busy lines in emergencies and provide special billing assistance when requested.
• Provide relay service for users who are deaf or hard of hearing.
• Keep records of calls placed and received, and related toll charges.
• Promote company products, services, and savings plans when appropriate.
• Ability to work asynchronously and communicate effectively with engineering or research teams partnering on model evaluation is required.

• Location: Remote, asynchronous work.
• Employment type: Part-time, hourly engagements that are temporary and project-based.
• Schedule: Flexible hours with no minimum commitment; most contributors average 5 to 20 hours per week.
• Project availability: Projects run year-round and open periodically across different areas of expertise. Placement into specific projects depends on current availability.

Up to $60/hr (depending on the project)

• F-1 students who are eligible for CPT or OPT may be eligible to participate. Consult your Designated School Official to confirm eligibility.
• If your school requires enrollment in a CPT course, this program may not meet that requirement.
• STEM OPT is not supported for participation in these projects.
• Confirm work-authorization details before applying; additional documentation or verification may be required.

• Create an account on the program portal and complete profile information.
• Verify your identity and any required eligibility documentation.
• Enroll in and complete onboarding for relevant projects when they become available.
• Begin asynchronous project work and submit evaluations to start earning.

This role is compatible with other employment and is intended for professionals who want to contribute domain expertise to improve AI behavior in telephone operations.