Higher Education Professional for AI System Evaluation

Shape AI evaluation tasks that reflect the real complexity of large universities, from academic planning and shared governance to accreditation, enrollment, and institutional finance.

This role develops realistic higher education scenarios, reference responses, and scoring rubrics for AI systems used in university and higher education institution contexts. The work is grounded in the diverse stakeholders, operational realities, and high-stakes decisions found across research universities and higher education systems.

• Create scenarios involving curriculum and program design, faculty senate or accreditation review, and complex budget or enrollment-planning cycles.
• Develop tasks across academic program development, student affairs and retention, research administration and grant compliance, faculty governance, and institutional advancement and fundraising.
• Design higher education operations scenarios involving Banner or Workday Student, Canvas or Blackboard, admissions and advancement CRM platforms, and research administration systems such as Cayuse and InfoEd.
• Apply accreditation standards, shared-governance models, learning-outcomes assessment, and enrollment-management strategy to produce reference academic plans, accreditation materials, and communications for administrators or boards.
• Write rubrics that distinguish sound higher education judgment from generic academic or policy-manual knowledge.

• At least 5 years of experience as faculty, an academic administrator, or in a senior operational role at a college, university, or higher education system.
• Direct responsibility for academic programs, enrollment or retention initiatives, research administration, or institutional strategic priorities.
• Working fluency with higher education tools and frameworks, including practical knowledge of university budgets, accreditation compliance, and shared governance.
• Experience authoring rubrics, curriculum-design materials, or faculty-training content is preferred.

• Remote, hourly engagement.

• $60 to $70 per hour.