Pharmacist for AI Model Evaluation

Pharmacy experts apply their clinical and research knowledge to create, test, and evaluate prompts and responses for large language models within pharmaceutical domains. Work focuses on improving model understanding and explanations of pharmacology, drug development, therapeutic guidance, and related subdomains.

• Design and refine domain-specific prompts for large language models.
• Critically evaluate LLM outputs for accuracy, reasoning quality, and domain relevance.
• Conduct focused literature or domain research to inform prompt design and evaluation, using AI tools as appropriate.
• Document findings, provide structured feedback, and contribute to small cohort research tasks that probe models'' scientific and language understanding.
• Participate in asynchronous collaboration with research teams and other subject-matter experts.

• PhD in Pharmacy, Pharmaceutical Sciences, Pharmacology, or a closely related discipline, awarded by a U.S. institution.
• Comfort working primarily asynchronously and independently.
• Deep subject-matter expertise and the ability to identify where current AI systems fall short in explaining or reasoning about key concepts.
• Willingness to learn new skills and methods while contributing to AI evaluation and model improvement efforts.
• Selection for project cohorts is competitive and limited to candidates with strong disciplinary and research credentials.

• Location: Fully remote, work from anywhere.
• Schedule: Asynchronous and flexible hours, with no minimum hourly commitment.
• Employment type: Part-time engagement with project-based placement.
• Program timing: Activities run year-round, however specific project availability will vary by domain and timing; placement into any project depends on availability and cohort selection.

Up to $100/hr (depending on the project)

• PhD from a U.S. institution is required.
• F-1 students who are eligible for CPT or OPT may be eligible to participate. Work with your Designated School Official to confirm eligibility.
• If your school requires enrollment in a CPT course, this program may not meet that requirement. STEM OPT is not supported.

• Create an account on the program platform and submit the requested profile information.
• Complete identity verification as part of the application process.
• Onboard into projects that match your expertise when selected, completing any project-specific orientation.
• Begin assigned project work and receive compensation according to the project terms.