Skip to content
SaidGig
Sign up.

Give me your email, I promise I won't do anything weird with it.

Spanish AI Quality Analyst, Personalization

$15/hour

RemoteContracttechnology
Apply Now

About this role

Role Overview

Evaluate personalized AI interactions in Spanish by testing how effectively the model uses information from your past conversations, email, search activity, and video activity to deliver relevant, helpful responses. You will create prompts rooted in your own experiences, then apply careful judgment to assess personalization quality, including grounding, integration, and helpfulness.

Key Responsibilities

  • Design and run multi-turn conversations, typically one to five turns, that require the model to draw on personal information and experiences.
  • Evaluate whether responses address the intent of the opening prompt and apply personalization appropriately.
  • Identify grounding problems, including unsupported claims, flawed inferences, and hallucinations about the user.
  • Assess whether personal data is integrated naturally rather than presented in a robotic or overly narrative way.
  • Compare and rank two side-by-side model responses for helpfulness, ease of use, and overall user experience.
  • Write clear, defensible comparison rationales that cite specific conversation turns and explain positive findings or issues.
  • Review debug information to verify that conversation summaries and relevant data sources were used correctly.
  • Delete evaluation conversations to keep them from affecting future chat history.

Qualifications

  • High-level Spanish reading and writing ability.
  • Willingness to use your primary personal Google account, rather than a test account, and enable personal data sources for authentic evaluation.
  • Strong analytical judgment for nuanced, ambiguous AI responses and personalization quality.
  • Experience creating creative, multi-turn prompts based on personal context.
  • Ability to recognize inaccurate personalization, weak inferences, and forced connections.
  • Careful attention to subtle differences in naturalness and overnarration when reviewing side-by-side responses.
  • Excellent written communication, including the ability to produce concise, structured rationales that reference specific turn numbers.
  • Ability to provide constructive feedback and detailed annotations.
  • Strong communication and collaboration skills, with the ability to work independently in a remote environment.
  • A desktop or laptop and reliable internet connection.
  • Bachelor''s degree or equivalent relevant experience in policy, law, ethics, linguistics, journalism, computer science, or another analytical field.
  • Experience in data annotation, AI quality evaluation, content moderation, or a related role is strongly preferred.

Work Terms

  • Remote contract engagement.
  • Three-month project.
  • Full-time availability in your local time zone is required to support a global 24-hour operation.
  • Commit at least four hours per day, up to 40 hours per week, including four hours of overlap with Pacific Time.

Compensation

  • $15 per hour.

Application Process

  • Selected candidates will receive an interest form for the role.
  • Following profile review, candidates will receive an assessment that must be completed within 24 hours.
  • Candidates selected based on assessment results will be contacted to discuss pre-onboarding requirements.

Related Jobs

More like this