Skip to content
×

AI Media Evaluation Analyst

Job in Vancouver, BC, Canada
Listing for: Scale AI
Full Time position Listed on 2026-11-11
Job specializations:
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling
Salary/Wage Range or Industry Benchmark: 24000 - 34000 CAD Yearly CAD 24000.00 34000.00 YEAR

Job Description & How to Apply Below

Evaluate AI-generated media remotely on your own schedule using English communication, close observation, and evidence-based judgment. Review voice, image, and video outputs across varied projects.

As an Outlier Expert, you will help Scale AI improve advanced AI systems through structured evaluation and feedback. The work includes role playing live conversations with AI voice models, comparing generated media, and explaining specific issues in writing. You will assess adherence, quality, realism, naturalness, pronunciation, and clarity while making decisions when both options have flaws.

Key Responsibilities:
  • Conduct live English conversations with AI voice models
  • Rank exchanges for naturalness, usefulness, and clarity
  • Compare images and videos against their prompts
  • Inspect outputs for artifacts, errors, and unnatural motion
  • Write specific explanations supporting evaluation decisions
Requirements:
  • Fluent English with strong written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing short evidence-based explanations
  • Valid identification, mobile phone, resume, and Linked In profile

Apply your English communication, media judgment, and detailed feedback skills while evaluating AI outputs for Outlier.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary