Skip to content
×

Remote AI Media Evaluator

Remote / Online - Candidates ideally in
Vancouver, BC, Canada
Listing for: Scale AI
Remote/Work from Home position Listed on 2026-11-11
Job specializations:
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
  • Creative Arts/Media
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
Salary/Wage Range or Industry Benchmark: 17000 - 29000 CAD Yearly CAD 17000.00 29000.00 YEAR

Job Description & How to Apply Below

Evaluate AI-generated media remotely on your own schedule using English conversation skills and close visual and audio attention. Help identify what models get right or wrong.

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. Reviewers roleplay conversations with voice models, compare images and videos, and explain findings in writing. Your feedback supports evaluation loops for improving advanced AI systems.

Key Responsibilities:
  • Conduct scenario-based English conversations with AI voice models
  • Rank speech for naturalness, usefulness, and clarity
  • Compare images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Write evidence-based explanations of evaluation decisions
Requirements:
  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing short, evidence-based reviews
  • Ability to decide when both options have flaws

Use English communication, media judgment, and precise feedback to evaluate AI outputs for Outlier remotely on your schedule.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary