Skip to content
×

Remote AI Media Evaluator

Remote / Online - Candidates ideally in
Vancouver, BC, Canada
Listing for: Scale AI
Remote/Work from Home position Listed on 2026-11-11
Job specializations:
  • Creative Arts/Media
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
Salary/Wage Range or Industry Benchmark: 24000 - 34000 CAD Yearly CAD 24000.00 34000.00 YEAR

Job Description & How to Apply Below

Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and clear written feedback. Review voices, images, and videos for quality.

Outlier Experts support Scale AI’s training platform by evaluating model performance across varied projects. As a Remote AI Media Evaluator, you will review outputs, compare alternatives, and explain specific issues in English. The work includes conversations with AI voice models, visual comparisons, and detailed scoring. Your evaluations contribute to feedback that helps AI systems improve their real-world performance.

Key Responsibilities:
  • Roleplay live English conversations with AI voice models
  • Rank exchanges for naturalness, usefulness, and clarity
  • Compare generated images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio issues
  • Write evidence-based explanations supporting evaluation decisions
Requirements:
  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational speech
  • Experience writing short evidence-based reviews
  • Ability to decide when both options have flaws

Apply careful visual, audio, and written judgment to evaluate AI-generated media through Outlier’s flexible remote platform.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary