Skip to content
×

Remote AI Media Evaluator

Remote / Online - Candidates ideally in
Ottawa, Ontario, K0A 0E5, Canada
Listing for: Scale AI
Remote/Work from Home position Listed on 2026-11-06
Job specializations:
  • Creative Arts/Media
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
Salary/Wage Range or Industry Benchmark: 24000 - 34000 CAD Yearly CAD 24000.00 34000.00 YEAR

Job Description & How to Apply Below

Review AI-generated media remotely on your own schedule, using fluent English, careful observation, and clear written explanations. Evaluate voice, images, and videos against prompts.

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers. As an AI Media Evaluator, you will assess model outputs, explain specific issues, and help improve advanced AI systems. Tasks include conversational scoring, visual comparison, audio review, and caption labeling.

Key Responsibilities:
  • Roleplay live English conversations with AI voice models
  • Rank speech naturalness, usefulness, clarity, and pronunciation
  • Compare generated images and videos against text prompts
  • Inspect outputs for artifacts, motion, text, and audio issues
  • Write evidence-based explanations of evaluation decisions
Requirements:
  • Fluent English and strong written communication skills
  • Strong attention to detail and patience during reviews
  • Comfort with natural conversational speech and realistic situations
  • Experience writing concise, evidence-based explanations or reviews
  • Valid , mobile phone, resume, and Linked In profile

Use English communication, visual judgment, and careful listening to evaluate AI-generated media through flexible Outlier project work.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary