Skip to content
×

AI Media Evaluation Analyst

Job in Vaughan, Ontario, L6A 0K9, Canada
Listing for: Scale AI
Full Time position Listed on 2026-11-06
Job specializations:
  • Science
    AI Evaluation, Data Annotation/ AI Labeling
Salary/Wage Range or Industry Benchmark: 24000 - 34000 CAD Yearly CAD 24000.00 34000.00 YEAR

Job Description & How to Apply Below

Review AI-generated media remotely with Outlier, evaluating voice, image, and video outputs through careful English-language analysis. Set your own schedule while working independently.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess naturalness, prompt adherence, quality, realism, and audio-visual consistency. The work supports feedback loops that help advanced AI systems improve in real-world performance.

Key Responsibilities:
  • Conduct scenario-based conversations with AI voice models
  • Compare generated images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio errors
  • Rate outputs and explain observations in written English
  • Label actions and correct draft video captions
Requirements:
  • Fluent English with clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing evidence-based explanations or reviews
  • Ability to choose clearly between imperfect options

Apply analytical judgment, strong English communication, and close media inspection to AI evaluation projects through Outlier.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary