Skip to content
×

AI Media Evaluation Specialist

Job in Vancouver, BC, Canada
Listing for: Scale AI
Full Time position Listed on 2026-11-11
Job specializations:
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
  • Creative Arts/Media
    AI Evaluation, Data Annotation/ AI Labeling, AI Business & Operations
Salary/Wage Range or Industry Benchmark: 24000 - 34000 CAD Yearly CAD 24000.00 34000.00 YEAR

Job Description & How to Apply Below

Evaluate AI voice, image, and video outputs remotely on your own schedule while applying fluent English and close attention to detail. Outlier offers flexible project work for contributors in accepted countries.

As an Outlier Expert, you will review AI-generated media and provide evidence-based feedback. You will roleplay conversations with AI voice models, compare visual outputs, inspect artifacts, and assess adherence, quality, and realism. Your evaluations support AI training and improvement through Scale AI’s platform.

Key Responsibilities:
  • Conduct live English conversations with AI voice models
  • Compare generated images and videos against prompts
  • Inspect outputs by replaying, zooming, and listening closely
  • Rate naturalness, quality, realism, and prompt adherence
  • Write specific explanations describing observed issues
Requirements:
  • Fluent English with clear written communication
  • Strong attention to detail and patience
  • Comfort discussing realistic situations conversationally
  • Experience writing concise evidence-based reviews
  • Ability to decide when both options have flaws

Bring careful observation, fluent English, and clear judgment to AI media evaluation projects through Outlier’s remote platform.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary