Visual Rater - Fully Remote
Toronto, Ontario, C6A, Canada
Listed on 2026-10-08
-
Creative Arts/Media
AI Evaluation, Data Annotation/ AI Labeling
Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.
For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.
You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.
Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).