Remote Data Labeling Toronto

Rex.zone supports AI labs, tech startups, BPOs, and annotation vendors with scalable human feedback and training data operations. This role focuses on high-quality remote data labeling to improve large language model evaluation and model performance.

Rex.zone supports AI labs, tech startups, BPOs, and annotation vendors with scalable human feedback and training data operations. This role focuses on high-quality remote data labeling to improve large language model evaluation and model performance.

You will deliver accurate labels and written rationales using rubric-based evaluation, document edge cases, and help improve annotation guidelines. Work is performed fully remote using Rex.zone workflows and project tools.

• Label text, image, and multimodal data following strict annotation guidelines compliance
• Perform RLHF preference ranking, including rationale writing for LLM training pipelines
• Execute prompt evaluation against rubrics (helpfulness, harmlessness, factuality)
• Run QA evaluation workflows: calibration, consensus checks, sampling audits, and adjudication notes
• Complete NLP labeling such as named entity recognition and text classification
• Support computer vision annotation (bounding boxes, polygons, keypoints, segmentation)
• Apply content safety labeling for policy categories and risk severity
• Flag ambiguous cases and propose guideline updates to reduce label noise

• Experience in data labeling, data annotation, or QA evaluation for AI/ML datasets
• Strong written communication for clear rationales and edge-case documentation
• Comfort applying rubrics and maintaining annotation guideline compliance
• Understanding of training data quality concepts (agreement, consistency, bias)
• Ability to work independently in a remote setting with dependable execution

• Guideline compliance and QA pass rate
• Calibration agreement and audit outcomes
• Turnaround time balanced with accuracy
• Measurable improvements from cleaner labels and better preference data

Competitive hourly base pay: $30–$50 per hour (USD), based on scope, label complexity, and QA responsibility.