AI

AI Jobs in Canada (Remote, Full-Time) — Open Role

Rex.zone supports distributed AI/ML data operations that improve large language model evaluation and training data quality. This role focuses on production-grade workflows such as RLHF, data labeling, prompt evaluation, QA evaluation, and content safety labeling across NLP and (optionally) computer vision.

What You Will Do

• Execute RLHF evaluation, preference ranking, and rubric-based rationales
• Perform prompt evaluation and response grading (helpfulness/harmlessness/honesty)
• Complete data labeling tasks including named entity recognition and text classification
• Run QA evaluation via audits, spot checks, and inter-annotator agreement workflows
• Apply content safety labeling policies and maintain annotation guidelines compliance
• Document edge cases and surface systematic failure modes impacting LLM training pipelines

• Mid-Senior experience in AI data operations or applied ML support
• Strong written reasoning and comfort with rubric-based evaluation
• Familiarity with RLHF concepts and large language model evaluation
• Experience with labeling taxonomies (classification, NER, evaluation tasks)
• Comfort using web-based annotation tools, task queues, and spreadsheets