AI Training

About The Role

AI Training Jobs in Canada focus on building and evaluating AI/ML training data for LLM training pipelines. In this full‑time remote role, you will label and evaluate text, image, and multimodal data to improve training data quality and model performance.

• Perform data labeling for NLP, LLM, and computer vision annotation tasks
• Execute RLHF ranking and pairwise preference judgments
• Run QA evaluation checks and maintain annotation guidelines compliance
• Conduct prompt evaluation and response grading for helpfulness, correctness, and safety
• Apply content safety labeling (e.g., harassment, self‑harm, adult content)
• Document edge cases, write clear rationales, and elevate ambiguous examples
• Collaborate asynchronously with cross‑functional teams while following secure data handling practices

• Mid‑Senior experience in AI/ML data operations, evaluation, or large‑scale annotation programs
• Strong analytical writing and rubric‑driven decision‑making
• Familiarity with LLM training pipelines, dataset QA, and common annotation error sources
• Experience with NLP (classification, NER) and/or computer vision annotation workflows
• Ability to meet throughput targets and maintain high agreement rates in remote settings

• Queue‑based task routing with SLAs, audit trails, and spot audits
• Calibration sessions, gold‑standard checks, and feedback loops
• Issue tracking for edge cases and guideline updates
• Privacy‑first, secure remote work practices

Hourly rate: $30–$50/hr (USD)