AI Training

Position: AI Training Jobs
About

The Role
AI Training Jobs in Canada focus on building and evaluating AI/ML training data for LLM training pipelines. In this full‑time remote role, you will label and evaluate text, image, and multimodal data to improve training data quality and model performance.

What You Will Do

Perform data labeling for NLP, LLM, and computer vision annotation tasks

Execute RLHF ranking and pairwise preference judgments

Run QA evaluation checks and maintain annotation guidelines compliance

Conduct prompt evaluation and response grading for helpfulness, correctness, and safety

Apply content safety labeling (e.g., harassment, self‑harm, adult content)

Document edge cases, write clear rationales, and elevate ambiguous examples

Collaborate asynchronously with cross‑functional teams while following secure data handling practices

Required Qualifications

Mid‑Senior experience in AI/ML data operations, evaluation, or large‑scale annotation programs

Strong analytical writing and rubric‑driven decision‑making

Familiarity with LLM training pipelines, dataset QA, and common annotation error sources

Experience with NLP (classification, NER) and/or computer vision annotation workflows

Ability to meet throughput targets and maintain high agreement rates in remote settings

Workflow and Tools

Queue‑based task routing with SLAs, audit trails, and spot audits

Calibration sessions, gold‑standard checks, and feedback loops

Issue tracking for edge cases and guideline updates

Privacy‑first, secure remote work practices

Compensation
Hourly rate: $30–$50/hr (USD)

#J-18808-Ljbffr