AI India — Remote AI Data Annotation Specialist

Overview

About The Role Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.

• Execute data labeling and data annotation for NLP and computer vision datasets
• Perform RLHF-style preference comparisons and graded reward-model judgments
• Run prompt evaluation and response grading using detailed rubrics
• Complete QA evaluation audits, guideline compliance checks, and rework cycles
• Apply named entity recognition (NER), taxonomy tagging, and text classification
• Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
• Document edge cases and contribute to annotation guidelines updates
• Report throughput, agreement rates, and error categories to improve production quality

• Mid-Senior experience delivering high-precision labeling/evaluation work
• Strong written English and ability to follow complex rubrics
• Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
• Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
• Comfort working remotely with asynchronous communication and versioned guidelines

$30–$50 per hour (base salary, hourly). Final compensation depends on scope and evaluation complexity.

Apply via Rex.zone and share relevant labeling, evaluation, and QA experience.