Remote Data Labeling Specialist; India)

Remote Data Labeling Jobs in India

Rex.zone is hiring a Remote Data Labeling Specialist to create and validate labeled training data for AI/ML systems, including LLM evaluation workflows. You will follow detailed annotation guidelines, document edge cases, and collaborate with QA reviewers to improve training data quality and downstream model performance.

• Label and review text, image, and multimodal data for AI/ML use cases
• Perform RLHF-style preference ranking and prompt evaluation for large language model evaluation
• Execute QA evaluation checks, resolve disagreements, and reduce annotation variance
• Maintain annotation guidelines compliance and escalate ambiguous policy edge cases
• Contribute to training data quality metrics (accuracy vs. gold sets, audits, inter-annotator agreement)
• Collaborate asynchronously with project leads across AI labs, tech startups, BPO teams, and annotation vendors

• NLP: classification, intent, named entity recognition, entity linking, taxonomy tagging
• Computer Vision: bounding boxes, polygons, keypoints, segmentation masks, OCR tagging
• Content Safety: policy-based labeling, moderation categories, sensitive attributes handling
• LLM Evaluation: response grading, hallucination checks, factuality review, safety alignment, RLHF ranking
• Quality Systems: gold-set calibration, audit sampling, error taxonomy

• Mid-to-senior experience in data labeling/data annotation with measurable QA outcomes
• Strong English reading comprehension and careful instruction-following for rubric-based evaluation
• Comfort with annotation tools, task queues, and remote QA workflows
• Ability to apply consistent labeling decisions and document edge cases clearly

Competitive hourly rate: $30–$50 per hour (based on skills and program needs).