Remote Data Labeling Specialist
Remote / Online - Candidates ideally in
UAE/Dubai
Listed on 2026-08-03
UAE/Dubai
Listing for:
Rex.zone
Remote/Work from Home
position Listed on 2026-08-03
Job specializations:
-
IT/Tech
Data Annotation/ AI Labeling, AI Evaluation, AI Business & Operations
Job Description & How to Apply Below
Rex.zone is seeking Remote Data Labeling Specialists in New York to support AI development projects by creating high-quality training data for advanced artificial intelligence systems. This role involves working on text, image, and conversational data annotation tasks that directly contribute to improving AI model performance.
The successful candidate will perform detailed labeling, quality evaluation, and guideline-based annotation while maintaining accuracy and consistency. This opportunity is ideal for professionals who have strong attention to detail, enjoy working with AI-related projects, and can effectively manage structured evaluation workflows in a remote environment.
Key Responsibilities- Perform data labeling and annotation tasks for NLP and computer vision projects using assigned tools and guidelines.
- Conduct quality assurance evaluations, including spot checks, review queues, agreement assessments, and error identification.
- Complete RLHF evaluation tasks such as preference ranking, pairwise comparisons, and rubric-based scoring of AI responses.
- Evaluate AI-generated content for instruction following, reasoning quality, safety, and overall performance.
- Follow annotation guidelines, document decision-making processes, and elevate unclear cases when required.
- Improve training data quality through consistency reviews, feedback loops, and taxonomy improvements.
- Support project-based work streams include entity recognition, data curation, and content classification.
- Professional experience in data labeling, annotation operations, or AI evaluation workflows.
- Strong attention to detail with the ability to consistently apply guidelines and evaluation criteria.
- Familiarity with quality assurance processes, sampling methods, and review procedures.
- Ability to handle ambiguous cases and provide clear written explanations for decisions.
- Capability to meet productivity and quality targets while following updated project guidelines.
- Comfortable working independently in a remote environment.
- NLP & computer vision data annotation.
- AI model evaluation, RLHF workflows, and quality assessment.
- Data classification, labeling guidelines, and taxonomy management. Bachelor's Degree or relevant experience in Data Science, Technology, Linguistics, AI, or a related field.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×