×
Register Here to Apply for Jobs or Post Jobs. X

AI Evaluator | Remote

Remote / Online - Candidates ideally in
UAE/Dubai
Listing for: Crossing Hurdles
Remote/Work from Home position
Listed on 2026-03-05
Job specializations:
  • IT/Tech
    Data Scientist, Technical Writer
Salary/Wage Range or Industry Benchmark: 120000 - 200000 AED Yearly AED 120000.00 200000.00 YEAR
Job Description & How to Apply Below
Position: AI Evaluator | $22.64/hr Remote

Responsibilities

  • Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across diverse topics.
  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by annotating response strengths, gaps, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of AI-generated responses.
  • Ensure outputs align with expected conversational behavior and system guidelines.
  • Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.
Requirements
  • Should hold Bachelor’s degree completed.
  • Native-level or near-native fluency in Arabic (ILR 5 / CEFR C2) with strong English proficiency.
  • Proven experience using large language models and understanding real-world LLM usage.
  • Excellent writing skills with the ability to provide clear, nuanced, and structured feedback.
  • Strong attention to detail and analytical thinking abilities.
  • Comfortable working across multiple topics, domains, and evolving requirements.
  • Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.
#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary