More jobs:
Remote Multi-Turn Ranking Evaluator & Feedback Specialist
Remote / Online - Candidates ideally in
Columbus, Franklin County, Ohio, 43224, USA
Listed on 2026-08-05
Columbus, Franklin County, Ohio, 43224, USA
Listing for:
AuraOne
Remote/Work from Home
position Listed on 2026-08-05
Job specializations:
-
IT/Tech
AI Evaluation, Data Annotation/ AI Labeling
Job Description & How to Apply Below
Aura One seeks a remote contractor to evaluate multi-turn ranking reward model evaluation prompts and responses. You will compare outputs, assign severity tags, and provide structured feedback to retrain the model using Aura One's rubric.
You will identify hallucinations, instruction-following failures, and unsafe content, while calibrating against gold-standard examples weekly and reporting recurring issues to improve future rubrics.
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×