More jobs:
Remote AI Evaluation Specialist: Rubric Vetting
Remote / Online - Candidates ideally in
Charlotte, Mecklenburg County, North Carolina, 28245, USA
Listed on 2026-08-02
Charlotte, Mecklenburg County, North Carolina, 28245, USA
Listing for:
AuraOne
Remote/Work from Home
position Listed on 2026-08-02
Job specializations:
-
IT/Tech
AI Evaluation, Data Annotation/ AI Labeling
Job Description & How to Apply Below
Aura One seeks a remote Evaluation Specialist to review agentic task completion model evaluation prompts and responses against Aura One's quality rubric. You will compare paired outputs, label edge cases, and draft structured feedback the modeling team can use to retrain.
Responsibilities include evaluating outputs against the rubric, tagging hallucinations and instruction-following failures, capturing ambiguous prompts, and maintaining reviewer-quality scores with calibration against gold
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×