Remote RLHF Data Reviewer: Consensus & Rubric Feedback
Philadelphia, Philadelphia County, Pennsylvania, 19117, USA
Listed on 2026-10-04
-
IT/Tech
Data Annotation/ AI Labeling, AI Evaluation
Aura One is seeking a Labeler Consensus Preference Data Reviewer for a remote evaluation track. You will review labeler consensus preference data evaluation prompts and responses against our quality rubric, compare paired outputs, and write structured feedback the modeling team can use to retrain.
You will produce preference rankings, reward-model feedback, and calibrated human judgment for post-training pipelines, tagging edge cases and risk signals, while ensuring consistency across long
This role, Remote RLHF Data Reviewer:
Consensus & Rubric Feedback at AI Trainer Jobs, could be your next career step.
Are you ready to take on the Remote RLHF Data Reviewer:
Consensus & Rubric Feedback role at AI Trainer Jobs?
We would love to welcome a new Remote RLHF Data Reviewer:
Consensus & Rubric Feedback to our organisation in United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).