Tool-Use Reasoning QA Reviewer; Remote Contractor
Philadelphia, Philadelphia County, Pennsylvania, 19117, USA
Listed on 2026-10-09
-
Quality Assurance - QA/QC
Data Annotation/ AI Labeling, IT QA Tester / Automation
Aura One, Inc. is seeking a remote Tool-Use Reasoning Failure Analysis Reviewer to assess evaluation prompts and responses against our quality rubric.
You will compare paired outputs, assign severity tags, and write structured feedback for model retraining. Responsibilities include labeling hallucinations, instruction-following failures, and unsafe content with structured tags; calibrating scores against gold standards; and documenting recurring failure modes for rubric updates.
We would love to welcome a new Tool-Use Reasoning QA Reviewer (Remote Contractor) to our organisation in United States.
Join Aura One, Inc. and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
This posting is for the Tool-Use Reasoning QA Reviewer (Remote Contractor) role at Aura One, Inc., based in United States.
We are looking to fill the Tool-Use Reasoning QA Reviewer (Remote Contractor) position at Aura One, Inc. in United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).