Remote AI Quality & Evaluation Specialist
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-10-02
-
Quality Assurance - QA/QC
Data Annotation/ AI Labeling, IT QA Tester / Automation
Gramian Consultancy is seeking an AI Quality & Evaluation Specialist to validate task quality, review AI agent performance, and audit grading logic. You will analyze execution traces, tool calls, reference solutions, and evaluation criteria to identify task defects, grading errors, and unjustified model failures.
This is a remote LATAM contractor role, 40 hours per week, requiring strong analytical judgment, technical QA experience, and fluency in written English to provide precise,
As a Remote AI Quality & Evaluation Specialist, you will play an important part at Gramian Consulting Group in United States.
This posting is for the Remote AI Quality & Evaluation Specialist role at Gramian Consulting Group, based in United States.
We are looking to fill the Remote AI Quality & Evaluation Specialist position at Gramian Consulting Group in United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).