AI Evaluation & QA Analyst - Remote LATAM
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-09-29
-
IT/Tech
IT QA Tester / Automation, AI Evaluation, Data Annotation/ AI Labeling
Gramian Consulting Group is seeking an AI Evaluation & Quality Assurance Specialist to review task quality, instructions, and scoring rubrics for AI agents. You will inspect reference solutions, grading logic, execution traces, and generated deliverables to identify defects and unfair penalties.
Comfortable reading Python, SQL, and shell scripts; passable to highly accurate analysis of technical workflows and evaluation logic is required.
This role, AI Evaluation & QA Analyst - Remote LATAM at Gramian Consulting Group, could be your next opportunity.
This is a Part Time role.
The position is based in United States.
This opportunity is part of our work in Finance, IT & Technology.
The advertised compensation is 55.000 - 83.000.
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).