AI Developer Trace Task Auditor
Job in
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-10-11
Listing for:
Mercor
Full Time
position Listed on 2026-10-11
Job specializations:
-
Software Development
AI QA / Validation Engineer, AI Engineer (Applied/Software), Software Testing
Job Description & How to Apply Below
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications- 3+ years professional software development
- Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, Git Hub Copilot, Claude Code, or similar)
- Strong code-reading and debugging skills across full-stack or backend systems
- Ability to evaluate multi-step coding trajectories for correctness and best practice
- Experience with Kiro or Amazon Code Catalyst
- Prior work evaluating or grading AI-generated code
- Contributions to developer tooling
The AI Developer Trace Task Auditor position in the IT & Technology field is open for applications.
Full responsibilities and requirements are described in the listing above.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×