Remote Senior AI Agent Evaluation Engineer
Medford, Middlesex County, Massachusetts, 02153, USA
Listed on 2026-09-30
-
Software Development
AI Engineer (Applied/Software), AI QA / Validation Engineer, AI Reliability/ Performance Engineer
YO AI Labs is seeking a Senior Software Engineer contractor to help build reinforcement learning environments evaluating AI models on software tasks. The role focuses on creating reproducible environments, deterministic verification, and reference solutions for code challenges.
Responsibilities include designing tasks such as bug fixing, feature development, refactoring, and performance optimization, while evaluating agents' reasoning with MCP tools. Remote, ~15 hours/week.
This role is for the Remote Senior AI Agent Evaluation Engineer role at YO AI Labs.
The position is based in Boston, MA, United States.
This opportunity is part of our work in IT & Technology, Engineering.
The advertised compensation is 42.000 - 65.000.
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
Learn more about the Remote Senior AI Agent Evaluation Engineer role in the description above.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).