Job Description & How to Apply Below
As an AI Automation Evaluation Engineer, you will provide human feedback that helps leading AI organizations train Large Language Models. Projects teach systems to coordinate multi-step tasks, manage architectural workflows, and produce reasoned outputs. The work requires careful analysis of live agent behavior.
Key Responsibilities:
Create rubrics assessing agent outputs and workflows
Investigate failures within agent traces
Challenge agents through targeted stress testing
Requirements:
Two or more years in backend engineering or AI automation
Experience integrating complex systems with modular services
Hands-on work with multi-turn system interactions
Strong attention to detail during technical evaluation
Ability to deliver high-density technical feedback
Use systems integration, agent evaluation, and technical feedback expertise to support higher-quality autonomous AI development with Outlier.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×