AI Agent Evaluation Engineer - Remote
-
Business
Job Description & How to Apply Below
Cresta is hiring an AI Agent Evaluation Engineer to shape how we measure agent quality across conversations. You will design evaluation rubrics, build automated judges, and calibrate them against human labels to ensure reliable metrics.
You’ll work on multilingual evaluations and collaborate with ML, engineering, and product teams to improve agent performance across languages and channels. You will develop scalable evaluation pipelines, define failure taxonomies, and communicate results clearly
As a AI Agent Evaluation Engineer - Remote, you will play an important part at Cresta in Marion, KS, United States.
This opportunity is part of our work in IT & Technology, Engineering.
The advertised compensation is 120..
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction