Skip to content
×

AI Agent Evaluation Engineer - Remote

Remote / Online - Candidates ideally in
Davenport, Scott County, Iowa, 52801, USA
Listing for: Cresta
Full Time, Remote/Work from Home position Listed on 2026-11-16
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 180000 USD Yearly USD 120000.00 180000.00 YEAR

Job Description & How to Apply Below

Cresta is hiring an AI Agent Evaluation Engineer to shape how we measure agent quality across conversations. You will design evaluation rubrics, build automated judges, and calibrate them against human labels to ensure reliable metrics.

You’ll work on multilingual evaluations and collaborate with ML, engineering, and product teams to improve agent performance across languages and channels. You will develop scalable evaluation pipelines, define failure taxonomies, and communicate results clearly

As a AI Agent Evaluation Engineer - Remote, you will play an important part at Cresta in Marion, KS, United States.

This opportunity is part of our work in IT & Technology, Engineering.

The advertised compensation is 120..

We aim to respond to suitable candidates as soon as possible.

Full responsibilities and requirements are described in the listing above.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary