AI Evaluation & Agent Systems Engineer
Job in
Dallas, Dallas County, Texas, 75201, USA
Listing for:
Syntony
Full Time
position
Listed on 2026-11-05
Job specializations:
-
Software Development
AI QA / Validation Engineer, AI Reliability/ Performance Engineer
Job Description & How to Apply Below
- - Build evaluation software for AI models and agents, designing tests and measuring behavioral changes.
- - Develop evaluation harnesses for model behavior, tool use, and multi-step agent tasks.
- - Record inputs, configurations, tool calls, and observations in structured traces.
- - Build replay and regression tests comparing system behavior before and after changes.
- - Requires experience with evaluation software, model integrations, or agent systems.
- - Requires understanding of experiment design, n…
Wie wil weten of een AI-systeem na een update veiliger of juist riskanter is geworden, heeft een betrouwbare manier nodig om dat te meten. Hier bouw je testopstellingen waarmee andere onderzoekers en ontwikkelaars dat gedrag vastleggen en vergelijken. Je beantwoordt de veiligheidsvraag dus niet zelf, maar je bouwt het meetinstrument dat bepaalt hoe goed anderen dat kunnen.
We invite applications for the AI Evaluation & Agent Systems Engineer position located in United States.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).