×
Register Here to Apply for Jobs or Post Jobs. X

AI Agent Developer & Tester

Job in Orem, Utah County, Utah, 84058, USA
Listing for: Smith Johnson Group
Full Time position
Listed on 2026-06-03
Job specializations:
  • Software Development
    Software Engineer
Salary/Wage Range or Industry Benchmark: 80000 - 100000 USD Yearly USD 80000.00 100000.00 YEAR
Job Description & How to Apply Below

Responsible for implementing and testing Lang Graph-based AI agent workflows within the APEX platform, including node-level unit testing, graph-level integration testing, regression suite ownership, and production observability. Also owns E2E UI test coverage via Playwright across all three APEX portals and manages GCP infrastructure supporting the agent layer.

Must Have
  • Agent unit testing - every node tested in isolation with mocked state before it ships
  • Agent graph testing - full end-to-end graph runs with controlled inputs
  • LLM mocking strategies – unit test, mock, fake model stubs, or framework-level mocking; non-determinism must be controlled
  • Flaky test management - controlled seeds, mocked outputs, or threshold-based assertions for non-deterministic agent behavior
  • Regression test authorship - every bug fixed gets a regression test before the fix is considered done
  • Playwright E2E testing - responsible for test coverage, not just test authorship; actively tracks and closes flow gaps
  • Structured output / JSON schema validation
  • Application Development and Support Experience in cloud (GCP is preferred but any cloud is fine)
Nice to Have
  • Lang Smith / RAGAS
  • Financial services / regulated industry
#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary