Applied ML Engineer - LLM Router; Remote
Boise, Ada County, Idaho, 83701, USA
Listed on 2026-11-01
-
Software Development
Machine Learning/ ML Engineer, AI Engineer (Applied/Software)
Cast AI, based in Miami with a globally distributed team, is seeking an experienced ML engineer to own the auto-router for LLM workloads. You will design training objectives, implement evaluation gates, and drive a feedback loop from live traffic to continuously improve routing decisions.
You will run production-grade experiments, calibrate models, and collaborate with platform engineers to instrument data paths, ensuring latency-aware, cost-effective routing while maintaining high quality.
We would love to welcome a new Applied ML Engineer - Real-time LLM Router (Remote) to our group in United States.
The position is based in United States.
This opportunity is part of our work in IT & Technology.
The advertised compensation is 180..
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).