Backend Architect: Inference Gateway & Smart Routing
Listed on 2026-10-31
-
Software Development
Backend Developer
is seeking an experienced backend engineer to own and scale the inference gateway that routes every model call. You will manage provider/model selection, fallback, and enforcement within a sub-millisecond budget while building an intelligence layer for selecting the right model.
This role emphasizes cost attribution, metering, and robust, scalable routing across hosted providers and internal models.
Are you ready to take on the Backend Architect:
Inference Gateway & Smart Routing role at
We invite applications for the Backend Architect:
Inference Gateway & Smart Routing position located in New York, NY, United States.
The following opening is for a Backend Architect:
Inference Gateway & Smart Routing with
Our group is growing, and we are hiring a Backend Architect:
Inference Gateway & Smart Routing in New York, NY, United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).