Senior Backend Engineer — Remote Inference Gateway & Routing
New York, New York City, Richmond County, New York, 94199, USA
Listed on 2026-10-19
-
Software Development
Backend Developer
is hiring for a remote role in the United States. You will own and scale the inference gateway, spanning model routing, cost attribution, and enforcement on the request path.
You’ll work between model serving and product to optimize latency, cost, and reliability, with preference for candidates in SF Bay Area or NYC but open to strong remote applicants across the US. The position emphasizes building a scalable gateway with a single-digit-millisecond budget, strong Python/Kubernetes
This is a strong opportunity to take on the Senior Backend Engineer — Remote Inference Gateway & Routing role at
Full responsibilities and requirements are described in the listing above.
Learn more about the Senior Backend Engineer — Remote Inference Gateway & Routing role in the description above.
We appreciate your interest in this position.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).