Inference Performance Engineer: Accelerate LLMs & Cut Costs

Baseten is seeking an Inference Performance Engineer to accelerate the world's most demanding AI workloads. You’ll optimize the inference stack from engine to routing, applying techniques like quantization, speculative decoding, and KV-cache management to improve latency and throughput.

You’ll collaborate across teams to ship performance wins, contribute to open‑source engines, and bring up new model architectures on new hardware in a fast‑paced startup environment.

As a Inference Performance Engineer:
Accelerate LLMs & Cut Costs, you will play an important part at US Health Partners, LLC in New York, NY, United States.

This posting is for the Inference Performance Engineer:
Accelerate LLMs & Cut Costs role at US Health Partners, LLC, based in New York, NY, United States.

We are looking to fill the Inference Performance Engineer:
Accelerate LLMs & Cut Costs position at US Health Partners, LLC in New York, NY, United States.