LLM Inference Engineer; Mid/Senior/Onsite
Listed on 2026-10-20
-
Software Development
AI Engineer (Applied/Software)
Hippocratic AI in Menlo Park, CA is seeking an LLM Inference Engineer (Mid/Senior/Staff) to design and optimize multi-node serving infrastructures for healthcare language models. You will tackle distributed inference, quantization, speculative decoding, and caching to achieve sub-100ms responses across diverse GPU types.
Responsibilities include shipping major serving improvements within 90 days, deploying advanced architectures, and driving core optimization techniques that enhance latency,
Our organisation is growing, and we are hiring a LLM Inference Engineer (Mid/Senior/Staff) Onsite in Menlo Park, CA, United States.
Are you ready to take on the LLM Inference Engineer (Mid/Senior/Staff) Onsite role at We Love AI Jobs?
We would love to welcome a new LLM Inference Engineer (Mid/Senior/Staff) Onsite to our team in Menlo Park, CA, United States.
For the LLM Inference Engineer (Mid/Senior/Staff) Onsite position at We Love AI Jobs, we are reviewing applications now.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).