Senior LLM Inference Runtime Engineer
Listed on 2026-10-12
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Hewlett Packard Enterprise seeks an experienced software engineer to design, implement, and operate core components of an enterprise LLM serving runtime. You will drive latency/throughput improvements, contribute to Kubernetes orchestration, and mentor teammates across reviews and technical guidance.
The role requires deep knowledge of inference engines and internals, plus strong Go, Python, C++, and CUDA debugging skills.
Step into the Senior LLM Inference Runtime Engineer role at Hewlett Packard Enterprise in Fort Collins, CO, United States and grow with us.
This opportunity is part of our work in IT & Technology.
The advertised compensation is 180..
We aim to respond to suitable candidates as soon as possible.
Full responsibilities and requirements are described in the listing above.
Learn more about the Senior LLM Inference Runtime Engineer role in the description above.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).