Senior LLM Inference Engineer — Hybrid & GPU-Focused
-
Software Development
Job Description & How to Apply Below
Hewlett Packard Enterprise Development LP in the United States seeks a Senior Software Engineer to design and evolve the model runtime for the AI inference platform, focusing on low tail latency and high GPU utilization on customer-owned hardware. You will implement core components, work with inference teams, and enhance batching, KV cache management, and distributed execution across GPUs.
The role is hybrid with an expected 2 days per week from an HPE office, with remote options considered.
This role, Senior LLM Inference Engineer — Hybrid & GPU-Focused at Hewlett Packard Enterprise, could be your next move.
If your experience matches this role, we encourage you to apply.
All applications are reviewed carefully by our team.
The position is based in Spring, TX, United States.
This opportunity is part of our work in IT & Technology.
Position Requirements
10+ Years work experience(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction