LLM Inference Runtime Architect Scalability
-
Software Development
Job Description & How to Apply Below
Hewlett Packard Enterprise seeks a senior architect to define and own the technical architecture for LLM inference runtimes, focusing on execution efficiency and distributed inferencing strategies on customer-owned hardware. You will lead design reviews and mentor engineers.
You will collaborate with performance teams to optimize latency and throughput, apply continuous batching, and advance GPU memory management and inference internals in a fast-paced AI systems environment.
As a LLM Inference Runtime Architect | Performance & Scalability, you will play an important part at Hewlett Packard Enterprise in Durham, NC, United States.
Learn more about the LLM Inference Runtime Architect | Performance & Scalability role in the description above.
We appreciate your interest in this position.
Join Hewlett Packard Enterprise and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction