Senior DL Inference Engineer - GPU & LLM

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software powering AI applications. You will help develop high-performance DL frameworks including SGLang and vLLM for efficient model serving and inference.

You will work on improving platforms, enabling smooth deployment and serving of leading language models, and implementing cutting-edge algorithms for public release.

We are looking to fill the Senior DL Inference Engineer - GPU & LLM Performance position at NVIDIA Corporation in Santa Clara, CA, United States.

We are currently recruiting a Senior DL Inference Engineer - GPU & LLM Performance for our team in Santa Clara, CA, United States.

This is a great opportunity to take on the Senior DL Inference Engineer - GPU & LLM Performance role at NVIDIA Corporation.