Senior Engineer LLM

Position: Senior Engineer for LLM Performance at NVIDIA
Elevate AI inference capabilities at NVIDIA as a Senior Software Engineer! This role merges your systems knowledge with direct customer engagement, focusing on optimizing performance in LLM serving.

As a Senior Engineer at NVIDIA, you will engage with top-tier clients to understand their architecture and performance goals. This entails setting up benchmarking campaigns, operating vLLM on GPU clusters, and documenting actionable insights. Your work will drive improvements not only for customers but also for the broader open-source community.

Key Responsibilities:

• Work closely with customer engineering teams on performance goals

• Design and conduct benchmarking campaigns on GPU clusters

• Optimize configurations for efficient vLLM deployments

• Create tools and automation pipelines for team enhancement

• Draft clear documentation of findings for technical audiences

Requirements:

• Advanced degree in Computer Science or related field

• Minimum 5 years in complex software systems

• Proven experience with LLM workloads and vLLM

• Expertise in container orchestration and scheduling

• Ability to communicate technical findings effectively

Contribute your expertise to shape the future of AI solutions at NVIDIA.
#J-18808-Ljbffr