Lead Engineering Manager: LLM Inference

Position: Lead Engineering Manager: LLM Inference at NVIDIA
Transform AI software engineering as NVIDIA’s Engineering Manager. Spearhead initiatives to improve LLM/VLM inference software capabilities in a collaborative environment.

This highly impactful role requires a blend of strong leadership and technical expertise. You will oversee the development of LLM software technologies while working with NVIDIA Researchers and cross-functional teams to deliver fast, industry-leading products. Advance your career in a setting where your insights directly shape the future of AI.

Key Responsibilities:

• Lead a team dedicated to pushing LLM inference performance

• Design and optimize key software features for efficiency

• Ensure performance enhancements on NVIDIA’s architectures

• Collaborate on performance tuning with inference teams

• Incorporate cutting-edge technologies for better user experience

Requirements:

• MS, PhD, or equivalent in technology-related fields

• 7+ years in software engineering, including 3+ in leadership

• Expertise in C++ or Python with a focus on quality software

• Experience with LLM or VLM inference frameworks

• Proven ability to scale teams effectively

Drive the future of AI with your leadership at NVIDIA!
#J-18808-Ljbffr