Senior Software Engineer, NCCL

Overview

We are looking for a highly motivated senior software engineer for an exciting role in our communication libraries and network software team. The position will be part of a fast‑paced crew that develops and maintains software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning.

• Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for Tensor Flow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
• Participate in and contribute to parallel programming interface specifications like MPI/OpenSHMEM.
• Design, implement and maintain system software that enables interactions among GPUs and between GPUs and other system components.
• Create proof‑of‑concepts to evaluate and motivate extensions in programming models, new designs in runtimes, and new features in hardware.

• M.S./Ph.D. degree in CS/CE or equivalent experience.
• 5+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Strong experience with Linux.
• Expert understanding of computer system architecture and operating systems.
• Experience with parallel programming interfaces and communication runtimes.
• Ability and flexibility to work and communicate effectively in a multi‑national, multi‑time‑zone corporate environment.
• Deep understanding of technology and passion for what you do.
• Experience with CUDA programming and NVIDIA GPUs.
• Knowledge of high‑performance networks like Infini Band, iWARP, etc.
• Experience with HPC applications.
• Experience with Deep Learning Frameworks such as PyTorch, Tensor Flow, etc.
• Strong collaborative and interpersonal skills, with proven ability to effectively guide and influence within a dynamic matrix environment.

Base salary ranges from $152,000 to $241,500 for Level 3 and $184,000 to $287,500 for Level 4, depending on location, experience and market. You will also be eligible for equity and comprehensive benefits.

NVIDIA is committed to fostering an inclusive work environment and is an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA uses AI tools in its recruiting processes.