Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect – Deep Learning and HPC Communications

Join NVIDIA to design next‑generation data‑center platforms and scalable communication software that accelerate AI and HPC workloads.

Co‑design next‑gen data center platforms and scalable communications software, building on our GPU communication libraries (NCCL, NVSHMEM, GPUDirect).

• Investigate opportunities to improve communication performance by identifying bottlenecks in today’s systems.
• Design and implement new communication technologies to accelerate AI and HPC workloads.
• Explore innovative solutions in hardware and software for our next‑generation platforms as part of co‑design efforts involving GPU, networking, and software architects.
• Build proofs‑of‑concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
• Use simulation to explore performance of large GPU clusters (scales of 100s–1000s of GPUs).

• M.S./Ph.D. degree in CS/CE or equivalent experience.
• 3+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
• Deep understanding of operating systems, computer and system architecture.
• Solid fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
• Strong experience with Linux.
• Ability and flexibility to work and communicate effectively in a multi‑national, multi‑time‑zone corporate environment.

• Expertise in related technology and passion for what you do – experience with CUDA programming and NVIDIA GPUs, knowledge of high‑performance networks like Infini Band, RoCE, NVLink, etc.
• Experience with Deep Learning frameworks such as PyTorch, Tensor Flow, and knowledge of deep learning parallelisms and mapping to the communication subsystem; experience with HPC applications.
• Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic, multi‑functional environment.

NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High‑Performance Computing, and Visualization. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility.
As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all.

Job