Senior Solutions Architect, AI Cluster and Telemetry

Senior Solutions Architect – Data Center Systems & Performance

We are looking for a Senior Solutions Architect specializing in Data Center Systems & performance to join our elite solutions architecture team. In this role, you will work at the intersection of groundbreaking hardware and complex software stacks, acting as a pivotal technical expert uniting engineering, field teams, and customers with highly intensive requirements.

• Work together with partners and customers to identify, analyze, and resolve complex performance bottlenecks across interconnected GPU, CPU, and networking systems.
• Complete and maintain robust performance benchmarking suites to stress‑test high‑performance clusters and establish performance baselines.
• Apply industry‑standard performance tools to monitor hardware performance counters and extract deep system telemetry.
• Investigate system and software configurations to find and fix subtle discrepancies that impact peak performance.
• Partner closely with internal engineering units and outside collaborators and customers to collectively develop solutions and boost infrastructure performance.

• BS or MS in Engineering, Electrical Engineering, Physics, Computer Science, or equivalent experience.
• 8+ years of work‑related experience in the high‑tech industry, particularly in system build, performance analysis, and technical customer‑facing roles.
• Strong understanding of how CPUs, GPUs, and high‑speed networking fabrics interact within massive clusters.
• Practical experience with performance counters, profiling tools, and telemetry collection systems such as Perf, eBPF, Prometheus, Grafana.
• Practical experience working with containers, cloud provisioning, and scheduling tools such as Docker, Docker Swarm, Kubernetes, SLURM, Ansible.
• Proven track record of transforming raw logs and telemetry into structured time‑series data, dashboards, and heat maps.
• Ability to translate complex, low‑level technical performance anomalies into clear, actionable narratives for cross‑functional teams.
• Strong collaborative skills and a proven history of building successful relationships across diverse engineering and operations teams.

• Deep knowledge of multi‑GPU communication libraries like NCCL and their optimization of inter‑GPU topologies.
• Hands‑on experience with NVIDIA hardware architectures, NVLink, NVSwitch, or NVIDIA Nsight tools.
• Experience optimizing distributed AI training workloads, large‑scale language models, or high‑performance computing environments.
• Experience developing or integrating Agentic AI frameworks to autonomously parse telemetry logs, diagnose configuration drifts, or automate cluster triage.

Base salary ranges as follows:
Level4 – $184,000–$287,500;
Level5 – $224,000–$356,500. Compensation will be based on location, experience, and comparable roles. Employees are also eligible for equity and benefits.

NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.