Solutions Architect, AI and ML

NVIDIA is building the world’s leading AI company, and we are looking for an experienced Cloud Solution Architect to help assist customers with adoption of GPU hardware and software, as well as building and deploying Machine Learning (ML), Deep Learning (DL), and data analytics solutions on various Cloud Computing Platforms. As part of the Solutions Architecture team, we work with some of the most exciting computing hardware and software technologies including the latest breakthroughs in machine learning and data science.

A Solutions Architect is the first line of technical expertise between NVIDIA and our customers, so you will engage directly with developers, researchers, and data scientists at some of NVIDIA’s most strategic technology customers, as well as work directly with business and engineering teams on product strategy. We are looking for a Solutions Architect to help drive end‑to‑end technology solutions by applying NVIDIA’s full set of technologies based on the business needs of customers.

Join us in this exciting endeavor!

• Help cloud customers craft, deploy, and maintain scalable, GPU‑accelerated inference pipelines on cloud ML services and Kubernetes for large language models (LLMs) and generative AI workloads.
• Enhance performance tuning using Tensor
  
  RT/Tensor
  
  RT‑LLM, vLLM, Dynamo, and Triton Inference Server to improve GPU utilization and model efficiency.
• Collaborate with multi‑functional teams (engineering, product) and offer technical mentorship to cloud customers implementing AI inference at scale.
• Build custom PoCs for solutions that address customers’ critical business needs applying NVIDIA hardware and software technology.
• Partner with Sales Account Managers or Developer Relations Managers to identify and secure new business opportunities for NVIDIA products and solutions for ML/DL and other software solutions.
• Prepare and deliver technical content to customers, including presentations about purpose‑built solutions and workshops about NVIDIA products and solutions.
• Conduct regular technical customer meetings for project/product roadmap, feature discussions, and introduction to new technologies. Establish close technical ties to the customer to facilitate rapid resolution of customer issues.

• BS/MS/PhD in Electrical/Computer Engineering, Computer Science, Statistics, Physics, or other Engineering fields or equivalent experience.
• 3+ Years in Solutions Architecture with a proven track record of moving AI inference from POC to production in cloud computing environments, including AWS, GCP, or Azure.
• 3+ years of hands‑on experience with Deep Learning frameworks such as PyTorch and Tensor Flow.
• Excellent knowledge of the theory and practice of LLM and DL inference.
• Strong fundamentals in programming, optimizations, and software design, especially in Python.
• Experience with containerization and orchestration technologies like Docker and Kubernetes, monitoring, and observability solutions for AI deployments.
• Knowledge of inference technologies – NVIDIA NIM, Tensor
  
  RT‑LLM, Dynamo, Triton Inference Server, vLLM, etc.
• Proficiency in problem‑solving and debugging skills in GPU environments.
• Excellent presentation, communication, and collaboration skills.

• AWS, GCP or Azure Professional Solution Architect Certification.
• Experience optimizing and deploying large MoE LLMs at scale.
• Active contributions to open‑source AI inference projects (e.g., vLLM, Tensor
  
  RT‑LLM, Dynamo, SGLang, Triton or similar).
• Experience with Multi‑GPU Multi‑node inference technologies like Tensor Parallelism/Expert Parallelism, Disaggregated Serving, LWS, MPI, EFA/Infiniband, NVLink/PCIe, etc.
• Experience in developing and integrating monitoring and alerting solutions using Prometheus, Grafana, and NVIDIA DCGM and GPU performance analysis and tools like NVIDIA Nsight Systems.

We make extensive use of conferencing tools, but occasional travel is required for local on‑site visits to customers and industry events. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward‑thinking and hardworking people…