Senior Software Engineer - LLM Inference

The Opportunity

At Nutanix, we're simplifying the future of AI with the Nutanix Cloud Platform for AI, enabling organizations to easily build, fine-tune, and run Generative AI, Large Language Models (LLMs), and next-generation Agentic AI applications without the complexity of managing AI infrastructure themselves. Our high-performance, full-stack machine learning cloud platform delivers AI-ready capabilities out of the box ("GPT-in-a-Box") through a software-defined, full-stack infrastructure solution that simplifies AI deployment across on-premises data centers, edge locations, and public clouds.

The Enterprise AI team is at the forefront of this innovation, driving strategic products such as LLM Inference, the AI Gateway, and the Agentic AI Platform, recently showcased at NVIDIA GTC and NEXT 2026. Join the team responsible for the foundational AI technologies powering the next wave of intelligent applications at Nutanix.

About the Team:
We are a fast-paced, globally distributed team building the foundational layers of the enterprise AI stack. By joining our team, you'll help shape the next generation of enterprise AI platforms, working at the intersection of large-scale distributed systems and machine learning infrastructure. This is an opportunity to solve complex technical challenges, influence the direction of key AI technologies, and build systems that power AI workloads at enterprise scale.

You will report to a seasoned Technical Manager who will provide mentorship and guidance as you navigate through your responsibilities. The work setup at Nutanix AI is a hybrid model, offering a blend of in-office collaboration and remote work flexibility. As a new hire, you will be expected to be in the office for 3 days a week, ensuring that you have the opportunity to engage with your team and foster strong working relationships.

Your Role:

What You Will Bring