Principal Software Engineer - Dynamo

Why consider this job opportunity:

• Salary range of $272,000 - $425,500
• Opportunity for equity and comprehensive benefits
• Work with some of the most forward-thinking and hardworking professionals in the industry
• Engage in innovative projects within scalable AI systems
• Contribute to open-source development and community engagement
• Join a company committed to fostering a diverse and inclusive work environment

• Collaborate on the design and development of the Dynamo Kubernetes stack
• Introduce new features to the Dynamo Python SDK and Rust Runtime Core Library
• Design, implement, and optimize distributed inference components in Rust and Python
• Improve intelligent routing and KV-cache management subsystems
• Write clear documentation and contribute to user and developer guides

• BS/MS or higher in computer engineering, computer science, or related engineering (or equivalent experience)
• 15+ years of proven experience in a related field
• Strong proficiency in systems programming (Rust and/or C++) and experience in Python
• Deep understanding of distributed systems, parallel computing, and GPU architectures
• Experience with cloud-native deployment and container orchestration (Kubernetes, Docker)

• Prior contributions to open-source AI inference frameworks (e.g., vLLM, Tensor
  
  RT-LLM, SGLang)
• Experience with GPU resource scheduling, cache management, or high-performance networking
• Understanding of LLM-specific inference challenges, such as context window scaling and multi-model agentic workflows

We prioritize candidate privacy and champion equal-opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately.

We are not the EOR (Employer of Record) for this position. Our role in this specific opportunity is to connect outstanding candidates with a top-tier employer.