SDE II, ML Infra Services, Annapurna Labs

Job :  | Amazon Development Center U.S., Inc.

Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully integrated. Our org covers multiple disciplines including silicon engineering, hardware design and verification, software, and operations. AWS Nitro, ENA, EFA, Graviton and F1 EC2 Instances, AWS Neuron, Inferentia and Trainium ML Accelerators, and NVMe storage are some of the products we have delivered over the last few years.

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud‑scale machine learning accelerators and the Trn1 and Inf1 servers that use them.

• Lead the design and implementation of the ML infrastructure platform, building systems for capacity management, workload scheduling, and fleet orchestration across ML accelerators.
• Collaborate with ML scientists, training infrastructure engineers, hardware teams, and internal customers to ensure the ML Infra service delivers seamless ML accelerator access, with low wait times, high utilization, and zero‑config deployment from various environments.

• Build high‑impact solutions for a large customer base.
• Participate in design discussions, code reviews, and communicate with internal and external stakeholders.
• Work cross‑functionally to influence business decisions with technical input.
• Operate in a startup‑like development environment, focusing on the most important work.

• High‑impact, high‑visibility: your work directly accelerates every Neuron team's output, multiplying the result of 100+ engineers.
• Greenfield opportunities: building new capabilities with significant design ownership.
• Small, senior team: each member owns major components and drives architectural decisions.
• AI infrastructure: work at the intersection of Kubernetes, custom silicon, and large‑scale ML workloads.

• 3+ years of non‑internship professional software development experience.
• 2+ years of non‑internship design or architecture of new and existing systems.
• Experience programming with at least one software programming language.

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Bachelor's degree in computer science or equivalent.
• Experience taking a leading role in building complex software or computing infrastructure successfully delivered to customers.
• Experience with AWS services (EC2, Lambda, S3, DynamoDB, SQS).
• Experience with Kubernetes, Docker or container ecosystems, or managing full application stacks from OS up through custom applications; experience with big data architecture.
• Experience with version control systems and CI/CD pipeline implementation.
• Strong proficiency in Go/Java, Python, and JavaScript/Type Script.
• Application and kernel performance profiling and optimization.
• Proficiency in integrated software/hardware performance analysis and optimization.
• Experience designing and operating production services.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

The base salary range for this position is  -  USD annually. The Amazon package includes sign‑on payments and restricted stock units (RSUs). Final compensation is determined based on experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.

Location:

Seattle, Washington, USA.