Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops of compute power for ML in the cloud, all enabled by the edge software stack, the AWS Neuron SDK, which includes an ML compiler, Neuron Kernel Interface (NKI) compiler, and runtime that natively integrates into popular ML frameworks such as PyTorch and Tensor Flow.

Neuron Kernel Interface (NKI) is a bare‑metal language and compiler for directly programming Neuron devices available on AWS Trn/Inf instances. NKI enables developers to optimize and run operators directly on Neuron cores, fully utilizing available compute and memory resources.

In order to be considered for this role, candidates must be currently located in or willing to relocate to Cupertino, CA.

We are seeking a talented Software Development Manager with strong leadership and mentoring skills to join our NKI Compiler Team. As an SDM III you will lead a team of experienced compiler engineers developing compiler optimization algorithms, deploying a new compiler targeting AWS custom hardware at scale, and innovating on behalf of customers. You will partner with AWS ML services teams, pre‑silicon design, and bring new products/features to market, driving high performance and productivity for deep learning models.

You have knowledge of resource management, scheduling, code generation, optimization, and instruction architectures including CPU, NPU, GPU and novel forms of compute.

Explore the Product:

(Use the "Apply for this Job" box below).-

• 5+ years of engineering team management experience.
• 9+ years of working directly within engineering teams.
• 4+ years of designing or architecting new and existing systems (design patterns, reliability, and scaling).
• Experience partnering with product or program management teams.
• Understanding of compilers (resource management, instruction scheduling, code generation, and compute graph optimization).
• Strong software design fundamentals and excellent system‑level coding skills.

• M.S. or Ph.D. in Computer Science or a related technical field.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

We offer a competitive base salary ranging from $ to $ annually, along with sign‑on payments, restricted stock units (RSUs), health insurance, 401(k) matching, paid time off, and parental leave. Full benefits details can be found at .