Sr. Machine Learning Compiler Engineer, AWS Neuron, Annapurna Labs

Job Overview

The AWS Machine Learning accelerators, including Inferentia and Trainium, are at the forefront of AWS innovation, enabling generative AI  AWS Neuron Software Development Kit (SDK) integrates natively with popular frameworks such as PyTorch, Tensor Flow, and MXNet, providing a deep learning compiler stack for custom‑built AWS hardware.

The Amazon Annapurna Labs team is responsible for silicon development across engineering, hardware design and verification, software and operations. The AWS Neuron team focuses on optimizing performance of complex neural‑net models on AWS custom hardware, developing a compiler that transforms model descriptions into executable code for the cloud.

As a Sr. Machine Learning Compiler Engineer III you will be a thought leader in ground‑up development and scaling of a compiler to handle the world’s largest ML workloads. You will architect and implement business‑critical features, publish cutting‑edge research, mentor senior engineers, partner with AWS ML services teams, and participate in pre‑silicon design and product launches. A background in Machine Learning and AI accelerators is preferred, but not required.

• 5+ years of professional software development experience (non‑internship)
• 5+ years of programming with at least one software programming language
• 5+ years of leading design or architecture of new or existing systems (design patterns, reliability, scaling)
• 5+ years of full software development life cycle experience including coding standards, code reviews, source control, build processes, testing and operations
• Experience as a mentor, tech lead or leading an engineering team

• Bachelor’s degree in computer science or equivalent

The base salary range for this position is listed below. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on experience, qualifications and location.

• USA, CA, Cupertino –  –  USD annually
• USA, MA, Boston –  –  USD annually
• USA, WA, Seattle –  –  USD annually

Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit (Use the "Apply for this Job" box below). for more information.