Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Overview

Do you want to be part of the AI revolution? At AWS we create innovative software and hardware solutions that make deep learning pervasive for everyday developers. AWS Neuron is an SDK that optimizes the performance of complex ML models on AWS Inferentia and Trainium, custom chips designed to accelerate deep‑learning workloads. This role is for a senior software engineer in the Compiler team responsible for building the next‑generation Neuron compiler, which transforms ML models written in frameworks such as PyTorch, Tensor Flow, and JAX into efficient deployments on AWS Inferentia and Trainium servers.

• Design, implement, test, deploy, and maintain software solutions to improve Neuron compiler performance, stability, and user interface.
• Collaborate with chip architects, runtime/OS engineers, scientists, and ML app teams to deploy cutting‑edge ML models on AWS accelerators with optimal cost/performance.
• Serve as the front‑face of the Neuron compiler in open‑source communities (e.g., StableHLO, OpenXLA, MLIR) and influence industry partners.
• Create compiler optimization and verification passes, build features that expose AWS accelerator capabilities to developers, and implement tools for numerical error analysis.
• Resolve compiler defects, participate in design discussions, conduct code reviews, and communicate with internal and external stakeholders through forums such as Git Hub.
• Work in a startup‑like environment focused on the most important development work.

Our team supports new members and values knowledge sharing, mentorship, and career growth. Senior members provide one‑on‑one mentorship and thorough, yet kind, code reviews, empowering engineers to take on increasingly complex tasks.

• Bachelor's degree in computer science or equivalent.
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• 3+ years of experience developing compiler features and optimizations.
• Proficiency in at least one of the following languages: C++ (preferred), Python.

• Master's or Ph.D. in computer science or equivalent.
• Deep knowledge of compiler design, resource management, instruction scheduling, memory allocation, data transfer optimization, compute graph optimization, code generation, and instruction‑set architecture.
• Experience with LLVM and/or MLIR.
• Experience with large‑language models, vision models, or other deep‑learning models.

Amazon offers a comprehensive benefits package including health, dental, vision, prescription, Basic Life & AD&D, supplemental life plans, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.

Cupertino, CA – Salary range: $–$ USD annually. Compensation includes sign‑on payments and restricted stock units (RSUs).

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Posted: July 16, 2026