Sr ML Compiler Engineer , Annapurna Labs

The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud.

All this is enabled by a cutting‑edge software stack, the AWS Neuron Software Development Kit (SDK), which includes an ML compiler, runtime and natively integrates into popular ML frameworks, such as PyTorch, Tensor Flow and MxNet. AWS Neuron and Inferentia are used at scale with customers like Snap, Autodesk, Amazon Alexa, Amazon Rekognition and many others across various segments.

The Team:
As a whole, the Amazon Annapurna Labs team is responsible for silicon development  team covers multiple disciplines including silicon engineering, hardware design and verification, software and operations.

The AWS Neuron team works to optimize the performance of complex neural net models on our custom‑built AWS hardware. Specifically, the team is developing a deep learning compiler stack that takes neural network descriptions created in frameworks such as Tensor Flow, PyTorch, and MXNET, and converts them into code suitable for execution. The team is comprised of some of the brightest minds in engineering, research and product, focused on the ambitious goal of creating a toolchain that will provide a quantum leap in performance.

You:
As a Sr. Machine Learning Compiler Engineer III on the AWS Neuron team, you will be a thought leader supporting the ground‑up development and scaling of a compiler to handle the world's largest ML workloads. You will architect and implement business‑critical features, publish cutting‑edge research, and mentor a brilliant team of experienced engineers. You will serve as a hands‑on partner to AWS ML services teams, be involved in pre‑silicon design, bring new products/features to market and participate in many other exciting projects.

A background in Machine Learning and AI accelerators is preferred, but not required.

About the team

Why AWS:
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Utility Computing (UC): AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (IoT), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services.

Inclusive Team Culture:
Here at AWS, it’s in our nature to learn and be curious. Our employee‑led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and Amaze Con (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Work/Life Balance:
We value work‑life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.

Mentorship and Career Growth:
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge‑sharing, mentorship and other career‑advancing resources here to help you develop into a better‑rounded professional.

Diverse Experiences:
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications…