ML Compiler Engineer, Annapurna Labs

Overview

The AWS Neuron Compiler team is seeking experienced compiler engineers to develop a deep learning compiler stack that optimizes models from PyTorch, Tensor Flow, and JAX for custom AWS ML accelerators such as Inferentia and Trainium.

• Design, develop and optimize compiler features for deep learning workloads.
• Research and implement novel compiler techniques and deep‑learning systems software.
• Collaborate with runtime, framework, and hardware teams to deliver end‑to‑end performance.
• Handle backend tasks including instruction scheduling, memory allocation, data‑transfer optimization, graph partitioning, parallel programming, code generation, ISA design, hardware bring‑up and hardware‑software co‑design.
• Build metrics, automation, and root‑cause analysis to improve software quality.
• Participate in design discussions, code review, and stakeholder communication.
• Work in a fast‑paced, startup‑like environment focused on delivering high‑impact features.

• Bachelor’s degree in Computer Science, Engineering, Mathematics or related field.
• 3+ years of professional software development experience.
• Proficiency in at least one programming language (C++ preferred).
• 2+ years of experience in optimization algorithms, graph theory, hardware bring‑up, FPGA placement and routing, or hardware resource management.
• 3+ years of full software‑development life cycle experience (coding standards, code review, source control, build processes, testing, and operations).
• Strong knowledge of compiler design, instruction scheduling, memory allocation, data‑transfer optimization, graph partitioning, parallel programming, code generation, ISA design, new hardware bring‑up, and hardware‑software co‑design.
• Experience with LLVM and/or MLIR.
• Experience developing algorithms for simulation tools.
• Experience with Tensor Flow, PyTorch, and/or JAX.
• Experience with large‑language models, vision or other deep‑learning models (optional but preferred).
• M.S. or Ph.D. in Computer Science or related field is a plus.

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants:
The job duties include work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence; communicate effectively; follow all federal, state, and local laws and Company policies; and exercise sound judgment. Qualified applicants with arrest and conviction records will be considered as permitted by the Los Angeles County Fair Chance Ordinance.

Base salary range: $165,200 – $223,600 USD annually. Package includes sign‑on payments and restricted stock units (RSUs). Benefits include health, dental, vision, prescription coverage, 401(k) matching, paid time off, parental leave, and additional benefits.

Annapurna Labs (U.S.) Inc.