ML Compiler Engineer, Annapurna Labs; AWS

The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state‑of‑the‑art deep learning compiler stack that optimizes application models across diverse domains, including large language and vision, originating from leading frameworks such as PyTorch, Tensor Flow, and JAX. Your role will involve working closely with our custom‑built machine learning accelerators, including Inferentia and Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

• Design, develop, and optimize features for the compiler stack.
• Address challenging technical problems at every layer of the stack, often solving problems that have not been solved before.
• Implement, test, deploy, and maintain innovative software solutions that transform service performance, durability, cost, and security.
• Research and evaluate implementations to deliver the best possible customer experiences.
• Collaborate closely with cross‑functional team members from Runtime, Frameworks, and Hardware teams to ensure system‑wide performance optimization.
• Participate in design discussions, code reviews, and communicate with internal and external stakeholders.
• Develop high‑impact solutions for our large customer base.
• Work in a startup‑like development environment focused on the most important tasks.

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of professional software development experience (non‑internship).
• Proficiency with one or more programming languages, with C++ preferred.
• 2+ years of experience in optimization algorithms, graph theory, hardware bring‑up, FPGA placement and routing algorithms, or hardware resource management.

• 3+ years of work in the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• M.S. or Ph.D. in computer science or a related field.
• Strong knowledge in one or more of the following areas: compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, and hardware‑software co‑design.
• Experience with LLVM and/or MLIR.
• Experience developing algorithms for simulation tools.
• Experience with Tensor Flow, PyTorch, and/or JAX.
• Experience in large‑language models, vision, or other deep‑learning models.

USA, WA, Seattle – $–$ USD annually. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation is determined based on experience, qualifications, and location. Amazon offers comprehensive benefits, including health insurance, 401(k) matching, paid time off, and parental leave.

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or any other legally protected status.

Los Angeles County applicants:
Job duties for this position include working safely and cooperatively with other employees, supervisors, and staff; adhering to standards of excellence despite stressful conditions; communicating effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and following all federal, state, and local laws and company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position.

Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.