ML Compiler Engineer Generative AI & Accelerators

The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state‑of‑the‑art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, Tensor Flow, and JAX. The role will involve working closely with our custom‑built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

• Design, develop, and optimize features for the compiler stack, tackling challenges such as instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, and hardware‑software co‑design.
• Collaborate closely with cross‑functional team members from the Runtime, Frameworks, and Hardware teams to ensure system‑wide performance optimization.
• Participate in design discussions, perform code reviews, and communicate with internal and external stakeholders.
• Build high‑impact solutions for a large customer base, including automation, metrics, and defect resolution.
• Research and implement best‑practice solutions to deliver optimal experiences for customers.

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of non‑internship professional software development experience.
• Proficiency with one or more programming languages (C++ preferred).
• 2+ years of experience in optimization algorithms, graph‑theory, hardware bring‑up, FPGA placement and routing algorithms, or hardware resource management.

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• M.S. or Ph.D. in computer science or a related field.
• Strong knowledge in at least one of the following areas: compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, or hardware‑software co‑design.
• Experience with LLVM and/or MLIR.
• Experience with developing algorithms for simulation tools.
• Experience with Tensor Flow, PyTorch, and/or JAX.
• Experience in LLM, Vision, or other deep‑learning models.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.