Software Development Manager, Neuron Tools, Annapurna Labs

Position Overview

AWS Neuron is a complete software stack for the AWS Inferentia and Trainium cloud‑scale machine learning accelerators and the Trn1 and Inf1 servers that use them. As the Software Development Manager for the Tools Team, you will lead a talented team of engineers to develop and maintain high‑performance monitoring and profiling tools for machine learning applications and AI accelerators.

Key responsibilities include designing, developing and deploying the Neuron Profiler and other Neuron tools, ensuring scalability, reliability and usability, collaborating with cross‑functional teams to integrate our C++ compiler and runtime so customers can optimize performance of custom hardware, and driving innovation to support multiple frameworks such as PyTorch, Tensor Flow and XLA.

• 3+ years of engineering team management experience
• 7+ years of working directly within engineering teams experience
• 3+ years of designing or architecting systems for reliability and scaling
• Experience partnering with product or program management teams
• Experience in C++, Go, and Python

• 2+ years of leading teams in Machine Learning development, including building and training large models with PyTorch and/or Tensor Flow using distributed fleets of GPU or other accelerated systems.
• Experience with Linux distributions such as Ubuntu or CentOS, kernel development, and tooling such as perf and gdb.
• Experience with performance profiling, tracing, and analysis of AI training/inference applications.
• Experience with large‑scale, distributed AI training/inference applications, including libfabric, MPI, slurm, and EKS.
• Experience with fleet monitoring, debugging, and reliability.
• Knowledge of AI‑powered optimization suggestions for profiling would be an advantage.

The team embraces diversity and inclusion, offers flexibility in working hours, and supports career growth through mentorship and learning opportunities.

Sign‑on payments, restricted stock units, comprehensive health insurance, 401(k) matching, paid time off and parental leave. Salary range: 212,700–287,700 USD (Cupertino), 184,900–250,200 USD (Seattle).

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need accommodations, please visit (Use the "Apply for this Job" box below)..

Amazon Development Center U.S., Inc.

Job : A3167861