Software Development Engineer, Neuron Collectives, Annapurna Labs; AWS

Software Development Engineer, Neuron Collectives, Annapurna Labs

Annapurna Labs, an integral part of AWS, develops hardware and software components that form critical building blocks for EC2 infrastructure. The Neuron Collectives team seeks a Software Engineer to optimize collective operations for AWS Trainium – Amazon’s high‑priority initiative that powers frontier AI models. In this role you will work closely with the hardware team to maximize performance using C/C++, DMA interfacing, firmware, and detailed topologies, and you will analyze and optimize current collective algorithms using publicly available tools such as Neuron Explorer to fully utilize compute and bus bandwidth across the data center.

• Enhance collective algorithms and topologies for optimal training performance
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
• Monitor and analyze processor, DMA, firmware, and workload metrics
• Optimize collective operations to scale AI compute across the data center
• Work closely with the hardware team to co‑optimize software and Trainium silicon
• Develop and optimize C/C++ implementations of collective communication patterns
• Investigate and implement improvements for specific training topologies used by modern LLMs
• Build and maintain analysis frameworks and automation solutions

• Experience building complex software systems that have been successfully delivered to customers
• Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
• Bachelor’s degree in computer science or equivalent
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience in development in the last 3 years, or experience in embedded development in C/C++

• Master’s degree in computer science or equivalent
• Experience with hardware/software integration and real‑time systems
• Familiarity with collective communication algorithms (e.g., all-reduce, all-gather) or distributed training frameworks

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants:
Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position.

These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit (Use the "Apply for this Job" box below). for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.