Software Development Engineer II, AI​/ML Elastic Collectives - Annapurna Labs; AWS

Software Development Engineer II, AI/ML Elastic Collectives - Annapurna Labs

We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations – the fundamental operations that enable AI to scale across multiple accelerators and servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important. Experience with embedded systems is valued, and experience with high‑speed networking or HPC interconnects is highly valued.

If you like solving hard problems, want to work with HPC and ML customers, iterate fast, and deliver meaningful solutions at scale, then come join us! This truly is a role on the forefront of AI/ML – you’ll be working on features for the largest clusters, with the largest customers, and for the largest AI models.

The org you would be joining is Annapurna Labs, an integral part of AWS that develops hardware and software components critical to EC2 infrastructure. Every EC2 instance runs hardware designed in Annapurna Labs. We specialize in designing software, systems, and chips that optimize the AWS customer experience.

Our team focuses on building networking solutions for Machine Learning (ML) and High‑Performance Computing (HPC) workloads on AWS. We have mixed‑discipline orgs, and you’ll work side‑by‑side with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects. Our workforce is truly international, and we take mentorship seriously – senior mentorship is expected, and you will mentor junior engineers. The pace is fast as we work on the latest AI/ML advancements, but we also bond as a team and celebrate successes.

We offer flexibility in working hours and respect work‑life balance as a core value. Career growth opportunities are available, and you will be encouraged to keep learning as the AI/ML field evolves rapidly.

We dedicate ourselves to supporting new members with a broad mix of experience levels and tenures. Senior members provide one‑on‑one mentoring and thorough, kind code reviews. We care about your career growth and strive to assign projects that help you develop engineering expertise and take on more complex tasks.

AWS values diverse experiences. Even if you do not meet all listed qualifications and skills, we encourage you to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let that stop you from applying.

Here at AWS, it’s in our nature to learn and be curious. Our employee‑led affinity groups foster a culture of inclusion that empowers us to be proud of our differences. Ongoing events and learning experiences inspire us to embrace our uniqueness.

We value work‑life harmony. Achieving success at work should never come at the expense of home life, which is why we strive for flexibility as part of our working culture.

We continuously raise our performance bar as we strive to become Earth’s best employer. You’ll find endless knowledge‑sharing, mentorship, and career‑advancing resources here to help you develop into a well‑rounded professional.

• 3+ years of non‑internship professional software development experience
• 2+ years of non‑internship design or architecture (design patterns, reliability, and scaling) of new and existing systems
• Experience programming with at least one software programming language
• Knowledge of Linux fundamentals

• 3+ years of full software development life cycle, including coding standards, code reviews, source control, build processes, testing, and operations experience
• Bachelor’s degree in computer science or equivalent
• Knowledge of Python and/or C++ programming

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants:
Job duties for this position include working safely and cooperatively with other employees, supervisors, and staff; adhering to…