Software Development Engineer II, AI​/ML Elastic Collectives - Annapurna Labs

Position Overview

We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations—the fundamental operations that enable AI to scale across multiple accelerators and servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important. Experience with embedded systems is valued, and experience with high‑speed networking or HPC interconnects is highly valued.

• Develop and maintain collective operations for distributed AI/ML workloads.
• Optimize performance across multiple accelerators and servers.
• Collaborate with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects to deliver high‑performance solutions.
• Mentor new and junior engineers and participate in code reviews.
• Iterate quickly and deliver meaningful solutions at scale.

Basic Qualifications

• 3+ years of non‑internship professional software development experience.
• 2+ years of non‑internship design or architecture experience for new and existing systems.
• Experience programming with at least one software programming language.
• Knowledge of Linux fundamentals.

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Bachelor’s degree in computer science or equivalent.
• Knowledge of Python and/or C++ programming.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Location:

Cupertino, CA, USA.

Base salary range: 165,200 – 223,600 USD annually.