ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

The Annapurna Labs team at Amazon Web Services builds AWS Neuron, the SDK used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team works at the hardware-software boundary, crafting high-performance kernels for ML functions to maximize performance on our custom ML accelerators.

• Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models.
• Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
• Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks.
• Implement compiler optimizations such as fusion, sharding, tiling, and scheduling.
• Work directly with customers to enable and optimize their ML models on AWS accelerators.
• Collaborate across teams to develop innovative kernel optimization techniques.

• Design and code solutions to drive efficiencies in software architecture, building metrics, implementing automation, and resolving software defects.
• Build high-impact solutions for a large customer base.
• Participate in design discussions, code review, and communicate with internal and external stakeholders.
• Work cross-functionally to contribute to business decisions with technical input.
• Operate in a startup-like environment, focusing on high-priority work.

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability, scaling) of new and existing systems.
• Experience programming with at least one software programming language.

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• Bachelor’s degree in computer science or equivalent.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants:
Job duties for this position include work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position.

These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.