Neuron Runtime Software Development Engineer , Neuron Runtime

Overview

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the servers that use them. As the Software Development Engineer for the Neuron Runtime Team, you will develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators. You will work on design, development, and deployment of Neuron Runtime and other Neuron components.

The profiler enables internal and external customers to optimize AI workloads across hardware platforms such as Trainium and Inferentia devices by providing deep insights into performance bottlenecks and system behavior. You will help improve performance of ML kernels and ML frameworks. You will manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability. You will collaborate with cross-functional teams to ensure that the C++ compiler exposes key information so customers can understand and optimize the performance of our custom hardware.

Additionally, you will drive innovations that allow the profiler to support multiple frameworks, such as PyTorch, JAX, and XLA.

• Develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators.
• Design, develop, and deploy Neuron Runtime and other Neuron components.
• Enhance profiling capabilities to help internal and external customers optimize AI workloads across Trainium and Inferentia devices.
• Improve performance of ML kernels and ML frameworks.
• Manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure the C++ compiler exposes key performance information for customers to understand and optimize performance.
• Drive innovations to support multiple frameworks (e.g., PyTorch, JAX, XLA).

• 3+ years of non-internship software development experience.
• 2+ years of design or architecture experience (design patterns, reliability, scaling) of new and existing systems.
• Experience programming in at least one software programming language.

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• Bachelor’s degree in computer science or equivalent.

The base salary range is listed below; compensation includes sign-on payments and restricted stock units (RSUs). Benefits include health insurance (medical, dental, vision, prescription), life insurance, EAP, mental health support, Flexible Spending Accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave. Learn more about benefits at the Amazon benefits page.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.