Software Development Engineer, ECUltraServer Delivery Team; AWS

Software Development Engineer, EC2 Ultra Server Delivery Team

Job :  | Amazon Development Center U.S., Inc.

The Software Development Engineer II is responsible for designing, building, and maintaining cloud‑based provisioning workflows for NVIDIA GB200/GB300 Ultra Servers, orchestrating complex multi‑asset systems from infrastructure handoff to production delivery. This role requires expertise in AWS services, system architecture, and cross‑functional collaboration with Manufacturing, Operations, and Program Management teams to deliver AI/ML infrastructure.

• Design and architect solutions that are cross‑functional to Manufacturing, Operations, and Program Management
• Work in environments where the technology strategy is defined but the solution design is not
• Build solutions that are stable, logical, testable, and efficient with the ability to independently make trade‑off decisions
• Investigate and develop design concepts to frame solution sets at an application and product level

• Build cloud‑based solutions using AWS native services for scaling infrastructure frameworks
• Write high‑quality, maintainable code with proper testing and code reviews
• Develop and maintain the Multi‑Asset Provisioning Service workflows for GB200 and GB300 Ultra Server hosts
• Implement automation for hardware testing, cable validation, and testing processes
• Create observable systems with appropriate metrics and alarming

• Execute and monitor Ultra Server workflows for Ultra Server provisioning
• Troubleshoot workflow failures and coordinate with downstream teams
• Focus on operational excellence by identifying problems and proposing solutions that improve manufacturing software

• Work with hardware and software integrations specific to GPU clusters and AI/ML training systems
• Manage network partition configurations for multi‑node GPU clusters
• Handle firmware validation and consistency checks across asset groups

• Collaborate with customers and stakeholders to convert business needs into technical designs
• Participate in code reviews and technical assessments

This is a hands‑on position in which you will own everything from end to end: requirements gathering, designs, design reviews, implementations, code reviews, incremental feature launches, operations, mentoring, and the driving of continuous improvement.

The EC2 Ultra Server Provisioning team is a high‑performing engineering organization responsible for delivering NVIDIA‑based ML infrastructure  manage end‑to‑end provisioning workflows for GB200 and GB300 Ultra Servers, from host ingestion through testing, repair, and recovery. Our team drives operational excellence through continuous improvement of build quality metrics, reduction of dwell times, and collaboration on fleet‑wide unsellable reduction initiatives. We work closely with hardware engineering, data center operations, and EC2 service teams to ensure reliable, efficient delivery of critical ML compute capacity.

This is a high‑impact role leading a two‑pizza team of talented engineers solving complex technical challenges in one of Amazon’s fastest‑growing infrastructure domains.

• 3+ years of non‑internship professional software development experience
• 2+ years of non‑internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status,…