Senior Systems Engineer, Amazon Special Projects

Job :  |  Services LLC

Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company’s Think Big leadership principle to the highest levels. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds.

We launched products such as Comprehend Medical, Echo Frames and Amazon Explore. If you’re interested in innovating at scale to address big challenges in the world, this is the team for you.

• Design and implement the agent daemon on Linux, including GPU discovery, availability detection, and sandboxed container execution for ML inference workloads.
• Architect the local caching system — eviction policies, versioned manifests, disk budget management, and efficient update mechanisms that minimize data transfer for large model files.
• Build VRAM management and graceful workload migration logic.
• Integrate hardware attestation with the security engineer and support diverse hardware configurations and fleet onboarding automation.

Amazon Special Projects is a small, high-autonomy team building new-to-Amazon infrastructure from scratch. The systems component is where software meets hardware: you will build the on-node runtime — the agent, sandbox, GPU manager, and local storage layer — that makes a compute node reliable, secure, and performant. This is systems engineering at its most tangible — your code runs on real hardware and must be resilient to everything the real world throws at it.

• 6+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, Power Shell, Ruby experience
• 6+ years of non-internship professional software development experience
• 6+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production
• 6+ years of systems design, software development, operations, automation, and process improvement experience
• 7+ years of experience in systems programming (Rust, Go, or C++)
• Deep knowledge of Linux internals, including process scheduling, memory management, and storage subsystems
• Hands-on experience with container runtimes (Docker, containers, or custom sandboxes)
• Experience with GPU tooling and management (nvidia-smi, NVML, CUDA runtime)
• Demonstrated ability to build software that runs reliably on heterogeneous hardware

• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
• Experience designing caching systems with constrained storage budgets (LRU, ARC, or custom policies)
• Background in edge computing, fleet management, or embedded systems engineering
• Familiarity with hardware attestation (TPM, TEE) from the device side
• Experience with storage performance profiling and optimization across hardware types
• Track record of building daemon/agent software that operates unattended for extended periods

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a…