Senior Software Engineer, SRE, ML Fleet Systems

Senior Staff Software Engineer, SRE, ML Fleet Systems

2 days ago Be among the first 25 applicants

You have the opportunity to share your preferred working location:
Sunnyvale, CA, USA;
Kirkland, WA, USA;
Seattle, WA, USA
.

• Bachelor’s degree in Computer Science, a related field, or equivalent practical experience.
• 8 years of experience with software development in one or more programming languages.
• 4 years of experience leading projects and providing technical leadership.
• 3 years of experience designing, analyzing, and troubleshooting distributed systems.

• Master's degree or PhD in Computer Science, or a related technical field.
• Experience with infrastructure optimization, performance analysis, and cost reduction in large‑scale environments.
• Experience with Colossus and other relevant Google storage systems (e.g., Bigtable, Spanner, Woodshed).
• Understanding of resource management systems (e.g., Borg, Kubernetes, Flex), cluster management, and scheduling algorithms.
• Familiarity with Machine Learning hardware accelerators (e.g., TPUs, GPUs) and their lifecycle management.
• Excellent communication and collaboration skills, with the ability to build consensus across organizational boundaries.

Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed, fault-tolerant systems. SRE ensures that Google Cloud’s services—both our internally critical and our externally visible systems—have reliability, uptime appropriate to customers’ needs and a fast rate of improvement. Additionally, SRE’s will keep an ever‑watchful eye on our systems capacity and performance.

Much of our software development focuses on optimizing existing systems, building infrastructure, and eliminating work through automation. On the SRE team, you’ll manage the complex challenges of scale that are unique to Google Cloud, while using your expertise in coding, algorithms, complexity analysis, and large‑scale system design. SRE’s culture of intellectual curiosity, problem solving, and openness is key to its success.

Our organization brings together people with a wide variety of backgrounds, experiences, and perspectives, encouraging collaboration, big thinking, and risk‑taking in a blame‑free environment. We promote self‑direction to work on meaningful projects and provide the support and mentorship needed to learn and grow.

As a Senior Staff Software Engineer in the ML Fleet Systems team, you will shape the future of how Google manages its massive and rapidly growing ML infrastructure. You will be a technical luminary, responsible for the architecture, design, and implementation of systems and strategies ensuring scalable, reliable, and efficient deployment and consumption of ML resources. You will handle ambiguous, high‑impact problems, influencing teams across organizational boundaries.

Behind everything our users see online is the architecture built by the Technical Infrastructure team to keep it running. From developing and maintaining our data centers to building the next generation of Google platforms, we make Google’s product portfolio possible. We take engines apart to rebuild them, keeping networks up and running for the best, fastest experience possible.

The US base salary range for this full‑time position is $248,000–$349,000 + bonus + equity + benefits. Compensation details listed in US role postings reflect the base salary only and do not include bonus, equity, or benefits. Learn more about benefits at Google.

• Define and drive the long‑term technical outlook, strategy, and roadmap for critical software systems that manage Alphabet’s ML fleet, including capacity management for all ML resources such as TPUs, GPUs, compute, storage, and networking.
• Act as the Technical Lead for the internal Capacity Management Business team within ML Fleet, providing technical direction, mentorship, and guidance to build and evolve our capacity management solutions from operations to robust engineered solutions.
• Collaborate closely with engineering partners (e.g., Onefleet, Spatial Flex, Operational Data Store) to…