Software Engineer, AI​/ML, Google Public Sector

Staff Software Engineer, AI/ML, Google Public Sector

Google Reston, VA, USA

• Bachelor's degree or equivalent practical experience.
• 8 years of experience programming in C++, Java, Python, Kotlin or Go.
• Experience in technical leadership, including defining technical road maps, delivering projects, and maintaining code quality standards.
• Experience in parallel computing paradigms, hardware-level optimization, and low-level accelerator optimization.

• Master's degree or PhD in a quantitative discipline (e.g., Computer Science, Physics, Applied Mathematics, or similar).
• 8 years of experience designing, building, and operating large-scale distributed data systems and production machine learning deployments.
• Experience deploying modern deep learning architectures using frameworks like PyTorch or Tensor Flow on large-scale clusters.
• Experience with cloud-native infrastructure (Docker, Kubernetes) and managing distributed file systems and cloud object storage.
• Active, or the ability to obtain, a Secret security clearance.

We are seeking a technical Senior AI/ML Software Engineer to lead the architecture and deployment of large-scale distributed data systems and advanced machine learning pipelines. In this role, you will design infrastructure capable of analyzing high-throughput data streams. You will bridge the gap between High-Performance Computing (HPC) and modern AI applications, optimizing complex inference workloads for specialized hardware accelerators while guiding cross-functional engineering teams.

• Architect and operate advanced data synthesis pipelines and AI-based retrieval applications.
• Manage petabyte-scale data ingestion and synchronization across compute environments, including local storage, cloud backends, and on‑prem resources.
• Optimize highly parallel numerical operations and ML inference algorithms for specialized hardware accelerators.
• Lead technical direction and provide engineering mentorship for groups developing complex production software systems.
• Implement rigorous data life‑cycle policies to ensure system resilience, data integrity, and fault recovery at scale.

The US base salary range for this full-time position is $207,000-$300,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job‑related skills, experience, and relevant education or training.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents‑to‑be, criminal histories consistent with legal requirements, or any other basis protected by law.

See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.