Senior Software Engineer, AI​/ML, LLM Modeling

Senior Software Engineer, AI/ML, LLM Modeling

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale and extend well beyond web search. We are looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large‑scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile.

As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as our fast‑paced business grows and evolves. We need our engineers to be versatile, display leadership qualities, and be enthusiastic to take on new problems across the full stack as we continue to push technology forward.

The team works on new ways to search, with a focus on Large Language Models (LLM) modeling. Our work revolves around training LLM models, reinforcement learning, multi‑step reasoning to various distillation techniques, and contributing to different projects on shorter timelines. In this role, you will build new ways to use LLMs in search, develop new techniques, run experiments, and apply modeling methods in real‑world, user‑facing products.

You will weave LLMs into retrieval, tool calling, and content generation, finding unexplored opportunities and collaborating with other teams. In Google Search, we are reimagining what it means to search for information – any way and anywhere – and need to solve complex engineering challenges while expanding our infrastructure to maintain a universally accessible experience that people worldwide rely on.

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 3 years of experience with one or more of the following:
  Speech/audio technology, reinforcement learning, ML infrastructure, or another ML field.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• 3 years of experience with Large Language Models.
• Master’s degree or PhD in Computer Science or a related technical field (preferred).
• 5 years of experience with data structures or algorithms (preferred).
• Experience in Deep Machine Learning, especially with Large Language Models (preferred).
• Experience with reinforcement learning (preferred).

• Propose new modeling ideas and test them in the real world.
• Collect training data and evaluate its quality.
• Design and build evaluations.
• Deploy models to production, measure and optimize their latency.
• Run evaluations, analyze results and suggest modeling improvements.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents‑to‑be, criminal histories consistent with legal requirements, or any other basis protected by law.

English proficiency is a requirement for all roles unless stated otherwise in the job posting.