Software Engineer, AI Infrastructure

About the Role

Glean is looking for software engineers to help build the world’s best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain‑adapted language models, natural language question‑answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.

• Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
• Work with and enable other engineers focused on modeling and Agentic capabilities.
• Build agentic systems that leverage AI to proactively monitor, diagnose, debug, and maintain infrastructure health at scale across cloud deployments.
• Write robust code that's easy to read, maintain, and test.
• Mentor more junior engineers, or learn from battle‑tested ones.

• 2‑5 years of experience.
• BA/BS in computer science, math, sciences, or a related degree.
• Proven ability to design, build, and ship production‑ready software, ideally around AI/ML infrastructure (batch processing pipelines, serving infrastructure, LLM orchestration, etc.).
• Strong coding skills (Python, Go, Java).
• Thrive in a customer‑focused, tight‑knit and cross‑functional environment – being a team player and willing to take on whatever is most impactful for the company is a must.
• A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features.

• This role is hybrid (3‑4 days a week in our Mountain View office).

The standard base salary range for this position is $175,000 - $270,000 annually. Compensation offered will be determined by factors such as location, level, job‑related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We offer a comprehensive benefits package including competitive compensation, medical, vision, and dental coverage, generous time‑off policy, and the opportunity to contribute to your 401k plan to support your long‑term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipend to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.

At Glean, AI fluency is core to how we work and we're committed to ensuring every new hire feels confident integrating AI into their everyday work. As part of the interview process, you'll complete a brief AI‑focused exercise or discussion so we can understand how you think about, design, and use AI to drive impact in your role. Feel free to reference any tools, platforms, or workflows you use today – prior Glean experience isn't required.

We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.