Software Engineer, AI Serving; AI Infrastructure

All Open Positions Staff Software Engineer, AI Serving (AI Infrastructure)
Engineering Flex - London, United Kingdom
POS-22139

This role can be Office/Hybrid/Remote based within the UK

Hub Spot is at the forefront of empowering businesses with cutting-edge AI. We are seeking a Staff Software Engineer with a passion for infrastructure and developer experience to join our AI Serving team. The AI Serving team owns model inference and serving infrastructure end-to-end, ensuring AI models are reliably deployed, scaled, observed, and cost-efficient across all hublets and environments, while serving as the home for modern Python at Hub Spot.

The team owns the serving frameworks and libraries that power synchronous, asynchronous, and offline inference, along with model deployment pipelines, autoscaling, and GPU/CPU resource management. The roadmap focuses on improving the reliability and efficiency of batch inference, strengthening model observability, and scaling AI infrastructure cost-effectively. The team also serves as the home for core Python libraries and tooling across Hub Spot.

As a Staff Software Engineer on the AI Serving team you will:

• Write and ship production code that directly powers AI capabilities across Hub Spot, a crucial building block for user and business impact at scale
• Lead the evolution of our model serving and inference infrastructure, improving reliability, scalability, and cost-efficiency
• Set technical direction for how Hub Spot deploys and operates ML models at scale, guiding decisions on architecture, cost optimization, and developer experience
• Work closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving
• Gain deep exposure to a wide range of Hub Spot infrastructure systems through building and maintaining core Python libraries, an excellent opportunity to learn how Hub Spot operates under the hood
• Collaborate with Hub Spotters across the company in engineering, product, design, research, marketing, sales, etc., gaining exposure to how Hub Spot works as a business
• Be empowered to show up as your authentic self and choose a work style and location where you can do your best work, whether that’s at home, in an office, or a blend of the two

We’re not just looking for engineers with many years of experience. We’re looking for engineers who show unique excellence, leadership, and the ability to elevate those around them.

We work with Python and Java primarily, but experience with specific technologies is secondary to strong programming fundamentals. Check out our engineering blog to learn more.

What we’d like to see:

• A proven track record of directly contributing to and leading infrastructure projects at scale, ideally in serving, deployment, or platform engineering
• The ability to work collaboratively with the team to solve problems, transfer knowledge, and develop overall platform architecture
• The ability to work effectively across teams, driving technical initiatives spanning multiple groups within AI Infrastructure and beyond
• Comfort with ambiguity: you can take on broad, cross-team problems and drive them to resolution without waiting for every detail to be specified
• Coaching and mentorship experience
• A track record in partnering successfully with recruiting to build remarkable engineering teams
• Bonus:
  Python expertise. Experience with Python tooling, libraries, and developer experience is a strong plus, given the team’s role in stewarding Python across AI workloads at Hub Spot

We know the confidence gap and impostor syndrome can get in the way of meeting spectacular candidates, so please don’t hesitate to apply — we’d love to hear from you.

If you need accommodations or assistance due to a disability, please reach out to us using this form.

At Hub Spot, we value both flexibility and connection. Whether you’re a Remote employee or work from the Office, we want you to start your journey here by building strong connections with your team and peers. If you are joining our Engineering team, you will be required to attend a regional Hub Spot office for in-person onboarding. If you join our broader Product team,…