Sr. Engineering Manager, Inference

Sr. Engineering Manager, Inference – Weights & Biases

Join to apply for the Sr. Engineering Manager, Inference – Weights & Biases role at Weights & Biases

Core Weave, the AI Hyperscaler™, has acquired Weights & Biases to create the most powerful end‑to‑end platform to develop, deploy, and iterate AI faster. Since 2017, Core Weave has operated a growing footprint of data centers across the US and Europe, and was ranked as one of the TIME
100 most influential companies of 2024. By combining Core Weave’s industry‑leading cloud infrastructure with the best‑in‑class tools AI practitioners love from Weights & Biases, we’re setting a new standard for how AI is built, trained, and scaled.

The integration of our teams and technologies is accelerating our shared mission: to empower developers with the tools and infrastructure they need to push the boundaries of what AI can do. From experiment tracking and model optimization to high‑performance training clusters, agent building, and inference at scale, we’re delivering a seamless platform for the full AI lifecycle.

Weights & Biases has long been trusted by over 1,500 organizations—including AstraZeneca, Canva, Cohere, OpenAI, Meta, Snowflake, Square, Toyota, and Wayve—to build better models, AI agents, and applications. Now, as part of Core Weave, that impact is amplified across a broader ecosystem of AI innovators, researchers, and enterprises.

As we unite under one vision, we’re looking for bold thinkers and agile builders who are excited to shape the future of AI alongside us. If you’re passionate about solving complex problems at the intersection of software, hardware, and AI, there has never been a more exciting time to join our team.

As a Senior Engineering Manager for the W&B Inference team, you will lead the group responsible for productizing and operating our inference offering. In partnership with Core Weave AI platform team, you will ensure the service becomes a polished, reliable, developer‑friendly product within the W&B platform.

You will guide engineers working on service reliability, observability, operational excellence, packaging, developer‑facing tooling, and application‑layer enhancements. You will partner closely with Product, Core Weave engineering teams, Design, Support, and GTM stakeholders to ensure the inference experience meets the needs of practitioners deploying and scaling real‑world AI workloads. Your work will directly support end‑users, as well as other products powered by this service, like W&B Training.

You will combine strong engineering leadership with clarity in execution, helping the team deliver improvements that raise reliability, accelerate development workflows, and strengthen the overall inference experience for W&B users.

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
• Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact.
• Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
• Partner with Core Weave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user‑facing product.
• Guide the design and delivery of application‑layer enhancements such as tracing and tool call handling.
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade‑offs across cost, operational load, and architectural constraints.
• Create clarity in complex, cross‑functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams.
• Build a culture of ownership, technical excellence, and continuous improvement within the engineering team.

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible…