Principal Software Engineer, Infrastructure

Principal Software Engineer, Infrastructure – Weights & Biases

Join to apply for the Principal Software Engineer, Infrastructure – Weights & Biases role at Weights & Biases

5 days ago Be among the first 25 applicants

Core Weave, the AI Hyperscaler™, acquired Weights & Biases to create the most powerful end‑to‑end platform to develop, deploy, and iterate AI faster. Since 2017, Core Weave has operated a growing footprint of data centers covering every region of the United States and across Europe, and was ranked as one of the TIME
100 most influential companies of 2024. By bringing together Core Weave’s industry‑leading cloud infrastructure with the best‑in‑class tools AI practitioners know and love from Weights & Biases, we’re setting a new standard for how AI is built, trained, and scaled.

The integration of our teams and technologies is accelerating our shared mission: to empower developers with the tools and infrastructure they need to push the boundaries of what AI can do. From experiment tracking and model optimization to high‑performance training clusters, agent building, and inference at scale, we’re combining forces to serve the full AI lifecycle – all in one seamless platform.

Weights & Biases has long been trusted by over 1,500 organizations – including AstraZeneca, Canva, Cohere, OpenAI, Meta, Snowflake, Square, Toyota, and Wayve – to build better models, AI agents and applications. Now, as part of Core Weave, that impact is amplified across a broader ecosystem of AI innovators, researchers, and enterprises.

As we unite under one vision, we’re looking for bold thinkers and agile builders who are excited to shape the future of AI alongside us. If you’re passionate about solving complex problems at the intersection of software, hardware, and AI, there’s never been a more exciting time to join our team.

As a distinguished engineer on marimo’s molab team, you will design and implement the backend architecture of molab, solving for high availability, low latency (both the ability to rapidly spin up and spin down notebook kernels on demand, as well as low latency communication between the notebook frontend and backend), stability, and fraud and abuse. You will design molab to run on Core Weave’s specialized kubernetes‑based clusters and integrate with Core Weave object storage, and will solve for keeping utilization of GPUs high.

• 8+ years of experience in software engineering
• Strong fundamentals that are language agnostic
• Expertise in computer systems, including parallel computing (threading, multiprocessing), concurrency (asynchronous programming), networking/inter‑process communication
• Experience with containerization, container orchestration (kubernetes), scheduling, networked file systems, resource allocation, distributed systems, and cloud infrastructure
• Experience building highly available, fault‑tolerant systems
• Strong communication skills, written and verbal

• Proficiency with Python and Python packaging
• Basic experience with or awareness of the Python stack for AI/ML
• Empathy for practitioners and researchers in AI, ML, data engineering, NLP, or other quantitative work
• Experience with GPU resource allocation and sharing

• You love to empower developers by building performant and scalable tools
• You’re curious about how developers in AI, ML, and data experiment with models and code
• You’re an expert in building highly scalable cloud infrastructure

The base salary range for this role is $206,000 to $303,000. The starting salary will be determined based on job‑related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

• Medical, dental, and vision insurance – 100% paid for by Core Weave
• Compan…