Data Platform Engineer

Core Weave, the AI Hyperscaler™, acquired Weights & Biases to create the most powerful end‑to‑end platform to develop, deploy, and iterate AI faster. Since 2017 Core Weave has operated a growing footprint of data centers covering every region of the US and across Europe, and was ranked as one of the TIME
100 most influential companies of 2024. By bringing together Core Weave’s industry‑leading cloud infrastructure with the best‑in‑class tools that AI practitioners know and love from Weights & Biases, we’re setting a new standard for how AI is built, trained, and scaled. From experiment tracking and model optimization to high‑performance training clusters, agent building, and inference at scale, we are serving the full AI lifecycle—all in one seamless platform.

Weights & Biases has long been trusted by over 1,500 organizations—including AstraZeneca, Canva, Cohere, OpenAI, Meta, Snowflake, Square, Toyota, and Wayve—to build better models, AI agents, and applications. Now, as part of Core Weave, that impact is amplified across a broader ecosystem of AI innovators, researchers, and enterprises.

• Help business partners set goals, make decisions, and understand the levers to achieve their goals.
• Build reporting to keep the business attuned and aligned.
• Build datasets and pipelines to support self‑service analysis.
• Train models to understand our customer growth, churn risk, and detect spam and abuse.
• Explore novel benchmarks and recommendations for model training.
• Build and maintain a massive data platform to power it all.

• Build and operate the core data platform that powers reporting, self‑serve analytics, and data‑driven product decisions.
• Lead end‑to‑end platform initiatives—from design to rollout to operational ownership—balancing performance, cost, reliability, and developer experience.
• Partner closely with Data Scientists/Analysts and product engineering teams to improve telemetry quality and unlock new use cases on operational data.
• Design and scale ingestion and transformation systems that keep pace with rapid product growth and an increasingly distributed operational footprint.
• Build the platform with operability in mind: observability, on‑call readiness, incident response, and well‑documented runbooks.
• Participate in the data platform on‑call rotation after an onboarding period.
• Strategic goals for the team over the next 12 months:
  • Evolve our analytics architecture to effectively support multi‑petabyte scale by shifting high‑volume workloads to more scalable, cost‑effective compute and storage patterns, while maintaining (or improving) query performance and reliability.
  • Unify and standardize ingestion across a growing number of operational databases and deployment environments, enabling consistent governance, and observability as we scale from centralized infrastructure toward customer‑dedicated environments.
  • Lay foundations for internal applications (including ML/AI use cases) built on top of trustworthy, governed operational data.

• Deep knowledge (practical and theoretical) of data engineering and the accompanying workflows.
• History of writing easy‑to‑follow code and effective documentation for your projects.
• Expert knowledge of data orchestration/data pipeline tools (dbt, dagster, airflow, etc).
• Experience working with large & high demand data warehouses/platforms. Multi‑PB scale, with extreme business demand of the systems.
• Experience evolving architectures as scale changes (e.g., warehouse‑only → hybrid / lakehouse‑style patterns; storage/compute separation; open table formats).
• Expert knowledge and understanding of web apps and best practices for logging and event instrumentation.
• Ability to clearly communicate your ideas to folks across a range of backgrounds and levels of technical knowledge.

• Autonomous:
  If you work well in a self‑directed environment, and proactively find ways to improve processes and collaborate with team members or engaged users, your initiative will really shine in this role.
• Outgoing and friendly:
  You'll love this role if you enjoy connecting with real users day to day, helping them solve issues and understand good patterns for using our…