Senior Engineer - Data Platforms

Join to apply for the Senior Engineer - Data Platforms role at Core Weave

Join to apply for the Senior Engineer - Data Platforms role at Core Weave

Get AI-powered advice on this job and more exclusive features.

Core Weave is the AI Hyperscaler, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, Core Weave has operated a growing footprint of data centers covering every region of the US and across Europe. Core Weave was ranked as one of the TIME
100 most influential companies of 2024.

As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you’re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, Core Weave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry.

Core Weave powers the creation and delivery of the intelligence that drives innovation.

About

The Role

The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for Core Weave. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.

We Are Seeking a Senior Engineer With Specialization In Data Platforms And Stream Processing Who Can Help Us Fulfill The Goal Of Our Multi-regional Datastore Strategy And Establish Communication Models For Our Data Flow. This Individual Will Work With a Team Of 6-8 Mixed Skill Engineers And Have The Opportunity To Work On The Full Gamut Of Rewarding Challenges That Come With The Business Of Building a Cloud In a Communicative, Supportive, And High-performing Environment.

As a Member Of The Data Platforms Team You Will Have The Opportunity To

• Identify and develop applications for the organization's data. This involves understanding business needs and creating solutions that leverage data effectively.
• Design and implement the platform to deliver data to teams with a focus on providing managed solutions.
• Participate in operations and scaling of relational data platforms.
• Develop a stream processing architecture and solve for scalability and reliability.
• Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
• Establish guidelines, guard rails for data access and storage for stakeholder teams.
• Ensure compliance with standards for data protection regulation.
• Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.

• You have six or more years of experience in a software or infrastructure engineering industry.
• You enjoy helping your colleagues achieve more with less effort.
• You have experience operating services in production and at scale and are versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
• You understand data consistency and concurrency models, can clearly define data models and establish guidelines around data management.
• You’re excited about new research in data structures.
• You’re familiar with distributed NewSQL data stores such as Cockroach
  
  DB, TiDB, YDB, Yugabyte and/or stream processing tools such as NATS or Kafka.
• You have experience with designing and operating these systems at scale.
• You’re familiar with Kubernetes and have interest or experience with using it for event-driven and/or stateful orchestration.
• You’re…