Engineering Manager - Streaming

Overview

At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems. We are the Apache “Spark™ Structured Streaming” team responsible for building Stream Processing capabilities into Apache Spark™ and the Databricks Intelligence Platform. Stream processing is in its infancy and we are here to build not just state‑of‑the‑art Stream Processing technology but a best‑in‑class managed offering for customers to run their Stream Processing workloads.

• Leading a talented engineering team in the Apache Spark Structured Streaming team developing and promoting the engine in OSS and the Databricks data intelligence platform.
• Overseeing sustained recruitment of top‑tier talent and upskilling talent on the team.
• Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities.
• Building software that is not just high quality but easy to operate.
• Making company‑wide impact by driving Stream Processing adoption across the Databricks product portfolio.
• Managing technical debt, including long‑term technical architecture decisions and balancing product roadmap.

• 5+ years experience working in a related system, including big‑data ecosystem, Apache Spark or database internals.
• A passion for database systems, storage systems, distributed systems, language design, or performance optimization.
• Ability to ensure the team builds high‑quality and reliable infrastructure services. Experience responsible for testing, quality, and SLAs of a product. Previous experience building and leading teams in a complex technical domain, such as distributed data systems or database internals.
• Ability to attract, hire, and coach engineers who meet Databricks hiring standards. Can up‑level existing team via hiring top‑notch senior talent, growing leaders and helping struggling members. Can gain trust of the team and guide their careers. Experience managing distributed teams preferred.
• Comfortable working cross‑functionally with product management and directly with customers; ability to deeply understand product and customer personas.

Local Pay Range: $181,000 – $241,000 USD.

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all employees. For specific details on the benefits offered in your region, please visit

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio‑economic status, veteran status, and other protected characteristics.