Senior Data Engineer - Databricks

Senior Data Engineer - Databricks - London (Hybrid) - Up to £80,000 We're partnering with a fast-growing analytics and data business operating across the entertainment sector. As demand for real-time insight and advanced analytics continues to scale, the company is investing heavily in a modern, cloud-native data platform, with Databricks at its core. This role is ideal for a Senior Data Engineer who wants true end-to-end ownership: designing, building, deploying and operating production-grade data systems, while shaping engineering standards and CI/CD practices across the platform.

The Role You'll play a key role in building and evolving a high-performance Databricks lakehouse platform, taking ownership from ingestion through to production deployment.

Key responsibilities include:

Design, build and operate end-to-end data pipelines using Databricks Own and evolve Databricks architecture across batch, streaming and event-driven workloads Implement and mature CI/CD pipelines for data engineering (testing, deployment, versioning) Develop reusable, production-ready data frameworks and patterns Drive engineering best practice across performance, security, reliability and cost optimisation Lead technical design decisions and influence long-term data platform strategy Mentor other engineers and raise overall data engineering standards This is a hands-on role with genuine architectural influence, not a people-management-only position.

Key Experience & Capabilities We're specifically looking for strength in modern data engineering, not just analytics or reporting. Core requirements:
Strong experience delivering end-to-end data engineering solutions in production Deep hands-on expertise with Databricks (jobs, notebooks, workflows, Delta Lake) Experience designing and operating CI/CD pipelines for data platforms Strong Python & SQL skills for scalable data processing Solid understanding of lakehouse architecture and the Medallion (Bronze/Silver/Gold) pattern Strong data modelling experience (star/snowflake schemas, SCD Types 1-3)

Experience with streaming and event-driven architectures Performance tuning and cost optimisation in cloud data platforms

Experience with data quality, observability and data contracts Nice to have (but not essential): dbt, Snowflake or similar analytics engineering tooling Experience supporting ML or advanced analytics workloads Exposure to data mesh or domain-oriented data platforms What's on Offer Up to £80,000 salary Join a scaling, well-funded business with serious technical ambition Work on a modern Databricks-centric data platform High impact role with ownership of architecture, CI/CD and engineering standards Clear opportunity to influence how data engineering is done across the organisation Interested If you're a Senior Data Engineer who wants real ownership of Databricks, end-to-end pipelines and shape a modern data platform from the ground up.

Apply Now!