Databricks Data Engineer

Databricks Data Engineer - Leeds - Up to £70,000

Location:

Leeds (Hybrid - 2 days per week onsite)
Job Type: Permanent

About the Company

Our client is a rapidly growing data‑driven consultancy helping enterprise‑scale organisations modernise their data estates. With several major new projects kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high‑performing team.

You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. You'll work closely with architects, analysts, and platform teams to deliver scalable, high‑quality data solutions.

Key Responsibilities:

Develop, optimise, and maintain ETL/ELT pipelines within Databricks
Build reliable data ingestion frameworks using PySpark and Spark SQL
Design well-structured data models across medallion/lakehouse architecture
Work with Dev Ops teams to automate deployments using CI/CD
Collaborate with stakeholders to understand analytical needs
Ensure compliance with best practices around data governance, security, and quality

Requirements:

Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables)
Proficiency in PySpark and Python
Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services
Understanding of Delta Lake, streaming pipelines, and lakehouse architecture
Solid knowledge of data engineering principles (ETL/ELT, modelling, optimisation)
Benefits:

Salary up to £70,000
Annual bonus
Structured career development and funded certifications
Opportunity to work on high-impact, enterprise-scale data transformation programmes