Databricks Data Engineer

Databricks Data Engineer - Leeds - Up to £70,000

Location: Leeds (Hybrid - 2 days per week onsite)Job Type: Permanent

About the Company

Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high-performing team.

You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. You'll work closely with architects, analysts, and platform teams to deliver scalable, high-quality data solutions.

Key Responsibilities:

• Develop, optimise, and maintain ETL/ELT pipelines within Databricks
• Build reliable data ingestion frameworks using PySpark and Spark SQL
• Design well-structured data models across medallion/lakehouse architecture
• Work with Dev Ops teams to automate deployments using CI/CD
• Collaborate with stakeholders to understand analytical needs
• Ensure compliance with best practices around data governance, security, and quality

Requirements:

• Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables)
• Proficiency in PySpark and Python
• Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services
• Understanding of Delta Lake, streaming pipelines, and lakehouse architecture
• Solid knowledge of data engineering principles (ETL/ELT, modelling, optimisation)

Benefits:

• Salary up to £70,000
• Annual bonus
• Structured career development and funded certifications
• Opportunity to work on high-impact, enterprise-scale data transformation programmes