Databricks Engineer - PD - Remote

Position: Databricks Engineer - £400PD - Remote
Databricks Engineer - £400PD - Remote

About the Role

We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business.

Key Responsibilities

Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

Build and optimise data lakehouse architectures on Azure Data Lake Storage (ADLS).

Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows

Implement best practices for data governance, security, and quality across all pipelines.

Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.

Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation.

Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, Git Hub Actions, or Azure Dev Ops

Required Skills & Experience

3+ years' experience as a Data Engineer working in Azure environments.

Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling).

Solid knowledge of Azure cloud services including:

Azure Data Lake Storage

Azure Data Factory

Azure Synapse / SQL Pools

Azure Key Vault

Strong programming skills in Python and SQL.

Experience building scalable, production-grade data pipelines.

Understanding of data modelling, data warehousing concepts, and distributed computing.

Familiarity with CI/CD, version control, and Dev Ops practices.

Nice-to-Have

Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka).

Knowledge of MLflow, Unity Catalog, or advanced Databricks features.

Exposure to Terraform or other IaC tools.

Experience working in Agile/Scrum environments.

To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment