SC Cleared Data Engineer

Salary: £70,000 - 85,000 per year

• Current active SC Clearance is mandatory; candidates who are only eligible for SC Clearance cannot be considered.
• Strong commercial experience with Azure Databricks, Azure Data Factory, and Azure data engineering.
• Advanced Python skills, including Pandas, and strong SQL expertise.
• Hands‑on experience with Unity Catalog.
• Experience designing data warehouses, including slowly changing dimensions (SCD) and dimensional modelling.
• Knowledge of CDC, data ingestion patterns, and governed data platforms.
• Understanding of data governance, security, and lineage.
• Experience with in regulated or public sector environments is advantageous.
• Familiarity with Power BI is beneficial but not essential.

• Design, build, and optimise Azure data pipelines using Azure Data Factory and Azure Databricks.
• Develop data ingestion solutions using Change Data Capture and Managed File Transfer.
• Build canonical data models, conformed dimensions, and fact tables.
• Deliver curated Gold-layer datasets for reporting, analytics, and AI use cases.
• Automate data validation and quality assurance processes, replacing manual checks.
• Configure Unity Catalog, clusters, pipelines, and data contracts.
• Contribute to data governance, security, lineage, and platform design.
• Collaborate on solution design, code reviews, testing, and defect resolution.

• AI
• Azure
• Cloud
• Databricks
• Support
• Power BI
• Python
• SQL
• Security
• Unity
• pandas
• Game Dev

We are offering a 3‑month outside IR35 contract with a strong chance of extension based in Leeds, requiring onsite attendance once per week. This is an exciting opportunity for an experienced Data Engineer to support a greenfield Azure cloud data platform as part of a major transformation programme. You will help build a modern platform that integrates complex data from multiple systems, improves data quality, automation, and reporting, and creates a single trusted view of customer information.

last updated 29 week of 2026