Databricks Engineer - SC Cleared

We are looking for a Senior Databricks Engineer with SC Clearance
.

• Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
• Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
• Drive best practices for data engineering.
• Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
• Mentor junior engineers and support their personal development.
• Take ownership for the delivery of core solution components.
• Support with planning, requirements refinements, and work estimation.

• Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
• Hands‑on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
• Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
• Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real‑time data processing.
• Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
• Good experience with CI/CD practices and tools for data platforms using Azure Dev Ops.
• Good knowledge on how to leverage AI to increase deployment productivity and quality.
• Excellent communication skills.
• Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus.

• Rate offered: £500‑550 per day
• IR35 Status:
  Outside
• Location:
  
  Hybrid with travel to client site in the North East
• Start date:
  
  January
• Duration: 3 months initial sign‑up with significant opportunity for extension
• Required:
  
  Active SC Clearance

Mid‑Senior level

Full‑time

Engineering and Information Technology

Referrals increase your chances of interviewing at Share Force by 2x