Lead Data Engineer

Lead Data Engineer (Azure | Databricks | Fabric | PySpark | SQL)

Permanent | Hybrid | UK Public Sector Project

We are seeking a hands‑on Lead Data Engineer to join a growing Data & Analytics practice. This role focuses on designing, building, optimising, and maintaining enterprise‑level data solutions.

You will work across the full data lifecycle, delivering scalable, high‑performance solutions using Azure and tools such as Databricks and Fabric.

A strong Data Engineer with deep technical expertise in Azure, Databricks and Fabric, who enjoys working in a collaborative, client‑facing environment and thrives at designing and delivering enterprise‑level data solutions, spanning initial requirements gathering, proof‑of‑concept development, architecture planning, deployment and delivery.

• Develop solutions using Azure Databricks and/or Fabric
• Implement Medallion Architecture (Bronze, Silver, Gold)
• Develop data warehouse and lakehouse solutions
• Support BI, analytics, and AI workloads
• Optimise performance, cost, and reliability
• Collaborate with technical and functional stakeholders

• Proven ability to make both high‑level strategic and day‑to‑day operational decisions with confidence
• Strong leadership and interpersonal skills, with a track record of motivating and influencing stakeholders at all levels
• Sharp analytical mindset with the ability to proactively spot emerging opportunities and resolve challenges before they escape
• Strong hands‑on experience with Azure Databricks and Fabric
• Strong SQL and data warehousing expertise
• Experience with data modelling
• Experience with Databricks AI/BI or Power BI
• Experience with CI/CD and Dev Ops practices

• Experience in consulting / professional services
• Exposure to AI and advanced analytics solutions
• Exposure to Agentic AI systems built on top of Large Language Models
• Experience with real‑time / streaming data
• Experience with Infrastructure as Code (Terraform or Bicep)
• Experience in regulated industries
• Passionate about staying at the forefront of industry developments, with a habit of actively monitoring emerging trends, tools, and technologies
• Databricks/Microsoft Azure certifications

• Strong problem‑solving skills
• Collaborative and team‑oriented mindset
• Clear communication and documentation skills
• Ability to work in fast‑paced delivery environments

• Role Type:
  Permanent & Hybrid (2 days per week)
• Location:
  
  Guildford
• Clearance:
  Candidates must be eligible for UK Security Clearance (SC) or active SC