Azure Databricks Technical Lead

We work closely with clients and partners to take full advantage of the opportunities of technology. We mobilize expert teams that create custom solutions from existing and emerging technology to deliver viable outcomes  call this 'Value in the making.'

Grade – C1

Location
-Anywhere in the UK

We work closely with clients and partners to take full advantage of the opportunities of technology. We mobilize expert teams that create custom solutions from existing and emerging technology to deliver viable outcomes  call this 'Value in the making.'

Part of the Capgemini Group, Sogeti makes business value through technology for organizations that need to implement innovation at speed and want a local partner with global scale. With a hands‑on culture and close proximity to its clients, Sogeti is currently looking for a Azure Databricks Engineer to join our ACT Practice, ensuring alignment with business goals and driving impactful value creation for our clients.

Hybrid working:
The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

If you are successfully offered this position, you will go through a series of pre-employment checks, including identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)

• Hands‑on implementation and troubleshooting of Azure Databricks
• Databricks Serverless configuration and workload optimisation
• Databricks SQL and Delta Lake development
• Cluster management, compute policies, autoscaling, and workload monitoring

• Strong Python, PySpark, and SQL development skills
• Design and build ingestion and transformation pipelines
• Full and incremental data loading
• CDC (Change Data Capture) implementation
• Data quality controls, schema evolution, reconciliation, and error handling

• REST API integration experience
• Integration with databases, SaaS applications, cloud storage, and enterprise systems
• Secure authentication and credential management

• Azure Identity and Access Management
• Azure Networking and Private Endpoints
• Azure Security and Key Vault
• Azure Monitoring and Operational Support

• Resource tagging implementation
• Cost monitoring and reporting
• Budget controls and usage optimisation

• Experience supporting production Azure Databricks environments
• Monitoring, incident management, troubleshooting, and performance tuning
• Operational governance and platform standards implementation

• Experience enabling application deployment within Databricks
• BI tooling integration and scheduling
• Support for POSIT/RStudio migration activities

• Working with Data Engineers, Data Scientists, and Platform Teams
• Technical documentation and knowledge transfer
• Agile delivery experience

• POSIT/RStudio migration experience
• AI/ML and LLM integration
• RAG and Vector Database exposure
• Regulated industry experience

Capgemini is proud to be a Disability Confident Employer (Level
2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

• Declare they have a disability, and
• Meet the minimum essential criteria for the role.

Please opt in during the application process.