Azure Databricks Engineer

Location: Greater London

Internal Role Information Grade – C1

Location
-Anywhere in the UKAbout the job you're considering

We work closely with clients and partners to take full advantage of the opportunities of technology. We mobilize expert teams that create custom solutions from existing and emerging technology to deliver viable outcomes  call this 'Value in the making.'Part of the Capgemini Group, Sogeti makes business value through technology for organizations that need to implement innovation at speed and want a local partner with global scale.

With a hands-on culture and close proximity to its clients, Sogeti is currently looking for a Azure Databricks Engineer to join our ACT Practice, ensuring alignment with business goals and driving impactful value creation for our clients.

Hybrid working:
The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

If you are successfully offered this position, you will go through a series of pre-employment checks, including identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)
Mandatory Skills Azure Databricks Platform Engineering Hands-on implementation and troubleshooting of Azure Databricks Databricks Serverless configuration and workload optimisation

Databricks SQL and Delta Lake development

Cluster management, compute policies, autoscaling, and workload monitoring

Data Engineering Strong Python, PySpark, and SQL development skills

Design and build ingestion and transformation pipelines

Full and incremental data loading CDC (Change Data Capture) implementation

Data quality controls, schema evolution, reconciliation, and error handling

Integration Development REST API integration experience

Integration with databases, SaaS applications, cloud storage, and enterprise systems

Secure authentication and credential management

Azure Platform Services Azure Identity and Access Management Azure Networking and Private Endpoints Azure Security and Key Vault Azure Monitoring and Operational Support Fin Ops  & Cost Optimisation Resource tagging implementation

Cost monitoring and reporting

Budget controls and usage optimisation

Essential Skills Platform Operations Experience supporting production Azure Databricks environments

Monitoring, incident management, troubleshooting, and performance tuning

Operational governance and platform standards implementation

Discovery Zone & Migration Support Experience enabling application deployment within Databricks BI tooling integration and scheduling

Support for POSIT/RStudio migration activities

Collaboration

Working with Data Engineers, Data Scientists, and Platform Teams Technical documentation and knowledge transfer

Agile delivery experience

Desirable Skills POSIT/RStudio migration experience AI/ML and LLM integration RAG and Vector Database exposure

Regulated industry experience

We are a Disability Confident

Employer:

Capgemini is proud to be a Disability Confident Employer (Level
2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:
• Declare they have a disability, and
• Meet the minimum essential criteria for the role.

Please opt in during the application process.

What does 'Get The Future You Want' mean for you?

You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from think tanks to hackathons, and access to…