Senior Azure Databricks Job London England UK,IT/Tech

We are seeking a highly experienced Senior Azure Databricks to design build and optimise scalable enterprise data platforms within a modern Azure ecosystem The successful candidate will be responsible for developing end to end data pipelines implementing robust data models and ensuring the delivery of high-quality governed data products across the organisation

The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

Your Role:

Design develop and maintain end-to-end data pipelines across Raw Curated and Data Product layers
Build and optimise data ingestion transformation and processing frameworks using Azure services
Develop scalable ETLELT solutions leveraging Azure Databricks Azure Data Factory SQL Python and Py Spark
Implement enterprise data models supporting analytics reporting and operational use cases
Ensure data quality through validation controls reconciliation processes and referential integrity checks
Design and implement workflow orchestration monitoring alerting and SLA management processes
Drive performance optimisation and tuning across data pipelines processing jobs and storage layers
Contribute to CICD implementation and Dev Ops best practices for data engineering solutions
Support data governance initiatives including metadata management data cataloguing lineage and access control frameworks
Ensure compliance with security privacy retention and regulatory requirements

Your

Skills:

Strong handson experience with Azure Databricks and Azure Data Factory
Proven expertise in SQL Python and PySpark development
Extensive experience in designing and implementing enterprise grade data pipelines
Strong understanding of 3NF and dimensional data modelling principles
Experience designing and implementing Fact Dimension and Bridge tables
Knowledge of unit testing integration testing and automated testing frameworks
Experience with CICD pipelines and Dev Ops practices
Strong understanding of data governance data quality security and compliance requirements
Ability to work effectively within cross functional delivery teams and stakeholder environments

We are a Disability Confident

Employer:

Capgemini is proud to be a Disability Confident Employer (Level
2) under the UK Government’s Disability Confident scheme.

As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

Declare they have a disability, and
Meet the minimum essential criteria for the role.
Please opt in during the application process.

Make It Real (what does it mean for you):

You’d be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions.
To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.
You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from think tanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard Manage Mentor, Cybersecurity qualifications and much more.
You will be joining one of the World’s Most Ethical Companies, as recognised by Ethisphere for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping…