Data engineer databricks

Location: Hybrid – 2 days per week in London, 3 days remote

Requirements :
Have the right to work in the uk.

Rate: £530 per day

IR35: Outside IR35

Duration: Until Christmas 2026

Commitment: 5 days per week

Location: Hybrid – 2 days per week in London, 3 days remote

Requirements :
Have the right to work in the uk.

The core challenge is to extract data from Azure Dev Ops, transform it in Databricks and create reliable, reusable datasets that can power a comprehensive metrics dashboard across a large number of technology teams.

You will be working for Add Agility a consultancy that solves problems for clients and working with one or more of our clients based in central London

This is primarily a Databricks and data engineering role . With some The wider environment also includes Palantir Foundry data visualisation. , but deep Palantir expertise is not required. Other members of the team can support with Palantir-specific elements.

• Extracting data from Azure Dev Ops
• Working with Azure Dev Ops APIs and/or Analytics data
• Building robust ingestion pipelines into Databricks
• Understanding and transforming Azure Dev Ops work-item and historical data
• Creating clean, reusable datasets for reporting and analytics
• Building calculations for engineering and delivery metrics.
• Creating reliable data models and tables that can be consumed by the dashboard layer
• Improving data quality, validation and monitoring
• Working alongside product, engineering and client stakeholders to turn metric definitions into working data products
• Creating components and approaches that can be reused across future implementations

This is a hands-on engineering role . We need someone who can understand the underlying Azure Dev Ops data, build the pipelines and transformations, and turn it into a robust data layer from which meaningful engineering metrics can be calculated.

The initial engagement runs five days per week until Christmas 2026 , with two days per week working with the team in London and three days remote.

£530/day – Outside IR35.