Databricks Platform Engineer

Databricks Platform

Location:

UKRole Type:
Permanent - Full Time

Job Location:

Hybrid Working - minimum of 2 days a week in our London office

Sagacity are the data intelligencepeople. Our proposition isbusinesses increase customer engagement and make moreinto the data businesses already have, and combine it with our data,insight, and action. Think of us asdata co-pilots for sales, marketing,ops, billing, credit and debt - clients typically see 5x returns within thefirst few months.

Founded in 2005, we are acustomer-centric business witha World Class +95 Net Promoter Score. We believe data should beat the heart of every company and while we are sector agnostic,primarily our clients are in thetelecoms & media, water, andnot for profit sectors.

We are a purpose led company and we believe that purposecomes before profit. We workas one team both with clients and internally, and are trusted todeliver quality in our standard sand in achieving successful client outcomes. We are open, honestand communicate in a jargonfree, collaborative way, with all ourteams being agile and curious, and continuously learning to achieve our purpose. We believe that ifwe achieve our purpose theneverything else will follow.

Clever with data... combining data,insight, and action to drive value

Principal responsibilities will involve:
Provision, configure and operate Databricks work spaces, clusters,

SQL warehouses and pools across our cloud environment Implement and maintain Unity Catalog: catalogs, schemas,

external locations, row/column-level security, lineage and audit

Build reusable Terraform modules for Databricks and automate

platform changes through CI/CD pipelines

Tune Spark, Delta and Photon workloads to improve performance

and reduce DBU and cloud spend

Manage identity, SSO/SCIM, service principals, secret scopes and

network isolation to meet security and compliance needs

Operate Databricks Workflows, Delta Live Tables and

orchestration integrations used by Data Scientists and Data

Support MLflow, model serving and feature store usage for predictive modelling and GenAI work

Monitor jobs, clusters and warehouses; lead incident response and post-incident reviews

QA own work and that of others

A secure, reliable, well-governed Databricks platform that our analytics teams can rely on day to day

Reduced DBU and cloud spend through clear cluster policies,tuning and Fin Ops reporting, without slowing teams down

Faster, smoother delivery of client analytics and modelling work,with fewer platform-related blockers

Continued improvement of Sagacity’s Product Suite through arobust, scalable data and ML platform

Ability to take accountability and ownership for client and internal

Work as part of the Data & Analytics team, providing knowledge transfer, peer reviews and mentoring to drive continuous learning

You will design, build, and operate the Databricks Lakehouse platform that powers Sagacity’s client analytics, predictive modelling, and AI work. Working closely with our Data Scientists, Data Engineers, and Data & Analytics Manager, you will own platform reliability, governance, performance, and cost, enabling teams to deliver clear, insightful analytics to clients across financial services, retail, energy, telecoms & media, water, and the not for profit sector.

3+ years experience as a Data Platform Engineer, Cloud Engineeror Data Engineer, with hands-on Databricks production experience

Strong knowledge of the Databricks Lakehouse, Delta Lake, Apache Spark and Unity Catalog

Production experience administering Databricks on at least onemajor cloud (AWS, Azure or GCP), including networking, IAM and storage

Proficiency with Terraform (ideally the Databricks provider) and Gitbased…