Senior Data Engineer – Databricks & DLT

Job in City Of London, Central London, Greater London, England, UK

Listing for: Advantage Resourcing UK Ltd

Full Time position
Listed on 2026-09-06

Job specializations:

Software Development
Data Engineering, SQL Developer, Python

Salary/Wage Range or Industry Benchmark: 90000 - 130000 GBP Yearly GBP 90000.00 130000.00 YEAR

Location: City Of London

Senior Data Engineer – Databricks & DLT (Delta Live Tables)

Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineer with strong analytical capabilities and hands‑on experience in building scalable data solutions using a programming language like Python or Scala as well as experience in Databricks and Delta Live Tables - This experience is essential.

Suitable candidates will have expertise in Databricks,streaming architectures, data ingestion frameworks, anddashboarding, along with experience working withSAP data sources.

You will be responsible for designing and implementing scalable data pipelines and enabling real‑time and batch analytics across the organization.

Your Responsibilities:

Design and implement scalable data pipelines using

Databricks and Delta Live Tables (DLT).
Develop and managestreaming data solutions for real‑time analytics and decision‑making.
Ingest data from various sources—includingSAP systems using Qlik ReplicateandADFto ingest data from various sources ensuring data quality and consistency.
Perform data modelling and optimize data structures for analytics and reporting.
Collaborate with cross‑functional teams to understand data requirements and deliver robust solutions.
Monitor, troubleshoot, and enhance data workflows for performance and reliability.
Maintain technical documentation and contribute to data engineering best practices.

Required Skills &

Qualifications:

Strong experience with Databricks- DLT, Delta Lake concepts, UC governance.
Solid understanding of streaming technologies(e.g., Spark Structured Streaming, Autoloader).
Programming skills in Python,SQL, or
Proficiency indata modelling, ETL/ELT processes, and data architecture.
Experience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agent bricks, Genie)
Strong analytical background with problem‑solving skills.
Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing.
Hands‑on expertise inADF, and Qlik Replicatefor data ingestion and replication.
Experience working in Azure cloud environments.
Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.

#J-18808-Ljbffr