Data Engineer; SQL and PySpark

Position: Data Engineer (SQL and PySpark)
Data Engineer

Location:

Dunstable (near Luton) - Hybrid (up to 2 days onsite) Rate: £549 per day (Inside IR35 / Umbrella)

Contract:

Initial term until end of August

Overview

Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.

Key Responsibilities

Design and develop end-to-end data pipelines using reusable frameworks
Build scalable data solutions using Python, SQL, and Py Spark
Create modular frameworks separating configuration from orchestration
Implement robust automated testing (unit, integration, regression)
Establish and enforce data quality controls (schema, nulls, row counts, integrity checks)
Contribute to CI/CD pipelines and Git-based workflows
Troubleshoot and optimise data pipelines for reliability and performance

Required Experience

Strong Data Engineering background
Advanced Python and SQL skills

Experience with PySpark or distributed processing tools
Proven track record building reusable data frameworks
Strong testing experience (pytest, mock data, data validation techniques)
Solid understanding of data quality, integrity, and pipeline behaviour

Experience with CI/CD, Git, and code review processes

Desirable

Experience in enterprise or cloud-based data environments
Exposure to dbt, Great Expectations, or similar tools
Experience in retail, hospitality, or customer-focused industries