Data Engineer

Fully home-based / Remote UK wide, with optional occasional team and client meetings.

I’m recruiting a hands-on Data Engineer to build Azure data platforms and integrations for clients globally. You’ll turn messy data from APIs, Excel files and PDFs into reliable datasets that power dashboards, client portals and data-sharing products.

• Build Python and PySpark ingestion pipelines with record-level lineage, automated tests and reconciliation checks.
• Model data in a Databricks medallion lakehouse and design loads that can be safely rerun.
• Deploy and extend Azure environments in client tenancies using Terraform and CI/CD.
• Serve data to dashboards and portals backed by Azure SQL, and work directly with clients to define requirements and metrics.

• Strong Python and SQL, with hands-on experience using pandas, PySpark and pytest.
• Production Azure Databricks experience with Delta Lake, Unity Catalog and Workflows.
• Experience with Azure Storage, Key Vault, managed identities and private networking.
• Practical experience with Terraform, Git and CI/CD using Azure Dev Ops or Git Hub Actions, plus REST API ingestion and relational data modelling.

Experience in energy would be a bonus. Applications from other sectors are welcome.