Data Engineer

Providing services to Microsoft via Allegis Global Solutions (AGS) as a contract role. If selected, you will be employed by AGS, not Microsoft.

This role is for a hands‑on Data Engineer focused on building and improving data pipelines using SQL, Python, Spark, and Azure tools such as Databricks and Azure Data Factory. The individual will work under senior guidance to deliver reliable, high‑quality ETL/ELT pipelines and support ongoing modernization efforts. Responsibilities include pipeline optimisation, data quality checks, and production issue troubleshooting, as well as contributing to workflow improvements, implementing governance changes such as Unity Catalog, and maintaining clear technical documentation.

Strong coding skills, problem‑solving ability, and experience in agile, production environments are required.

• Build and maintain data pipelines (ETL/ELT) using SQL, Python, and Spark
• Work on Databricks and Azure Data Factory (ADF) pipelines
• Support Unity Catalog migration tasks
• Add data quality checks and monitoring alerts
• Troubleshoot pipeline failures and production issues
• Follow existing workflow/orchestration standards
• Write documentation, runbooks, and operational notes

• Working experience with Apache Spark
• Experience building and maintaining data pipelines
• Experience with Git (code reviews, pull requests, collaboration)
• Ability to debug pipeline failures and data issues
• Experience working in Agile delivery teams

• Exposure to Unity Catalog or other data governance frameworks
• Experience with Azure Dev Ops
• Exposure to event‑driven or telemetry data systems

Location:

Atherstone, England

Duration: 12 months

Pay Range: £180/day to £195/day (PAYE)

Weekly

Schedule:

40 hours