Senior Data Engineer

Please note that this is a contract role providing services to Microsoft through external staffing partners of Allegis Global Solutions (AGS). If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft.

Lead technical delivery across data platform modernization, with ownership of migration strategy execution, orchestration redesign direction, and cost optimization outcomes across Azure Databricks and ADF workloads.

• Own technical design and phased execution plan for Unity Catalog migration across priority data domains.
• Define target orchestration patterns and guide migration of legacy workflows to the agreed model.
• Drive cost and performance optimization across Spark jobs, clusters, storage, and scheduling patterns.
• Set engineering standards for data quality, observability, CI/CD, testing, and production readiness.
• Review architecture and critical pull requests; mentor less experienced engineers.
• Partner with analytics, product, and platform teams to sequence delivery with minimal operational risk.

• Strong production experience in SQL, Python, and Spark.
• Deep hands‑on Azure Databricks and Azure Data Factory delivery experience.
• Proven track record delivering migration or modernization initiatives in live data platforms.
• Strong experience with platform observability, incident response, and data reliability engineering.
• Experience delivering measurable cost optimization in cloud data platforms.
• Strong Git and code review practices; excellent cross‑team communication.

• 8+ years of experience working as a Data Engineer.
• Unity Catalog migration experience.
• Game telemetry or high‑volume event data background.
• Familiarity with Power BI or Tableau consumption patterns.

• Location:
  
  Athelstone, England
• Duration: 12 months
• Shift Timings:
  Hybrid (Hours minimum 10‑4pm; 3 days / week onsite)
• Weekly
  
  Schedule:
  
  40 hours

280 – 307 GBP daily (PAYE)