Senior Data Engineer - Microsoft Fabric & Azure

Wigan / London

Location: Hybrid

Reports to: Chief Architect - Data and Insights

ABOUT US

Agilisys is at the forefront of digital transformation and innovation in the public services sector. Withover two decadesof experience,we haveestablishedourselves as a trusted partner for governments, local authorities, and organizations nationwide. Our mission is to empower our clients to deliver exceptional public services by harnessing the full potential of technology and data.

OURVALUES

Partnership: we become one team and family with organisations, helping them to navigate change and stayagile.

Integrity: our people really care, going beyond the brief to make change happen for organisations and citizens.

Innovation: we bring together the right technologies and services to design solutions that work.

Passion: we are passionate about - and dedicated to - public services and improving people’s lives.

THE ROLE

The Senior Data Engineer – Microsoft Fabric & Azure is a senior, hands-on role within Agilisys’ Data & AI Practice. You will take engineering ownership of modern data-platform work streams from approved design through build, testing, production deployment and handover, with Microsoft Fabric and the Azure Data Platform at the core.

Working closely with architects, analysts, delivery teams and client stakeholders, you will help turn architecture into secure, scalable and supportable solutions. You will also contribute to engineering standards, mentor other engineers and help clients move from proof-of-value or legacy data platforms to production-grade services.

KEY RESPONSIBILITIES

• Deliver Fabric and Azure data platforms end to end: Build and product ionise Microsoft Fabric solutions using One Lake, Lake houses, Warehouses, Data Pipelines, Notebooks, Dataflows and Azure Data Factory, including integration with legacy, cloud and on-premises data sources.
• Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency, retry/replay, backfill and source-to-target reconciliation.
• Own Dev/Test/Production delivery and CI/CD: Configure Fabric workspace structures and environment-specific settings, and implement controlled promotion using Git, Azure Dev Ops/Git Hub, Fabric Deployment Pipelines, APIs or controlled manual steps where Fabric item limitations require them. Apply branch protection, peer review, testing, approvals, rollback and release evidence.
• Build for security, governance and compliance: Implement secure-by-design controls using Microsoft Entra , RBAC, Fabric workspace/item/data permissions, managed identities or service principals, encryption and appropriate network controls. Work with architects and governance specialists on Fabric-native governance and Microsoft Purview requirements where these are in project scope.
• Optimise, monitor and troubleshoot production workloads: Tune SQL, Spark, Delta/Parquet storage, partitioning and compute for performance, cost and reliability. Establish monitoring and alerting for pipelines, notebooks, semantic-model refreshes, data freshness and Fabric capacity, and diagnose failures, data-quality issues and performance problems during delivery and hypercare.
• Support Power BI and data consumption: Work effectively with data analysts for Power BI semantic models and reporting solutions, including Direct Lake and Import concepts, refresh, RLS/OLS, performance and deployment considerations, and enable governed consumption through semantic models, SQL endpoints, data products and APIs where required.
• Lead engineering delivery and…