Lead Data Engineer

Location:

Hybrid

Engineering

Chief Architect - Data and Insights

Agilisys is at the forefront of digital transformation and innovation in the public services sector. Withover two decadesof experience,we haveestablishedourselves as a trusted partner for governments, local authorities, and organizations nationwide. Our mission is to empower our clients to deliver exceptional public services by harnessing the full potential of technology and data.

we become one team and family with organisations, helping them to navigate change and stayagile.

our people really care, going beyond the brief to make change happen for organisations and citizens.

we bring together the right technologies and services to design solutions that work.

we are passionate about - and dedicated to - public services and improving people’s lives.

The Lead Data Engineer is a pivotal role within Agilisys’ Data & AI Practice, providing technical leadership across high-profile public sector programmes. This is a hands-on leadership position where you will define engineering standards, shape architectural decisions, and deliver modern, secure, and scalable data platforms using Microsoft Fabric and the Azure Data Platform.

Working closely with architects, analysts, delivery teams, and client stakeholders, you will lead the design and implementation of enterprise-scale data solutions that enable organisations to unlock value from their data while meeting stringent security, governance, and compliance requirements.

• Lead the design and evolution of scalable data platforms using Microsoft Fabric, Azure Synapse Analytics, and Azure Data Factory.
• Bridge legacy systems with modern cloud-native architectures.
• Define engineering standards, reusable patterns, and architectural best practices.
• Provide strategic technical leadership to ensure performance, scalability, and long-term platform sustainability.
• Work across distributed data processing, storage, and compute services within the Azure ecosystem.

• Lead the hands-on development of end-to-end data solutions using Microsoft Fabric components such as Lake houses, Warehouses, Notebooks, and Dataflows.
• Design scalable data models and ingestion frameworks, supporting both real-time and batch workloads using best-practice techniques (e.g. 3NF, Kimball).
• Enable data consumption through well-structured APIs, semantic models, and data products, with a strong understanding of Power BI integration within Fabric.
• Drive engineering excellence through robust development practices including version control, automated testing, peer reviews, and documentation.
• Optimise performance and cost-efficiency, tuning queries, storage formats (e.g. Delta, Parquet), and compute resources across Fabric and Azure workloads.

We’relooking for an expert in building dynamic and efficient data pipelines. This includes demonstrable experience in:

• Design and implement scalable ETL/ELT solutions for large-scale batch and real-time processing.
• Build and orchestrate complex data workflows using Azure Data Factory, Fabric Data Pipelines, and related technologies.
• Apply data engineering best practices including schema design, indexing, query optimisation, change data capture (CDC), and slowly changing dimensions (SCD).
• Develop high-performance transformation logic using Python, SQL, Spark, and related technologies.

• Lead CI/CD implementation for Microsoft Fabric components, integrating Git for version control and automating multi-environment deployments using Fabric Deployment Pipelines.
• Embed…