Data Engineer

Please note, this Final date to receive applications at 12pm, midday, on Monday 7th September.

We reserve the right to close this vacancy early if we receive a high volume of suitable applications.

Interviews will take place as and when suitable candidates are identified.

The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform. Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data solutions that support reporting, analytics, operational decision-making and future innovation.

As United Welsh modernises its data estate and explores the future direction of its data platform, the Data Engineer will support the evaluation, testing and implementation of modern data technologies, including Microsoft Fabric and other cloud-based solutions where appropriate.

A key part of this role will be involvement in proof-of-concept and pilot activity for Microsoft Fabric. The role will help assess whether Fabric is the right long-term platform for United Welsh by testing functionality, performance, scalability, governance, security and business value before wider decisions are made.

The role will work closely with BI Partners, the Data Governance Analyst, business stakeholders and third-party suppliers to ensure quality data is available when and where it is needed. This is an opportunity to contribute to a growing data capability and help improve outcomes for colleagues and customers across South Wales.

Data Platform Development:

• Design, build and maintain data solutions using Microsoft Fabric, Azure Data Lake and related Microsoft technologies where appropriate.
• Develop and support data pipelines that ingest, transform and curate data from a range of internal and external systems.
• Support the ongoing development of a modern Lakehouse-style architecture, including Bronze, Silver and Gold data layers.
• Maintain and enhance trusted, reusable datasets that support reporting, analytics and operational insight.
• Monitor and optimise platform performance, reliability, efficiency and cost awareness.

Microsoft Fabric Proof of Concept / Pilot Activity:

• Support the design, delivery and evaluation of Microsoft Fabric proof-of-concept and pilot activity.
• Test Fabric capabilities including Data Factory, Lakehouse, Dataflows, pipelines, semantic models and integration with Power BI.
• Assess if the platform meets criteria such as functionality, scalability, security, governance, performance and business value.
• Record technical findings, risks, dependencies and lessons learned to inform future platform decisions.
• Work with the Data and Insights Manager and wider team to provide clear recommendations based on pilot outcomes.

• Develop transformation logic that cleanses, validates and enriches data for operational and analytical use.
• Create and maintain reusable data sets and semantic models that support reporting and insight requirements.
• Apply good-practice data modelling techniques, including dimensional modelling and star schema design where appropriate.
• Work with business users to understand data requirements and translate them into scalable technical solutions.

Data Migration & System Implementation:

• Support system implementation and data migration projects through data mapping, transformation, validation and reconciliation activity.
• Work with business stakeholders and third-party suppliers to understand source and target system requirements.
• Identify and help resolve data quality issues that may impact migration activity or reporting outcomes.
• Help with repeatable migration processes, templates and validation approaches for future implementation activity.
• Support and maintain existing migration solutions developed using SQL Server Integration Services (SSIS), and be comfortable with working with and enhancing established migration processes where appropriate.
• Assist in the transition of migration processes from legacy approaches to modern cloud-based data engineering solutions where appropriate.

• Maintain high standards of data quality, accuracy, completeness and consistency.
• Build quality checks and validation processes into engineering solutions wherever possible.
• Work closely with the Data Governance Analyst to support data standards, classifications, lineage and quality monitoring.
• Create and maintain technical documentation, including data dictionaries, schemas, process flows and solution designs.
• Ensure data engineering activity supports organisational policies, compliance requirements and good governance practice.

• Implement and maintain appropriate security controls within data solutions.
• Support role-based access controls and secure handling of sensitive information.
• Contribute to the development of secure and well-governed data products.
• Ensure data engineering activity aligns with GDPR and organisational data protection requirements.
• Use Git-based…