Senior Data Engineer Hybrid

Position: Senior Data Engineer - £62,000 - Hybrid
SENIOR DATA ENGINEER
£63k - Hybrid Working (2 days a week in office) - Bridgend, Wales.

Your new company

The company is a not‑for‑profit housing association established in 2003 as the first large‑scale voluntary transfer of council‑owned homes to a social housing provider in Wales. The organisation is rooted in its mission to provide safe, high‑quality and affordable homes across Bridgend and South Wales, creating thriving communities where people feel secure, supported, and proud to live.
Today, the business manages over 6,000 homes, alongside nearly 700 leasehold flats, a portfolio of commercial properties, and more than 1,100 garages, supporting thousands of residents across the region. As a purpose‑driven organisation, its core focus is to deliver homes and places where people feel safe and happy, while helping individuals live independently and confidently.
With around 131 employees and a commitment to community development and sustainable living, they continue to play a vital role in local regeneration and social wellbeing. The organisation works to build strong partnerships, enhance resident engagement, and embed environmental sustainability into every part of its operations.
The organisation is also dedicated to nurturing inclusive communities and has pledged to uphold strong equality, diversity and inclusion values across all aspects of its work. With a vision of helping build a better Bridgend and Wales, the organisation remains committed to improving lives, investing in homes, and supporting resilient, forward‑looking communities.

Your new role

The overall purpose of this role is to be the primary architect and builder of our modern data estate. This is a high impact, "greenfield" role where you will design and implement the Azure Databricks infrastructure that forms the backbone of our future data, BI, and AI capabilities, and continue to mature our Power

BI architecture for ease and robustness of reporting and self-service.
This role will champion a Data Sec Ops  approach, ensuring that security, privacy and compliance are embedded throughout the data lifecycle from the outset.

The nascent nature of our data capabilities means you will have the opportunity to help shape those capabilities to achieve lasting positive value for the organisation as a whole, our customers and our colleagues.

No Sponsorship Offered for this role.

Key responsibilities and accountabilities

Data Platform Architecture & Data Sec Ops

- Lead the design and implementation of a scalable and secure data platform using Azure Databricks, enabling the ingestion, transformation and governance of data from key business systems while supporting a reliable "single version of the truth" for reporting and analytics;
- Design and deploy secure, scalable ELT or ETL pipelines using Databricks (Unity Catalog), Delta Lake, and Azure Data Lake Storage (ADLS);
- Implement shift-left security principles within the data ingestion layer, including automated data masking, encryption at rest and in transit, and row- and column-level security controls;
- Establish and embed Data Ops and Data Sec Ops  practices, including CI/CD, version control (Git), and automated security scanning of data pipelines.

Power BI & Reporting Foundation

- Finalise a governed Power BI architecture, including standardised semantic models and dataflows;
- Ensure robust Identity and Access Management (IAM) across Power BI work spaces, enabling true self-service analytics without compromising data privacy.

Data Stewardship & Leadership

- Proactively identify data and logic inconsistencies between systems, providing clear evidence and insight to support stakeholders in resolving operational issues;
- Act as a technical lead, coaching a Junior Data Engineer and Analyst on modern engineering standards and secure coding practices;
- Work with the Software Engineering Manager to establish naming conventions, metadata standards, and data residency/sovereignty protocols.

Stakeholder Engagement & Continuous Improvement

- Constructively challenge stakeholders and teams where necessary on scope and delivery to ensure deliverables remain on track;
- Support continuous improvement efforts…