Finance Data Engineer

Overview

The Data Engineer plays a critical role in enabling Finance & Treasury to deliver accurate, timely, and insight-driven reporting by building scalable data solutions, maintaining core data infrastructure, and supporting the modernisation of Finance systems.

This role is responsible for engineering robust data pipelines, managing datasets across the Microsoft Fabric platform, and ensuring Finance has reliable, consistent, and governed data to support transformation, automation, and improved operational efficiency.

As Finance undergoes significant change, the Data Engineer will be a key technical contributor—helping shape new ways of working, supporting system enhancements, and ensuring Finance is equipped with modern, resilient data capabilities.

• Design, develop, and maintain SQL data structures within Microsoft Fabric, writing efficient SQL queries and Python-based transformations to support scalable data pipelines and optimise performance across Lakehouse and Warehouse workloads.
• Build and maintain reporting datasets optimised for analytics and visualisation, implementing Slowly Changing Dimension (SCD Type
  2) logic to support historical reporting and data accuracy.
• Ensure data security and integrity throughout the medallion architecture, enforcing access controls, auditing data changes, and ensuring accurate, consistent data is delivered
• Develop and maintain Power BI semantic models and model layouts built on Microsoft Fabric Gold-layer datasets, ensuring secure, performant, and well-governed reporting models for dashboards and analytical consumption.
• Support the onboarding of new data sources into Microsoft Fabric by working with Dev Ops teams on secure connectivity, API integrations, and operational ingestion processes.
• Design and develop data pipelines and queries, for efficient data extraction and transformation.
• Write and maintain production-level code to support lead management and Finance systems, ensuring scalability, performance, and reliability.
• Development and maintenance of complex datasets needed for reports, dashboards, and visualisations.
• Troubleshoot database-related issues.
• Monitor and optimize database performance, identifying and resolving bottlenecks and inefficiencies.
• Conduct regular reviews of SQL code and queries for performance improvements
• Ensure data security and integrity.
• Stay updated with the latest database technologies and best practices.

• Implement best practices for data modelling, ETL processes, and data integration.
• Optimise data warehouse performance through efficient query design, indexing strategies, and data partitioning.
• Stay updated on emerging trends and technologies in data management and analytics and evaluate their potential impact on our data warehouse architecture.

• Support configuration changes as needed to meet Finance & Business requirements.
• Take ownership of upgrade processes including testing and configuration changes, ensuring the current system is fit for purpose for Finance users.
• Facilitating with the implementation of the new functionality arising from the upgraded software.

• Extensive SQL experience:
  • Working with relational databases (e.g., SQL Server, Oracle, MySQL).
  • Strong proficiency in SQL, T-SQL and Spark
    
    SQL.
  • Proven background as a SQL Analyst / Developer or Data Engineer.
• Experience working with structured and unstructured data sources.
• Experience writing stored procedures and production-level data transformation code.
• Previous experience of working in a fast-paced environment
• Knowledge of software development best practices.
• Strong analytical mind, excellent attention to detail.
• Good interpersonal and communication skills both written and verbal.
• Good analytical abilities, with an enquiring mind.
• Robust, capable of clearly and strongly articulating position.

• Hands-on experience with Microsoft Fabric.
• Advanced development experience, most notably with programming languages such as python.
• Power BI model development and semantic modelling.
• API setup/testing experience (e.g., Postman).
• Experience with cloud platforms and modern data architectures.
• Experience with…