Lead Data Engineer

The Lead Data Engineer will contribute to the development and delivery of Data Warehousing, Reporting and Analytics output. They will enable data (from NHS data sets e.g. relating to acute activity) to be appropriately shared and disseminated within operational reports, published Management Information or Official Statistics.

The Lead Data Engineer will work closely with colleagues to develop robust processes for managing and automating regular outputs. The Lead Data Engineer must communicate plans and timescales to enable onward management of key stakeholders and should provide regular updates.

The Lead Data Engineer will feed into development priorities to understand potential efficiencies and savings in automated processes, to deploy and manage resources appropriately as the organisation progresses towards its strategic data solution.

The Lead Data Engineer will develop and implement new technologies to support robust and accurate data management and must ensure documentation (such as data dictionaries and data lineage information) is readily available across a range of stakeholders.

• Technical lead for departmental work area, and overall data management framework.
• Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
• Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation.
• Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
• Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
• Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T‑SQL.
• Excellent knowledge and experience of R and Python programming.
• Experience of code reviews and ensuring coding standards are applied and met.
• Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
• Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.

• Educated to Masters level or equivalent level or equivalent experience of working at a senior level in specialist area, plus Postgraduate management diploma qualification.

• Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
• Excellent communication and collaboration skills to determine data requirements.
• Experience of implementing digital/information/data change programmes.
• Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
• Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T‑SQL.
• Extensive working knowledge and experience with ETL and data integration.
• Knowledge and expertise of IT architecture and infrastructure.
• Current knowledge of the public sector/NHS.

• Excellent analytical, IT keyboard and numerical skills – confident with statistics and their presentation.
• Excellent verbal and written communication (including presentation) skills.
• Ability to analyse highly complex issues where material is conflicting and drawn from multiple sources (verbal, written and numerical).
• Significant ability to analyse numerical and written data, assess options and draw appropriate initiatives.
• Demonstrable ability to plan over short, medium and long‑term time frames and adjust plans and resource requirements accordingly.
• Demonstrable ability to work effectively between competing activities where required.

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.