Data Engineer

Fixed Term Permanent Contract until 31/3/2027 Hybrid working The Data Engineer is responsible for designing, building, and maintaining our data infrastructure, ensuring the efficient and reliable processing, storage, and analysis of large datasets. The role will develop and deploy ETL processes from various systems to enhance the data capabilities of the client They will contribute to ensuring our data, and data shared by others is of the highest quality, available and usable.

The role requires a good level of knowledge, functional understanding of modern data technologies and platforms. Design and implement scalable, efficient, and robust data pipelines to extract, transform, and load (ETL) data from various sources into databases.
2.Build and link data sets so that the client can easily derive insights from its Write ETL scripts to make sure the ETL process performs optimally, leading on extracting data, joining and helping analysts to derive insights. Troubleshooting and resolving issues as they arise, to ensure the timely delivery of high- quality data. Identify and automate manual data flows and reports to enable scaling and repeatable use, working with colleagues across the organisation.

Engage and collaborate with teams to understand their data requirements and translate them into technical solutions. Work closely with data stakeholders to provide support and guidance on how to use the data engineering infrastructure effectively. Work with information analysts and BI developers to build optimal and reusable visualisations and reports Extract, clean, combine and store data in a way that allows it to be exploited and as an asset to help service delivery and decision making.

Support colleagues implementing data quality checks, data validation, and data cleansing processes to help ensure the accuracy, consistency, and integrity of the This may include purging data in accordance with regulation and internal policy. Adhere to data governance policies and standards, ensuring compliance with data privacy and security regulations. Anonymise data wherever necessary, working within the principles of GDPR and with suitable data protection and sharing agreements in place.

Document data engineering processes, workflows, and technical specifications to facilitate knowledge sharing and ensure reproducibility of analyses. Stay up-to-date with emerging trends and advancements in data engineering, evaluating and recommending new tools, techniques, and best practices that will enhance the data engineering infrastructure. Contribute to data strategy, writing good standards and practice for data o job description added