Senior Data Engineer

Salary: £55,000 - 55,000 per year Requirements

• We require proven experience in data engineering, including building and maintaining production‑grade data pipelines.
• We require strong experience with Azure Data Factory and Azure SQL Server.
• We require strong T‑SQL skills, including schema design, stored procedures and query optimisation.
• We require experience implementing validation, monitoring, logging and reconciliation controls within data pipelines.
• We require a strong understanding of secure data architecture and the handling of sensitive personal data.
• We require experience with Azure Dev Ops, version control and CI/CD practices.
• We require strong analytical and problem‑solving skills, with excellent attention to detail.
• We require the ability to communicate effectively and work successfully in a multidisciplinary team.
• We consider experience with education datasets, school MIS systems or EdTech platforms desirable.
• We consider experience with common data models, longitudinal datasets or research‑oriented data infrastructure desirable.
• We consider experience with Power BI, Fabric or related analytics technologies desirable.
• We consider experience in a public sector, education or high‑governance data environment desirable.
• We welcome an interest in applying data engineering to improve education and teacher development.
• We think a wide range of work and educational experiences could support success in this role.

• We design, build and maintain Azure‑based data pipelines to support the ingestion, transformation and curation of TED datasets.
• We develop and maintain Azure SQL databases and research‑facing schemas across raw, transformed and curated data layers.
• We write efficient, secure and well‑structured T‑SQL to support ingestion, validation, transformation and optimisation.
• We contribute to the development and ongoing refinement of a Common Data Model across multiple education data providers.
• We integrate and harmonise data from school MIS and EdTech platforms, including Bromcom, Arbor and Wonde.
• We build and maintain robust validation, logging, auditing and reconciliation processes to improve data quality and trust.
• We support secure data handling, including pseudonymisation, access control and compliance with data‑sharing agreements and security requirements.
• We work closely with analysts, researchers, architects and partners to deliver scalable, analytics‑ready data solutions.
• We contribute to agile planning, technical design, documentation and operational handover.
• We carry out our responsibilities in a way that reflects our mission and values.
• We observe our policies, procedures, working practices and regulations, including Equal Opportunities, Health and Safety, Confidentiality, Data Protection and Financial Regulations.
• We comply with all reasonable management requests.

• Azure
• CI/CD
• Dev Ops
• Fabric
• Support
• Power BI
• SQL
• Security
• Cloud

We are the National Institute of Teaching (NIoT), committed to high‑quality, evidence‑informed teacher education and improving teacher and leader development across the education system. Our Teacher Education Dataset (TED) is an ambitious data and research initiative that brings together education, research and digital infrastructure to generate better evidence about teacher development and what makes teaching impactful. We are offering a Senior Data Engineer position within our TED team on a hybrid basis, within commuting distance of one of our campuses, with a salary of £56,667 per annum plus benefits and London weighting if applicable.

We offer generous annual leave, flexible working, a Local Government Pension Scheme, salary sacrifice schemes, lifestyle discounts, enhanced parenthood leave, a supportive team environment, an Employee Assistance Programme and strong professional development support. We are committed to inclusion and welcome applications from people with diverse backgrounds, communities and industries. This role requires a satisfactory enhanced DBS check with Childrens Barred List Check and an Occupational Health Check as a condition of employment.

last updated 27 week of 2026