Lead Data Engineer

Description

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‑lead, equipping them with robust data platforms and joining a data team on its mission to eliminate silos and embed data knowledge into delivery teams. You will also help implement efficient data pipelines and storage.

• Define, shape and perfect data strategies in central and local government.
• Help public sector teams understand the value of their data, and make the most of it.
• Establish yourself as a trusted advisor in data‑driven approaches using public cloud services like AWS, Azure and GCP.
• Contribute to recruitment efforts and take on line‑management responsibilities.

• Proficiency in Git (including Git Hub Actions) and ability to explain the benefits of different branch strategies.
• Strong experience in IaC and ability to guide how to deploy infrastructure into different environments.
• Knowledge of handling and transforming various data types (JSON, CSV, etc.) with Apache Spark, Databricks or Hadoop.
• Good understanding of possible architectures in modern data system design (Data Warehouse, Data Lakes, Data Mesh).
• Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
• Understanding of how to create reusable libraries to encourage uniformity across multiple data pipelines.
• Ability to document and present end‑to‑end diagrams to explain a data processing system on a cloud environment.
• Some knowledge of diagram representation such as C4, UML, etc.
• Enthusiasm for learning and self‑development.
• Experience working on agile delivery‑lead projects and application of agile practices such as Scrum, XP and Kanban.
• Ownership of cloud infrastructure underpinning data systems through a Dev Ops approach.
• Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
• Skilled Data Engineer who has delivered data platforms.
• Knowledge of SOLID, DRY and TDD principles and how to implement them into a project.
• Commercial mindset for growing accounts organically with senior stakeholders.
• Experience enhancing project resilience by checking for software vulnerabilities and implementing appropriate testing strategies (unit, integration, data quality).
• Skill at guiding robust Dev Ops approaches in data projects.
• Ability to discuss tools needed for Data Ops, including orchestration, data integration and analytics.

• Experience working at a technology consultancy.
• Experience with Docker and virtual environments as part of the development and CI/CD process.
• Experience working with senior stakeholders to gather requirements and keep them engaged.
• Experience working with a team of engineers using techniques such as pair programming or mob programming.
• Experience working with data scientists to product ionise advanced deliverables such as machine learning models.
• Working knowledge of statistics.
• Experience with multidisciplinary digital and technology teams.
• Experience with in the public sector.
• Experience with data scientists to product ionise advanced deliverables, such as machine learning models.

Life at Made Tech

We’re committed to building a happy, inclusive and diverse workforce. Our blog covers mental health, communities of practice and neurodiversity, as well as client work and best practice. We use Slack to foster community and have special interest groups for music, food and pets, 10+ dedicated Slack channels for specific communities, allies, identities and learning spaces called COPs. If you’d like to speak to someone from one of these groups, let a member of the Made Tech talent team know.

Benefits

• 30 days paid annual leave.
• Flexible parental leave options.
• Part‑time remote working available for all staff.
• Paid counselling as well as financial and legal advice.
• 7% employer‑matched pension.

An increasing number of our customers are specifying a minimum of SC (security check) clearance for projects. Successful candidates must have eligibility: 5 years UK residency and 5 years employment history (or full‑time education), and no more than 30 consecutive days spent outside the UK in the last five years. If at any point it is apparent that you may not be eligible for SC, we will not progress your application and will contact you to let you know why.

Made Tech is on a mission to use technology to improve society for everyone. We help organisations transform, deliver and manage world‑class digital products and services. Recent achievements include the design and build of a Homes for Ukraine service delivered in 2 weeks, the digitalisation of NHS services, and support for local authorities in housing repairs. We are also advancing energy outcomes by improving network performance through real‑time asset monitoring.

We were recently a finalist for the Raising the Bar for Workplace Transparency Award.