Senior Data Engineer

Senior Data Engineer

Location:

Horsham, England, United Kingdom.

hackajob is collaborating with Envitia to connect them with exceptional tech professionals for this role. Join a close‑knit team with big ideas and a passion for solving complex data challenges at a leading technology company specialising in data intelligence, AI and geospatial solutions.

• Influencing major digital and data transformation projects across the UK public sector.
• Building and utilising smart, AI‑powered tools that support real decision making.
• Using tech to make a genuine difference in society.

You’ll be joining a fresh team of Data Engineers and Consultants passionate about enabling digital success. Using cutting‑edge data engineering and innovation tools, they build the platforms and capabilities that help organisations scale and innovate fast. This team is a powerhouse within our Consulting division, playing a hands‑on role in shaping what modern, data‑enabled organisations look like.

As a Senior / Principal Data Engineer, you will play a key leadership role in shaping and delivering advanced data‑driven solutions for our clients. You will lead the delivery of tailored solutions, responsible for the design, delivery, and implementation of solutions spanning end‑user interfaces, innovative user experiences, and data‑driven outcomes. Working within our Consulting division, you will be a key contributor to the development of our emerging capability framework.

You will lead the end‑to‑end delivery of data and digital solutions of varying scale and complexity across multiple technical domains, including modern Data Engineering and Pipelining, Analytics and Visualisation, Digital Twins, Simulation, and Asset/Data Management.

• Build, optimise, and maintain scalable data pipelines that handle high‑volume, high‑velocity data in complex SaaS environments.
• Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements.
• Analyse and consolidate business requirements and use cases to meet technical and non‑technical debt.
• Design tailored and bespoke solutions to address and mitigate challenges faced by our clients.
• Make key decisions on build vs. buy for data and digital engineering solutions and platforms.
• Work closely with the entire business beyond product or technology, driving innovation through concept demonstrators and supporting sales activities from a pre‑sales perspective.
• Carry out horizon scanning to identify emerging technology and industry trends and assess their potential impact and opportunities to become Envitia offerings to the market.

• Proficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch.
• Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open‑source frameworks including Spark, Beam, and Airflow.
• Hands‑on experience with real‑time data streaming technologies (e.g., Kafka, Pub/Sub).
• Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls.
• Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads.
• Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions).
• Experience working within data lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage.

• Practical understanding of at least one major cloud provider (AWS or Azure).
• Strong analytical and problem‑solving skills with a keen eye for detail and a drive to deliver business value through data.
• Excellent communication skills, with the ability to convey technical concepts to non‑technical audiences.
• Demonstrated ability to collaborate effectively within distributed or remote teams.
• A willingness to mentor and support colleagues in their professional development.

The successful candidate must hold or be required to go through an SC security clearance.

The role will require travel to our Horsham offices 2 days a month and travel to customer sites when required.

Mid‑Senior level.

Full‑time.

Information Technology.

Software Development.