Data Engineer - Datacore​/IOTT

Position: Data Engineer - Datacore / IOTT
Circa £45k, salary dependant on skills and experience

Base location in either Lincoln or Huntingdon (depending on your location) and home working (expectation is 2 days in the office)
Permanent Full time, 37 hours per week

Do you have prior experience of modern data engineering, including data modelling and working with real-time or streaming data?

Do you have experience of working within an Agile environment, or are keen to work in one?

Do you enjoy exploring, learning, and challenging yourself, and are you a strong team player?

If you can answer yes to the above, we have an exciting opportunity for you with our expanding team!

The data service will go beyond the traditional data warehouse to provide a modern data platform that supports both analytical and operational use cases. Within our Datacore (IOTT) platform, this includes enabling real-time and near real-time data capabilities, integrating data from industrial and operational systems, and delivering trusted, well-engineered data products that drive business performance in critical environments.

What will my role involve?

The Data Engineer is a T-shaped professional (also referred to as a generalised specialist) with identifiable core skills, yet with the ability to work across multiple disciplines (both technical and non-technical) as required.

The Data Engineer (Datacore / IOTT Platform), whilst having core skills to deliver data solutions on our analytics and big data platform, will also act as a technical expert across real-time and batch data platform delivery. You will work on building and maintaining data pipelines that integrate industrial, IoT, and enterprise data sources into a secure, scalable cloud platform.

You will be expected to work in an Agile/Scrum environment, in a squad model consisting of various other developers. You may be expected to work as a lead within the squad and/or fulfil other roles as required.

The Data Engineer (Datacore / IOTT) will have the core skills to carry out the following activities:

Design robust, secure, and supportable data solutions for both batch and streaming use cases, ensuring scalability, resilience, and security by design

Develop, test, and support data pipelines integrating data from industrial, IoT, and enterprise systems using technologies such as Azure Synapse, and event streaming platforms (e.g. Event Hubs, Kafka, MQTT, Quix)
Work with edge and integration platforms (e.g. High Byte, Ignition, Quix, or similar) to ingest, model, and standardise operational data, aligned to a Unified Namespace (UNS) approach for organising and distributing real-time operational data Build and optimise solutions for handling time-series and telemetry data, ensuring performance and usability at scale

Collaborate with architects, cloud engineers, and platform teams to design and evolve data platform capabilities, including CI/CD, deployment automation, and environment management

Ensure data quality, observability, and reliability across real-time and batch pipelines

Where required, contribute to downstream data modelling and analytics to support reporting and insight

Build automated test frameworks and develop test harnesses for each component, increasing overall test coverage and ensuring a culture of quality and reliability across the platform

What does it take to be a Data Engineer (Datacore / IOTT)?

Strong experience in data engineering using cloud platforms (e.g. Azure), including tools such as Azure Synapse, Spark, Python, and SQL Experience working with real-time or streaming data pipelines (e.g. Event Hubs, Kafka, MQTT, Quix, or similar)
Experience working with time-series or telemetry data Experience integrating data from APIs, industrial systems, or edge platforms (e.g. High Byte, Ignition, or similar)
Familiarity with Unified Namespace (UNS) principles and MQTT-based architecture is advantageous

Experience in data modelling (e.g. relational modelling, dimensional modelling, or similar approaches suited to operational systems)
Experience delivering end-to-end data solutions from ingestion through to production deployment

Experience working in an Agile/Scrum environment

Experience collaborating with platform and…