Data Engineer

Date Posted:
Country:
United Kingdom

Location:

Warminster, Wiltshire Role Type:
Hybrid

At OMNIA® Training, we’ve brought together some of the UK’s most innovative defence training organisations under one powerful mission: to transform the British Army’s training system and create the best-trained Army in the world. OMNIA are redefining the British Army’s collective training. To do that, we are looking for the best and brightest minds from across the UK. We are backed by British innovation and powered by world-class experts, like you.

OMNIA is at the heart of the UK’s bold Land Industrial Strategy.

You’ll work in a matrix organisation and report operationally through OMNIA Training and functionally to the Data Lead. Ultimately, you’ll work for the British Army, championing innovation, and helping shape the future of military collective training.

• Collaborate with engineering, simulation, customer, third party and training teams to ensure seamless data management and integration across military training environments.
• Ensuring the security and compliance of data environments through the implementation of appropriate security controls and governance frameworks.
• Author, review and contribute to technical documentation.
• Coordinate with cross‑functional engineering teams—including QA, development, operations, and business SMEs.
• Assist in the design and implementation of scalable, high‑performance data platforms and pipelines.
• Define and enforce data engineering standards, best practices, and governance frameworks including data lifecycle design, implementation and management.
• Implement the design and optimisation of data storage, processing, and retrieval strategies.
• Collaborate with cross‑functional teams (data scientists, analysts, software engineers) to align data solutions with business needs.
• Drive adoption of modern data technologies (e.g., cloud‑native platforms, streaming, orchestration tools).
• Contribute to data quality, security, compliance and lineage practices across the organisation.
• Provide technical input and guidance to data engineering team members.
• Evaluate, select and integrate new tools, frameworks and platforms for the data ecosystem.
• Act as a subject‑matter expert in data strategy, influencing design decisions.
• Any other duties required to meet the needs of the programme.

We’re after individuals who want to serve. You’ll have a mission focus, and the enthusiasm and drive to ‘get things done’. You’ll want to work in collaboration with other defence training organisations, and the British Army. You won’t let bureaucracy get in the way of what needs to be done, you’ll learn lessons and share these lessons across the team, you’ll understand what it means to put the mission first.

• Hands‑on experience with cloud platforms (AWS, Azure, GCP, OCI) and cloud‑native data services.
• Extensive experience designing and building large‑scale data pipelines and platforms.
• Strong expertise in SQL, data modelling, and database optimisation (relational, vector and No
  
  SQL).
• Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop).
• Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services.
• Strong programming skills in Python, Java, or Scala for data engineering.
• Hands‑on experience with data orchestration and workflow management tools (e.g., Airflow, Dagster, Prefect).
• Proven track record with data governance, quality, lineage and security practices.
• Experience with real‑time/streaming data technologies, data ingestion / ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub).
• Strong proficiency in relational and non‑relational databases (e.g., Postgre
  
  SQL, Mongo
  
  DB, Cassandra).
• Deep knowledge of data transformation and ETL pipelines and APIs.

• Degree in Data Engineering or equivalent professional accreditation such as CEng.
• Experience with graph databases and advanced query languages (e.g., Neo4j, Gremlin).
• Knowledge of machine learning data pipelines and MLOps practices.
• Familiarity with data virtualisation and data mesh concepts.
• Hands‑on experience…