Data Engineer

Data Engineer

• Role:
  Data Engineer
• Location:
  
  Newcastle Upon Tyne
• Salary: TBC – Depending on experience
• Levels:
  Senior Analyst, Specialist

Hybrid Working: 3 days per week in our Newcastle, Cobalt business park office

As a Data Engineer, you will design, build, and maintain scalable data solutions that enable analytics, AI, and operational insights. You’ll work alongside client and internal teams to create robust data pipelines, ensure data reliability, and support cloud‑based architectures that power intelligent decision‑making.

• Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark.
• Develop and support real‑time streaming pipelines and event‑driven integrations.
• Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue).

• Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture).
• Ensure data quality, lineage, governance, and security controls are applied consistently.

• Deploy and maintain data applications using CI/CD tooling (Azure Dev Ops, Git Hub Actions, Jenkins).
• Use Infrastructure as Code (e.g., Terraform, Cloud Formation) to manage cloud environments.
• Work with container technologies such as Docker and Kubernetes‑based workloads.

• Work closely with analytics, ML/AI, and product teams to deliver clean, well‑structured datasets.
• Participate in code reviews and internal knowledge‑sharing sessions.
• Provide guidance to junior engineers where needed.

• Strong programming proficiency in Java (preferred) or Python.
• Hands‑on experience with at least one of:
  Kafka, Flink, Spark (Flink/Kafka preferred for streaming).
• Solid understanding of stream processing concepts (e.g., event time, state, back pressure).
• Understanding of software engineering best practices: testing, design patterns, CI/CD, Git.
• Experience building ETL/ELT or streaming data pipelines.
• Exposure to microservices and distributed system concepts.
• Experience working with cloud platforms, ideally AWS, but Azure/GCP also acceptable.
• Understanding of distributed compute, large‑scale data systems, and performance considerations.

• Experience with CI/CD tools (Azure Dev Ops, Git Hub Actions, Jenkins etc.).
• Infrastructure‑as‑Code (Terraform preferred).
• Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS).

• Exposure to enterprise data platforms (Databricks, Snowflake, Big Query, or similar).
• Cloud certifications (AWS, Azure, GCP) are beneficial but not required.

• Minimum 3 years’ experience working on data engineering or large‑scale data solutions.
• Comfortable working in Agile delivery teams.
• Strong communication skills and ability to collaborate with technical and non‑technical stakeholders.

• Experience in client‑facing or consulting environments.
• Professional cloud or data engineering certifications.
• Experience mentoring or supporting junior engineers.
• Background in designing or operating real‑time, low‑latency systems.

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, sexual orientation, gender identity or expression, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.