Lead Data Engineer

Role :
Lead Data Engineer – Consultant

Location :
Sheffield, UK

Is it Permanent/

Contract:

Contract

Is it Onsite/Remote/Hybrid:
Hybrid (3 days weekly from office)

We Are Seeking a Lead Data Engineering Consultant With Proven Experience In Leading And Developing Data Engineering Platforms. The Ideal Candidate Will Possess Hands‑on Expertise In The Following Areas

• Extensive enterprise experience with Hadoop, Spark, and Splunk.
• Proficiency in object‑oriented and functional scripting, particularly in Python.
• Skilled in handling raw, structured, semi‑structured, and unstructured data (SQL and No
  
  SQL).
• Experience integrating large, disparate datasets using modern tools and frameworks.
• Strong background in building and optimizing ETL/ELT data pipelines.
• Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines.
• Experience supporting and collaborating with BI and Analytics teams in fast‑paced environments.
• Ability to pair program and work effectively with other engineers.
• Excellent analytical and problem‑solving abilities.
• Knowledge of agile methodologies such as Scrum or Kanban is a plus.
• Comfortable representing the team in standups and problem‑solving sessions.
• Capable of driving the creation of technical test plans and maintaining records, including unit and integration tests, within automated test environments to ensure high code quality.
• Promote SRE (Site Reliability Engineering) culture by addressing challenges through data engineering.
• Ensure service resilience, sustainability, and adherence to recovery time objectives for all delivered software solutions.