Senior Data Engineer - Outside Ext

Senior Data Engineer
Rate: up to £450/day Outside IR35
Contract Length: 6 Months (with likely extension)
Location: Hybrid - 1 day per week onsite in Central London
Working hours: 9am - 5pm - Monday - Friday

An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making.

Responsibilities for the Senior Data Engineer:

• Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards
• Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights
• Lead by example on engineering excellence, mentoring junior engineers and driving adoption of Dev Ops and CI/CD best practices within the data function
• Contribute to the evolution of a modern event-sourcing architecture, enabling efficient data modelling, streaming, and transformation across platforms
• Collaborate with cross-functional teams - including Business Analysts, Product Owners, and fellow Senior Data Engineers - to translate business needs into robust technical solutions
• Champion data governance, privacy, and security best practices, ensuring compliance and protection of customer data
• Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation

Essential Skills for the Senior Data Engineer:

• Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming
• Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines
• Advanced knowledge of SQL and data modelling (dimensional modelling, fact/dimension structures, slowly changing dimensions)
• Managing and querying data lakes or Lakehouse's
• Excellent communication skills with the ability to explain complex technical concepts clearly and persuasively

Desirable Skills for the Senior Data Engineer:

• Experience with event sourcing, dbt, or related data transformation tools
• Familiarity with Postgre
  
  SQL and cloud-native data services (Azure Event Hub, Redshift, Kinesis, S3, Blob Storage, One Lake, or Microsoft Fabric)
• Understanding of machine learning model enablement and operationalisation within data architectures
• Experience working within Agile delivery environments

If you are an experienced Senior Data Engineer with strong expertise in Databricks, Azure, and data architecture design, looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance.

Data Engineer, Senior Data Engineer