Senior Lead Data Engineer. LilyLifestyle

Lead Data Engineer

The Lead Data Engineer will play a pivotal role in designing, building, and optimising data pipelines and architecture to support analytics and business intelligence in the financial services industry. This position, based in London, requires an individual with a strong technical background and a passion for data innovation.

• Design, develop, and maintain scalable data pipelines and systems to process large datasets efficiently.
• Collaborate with analytics and business teams to understand data requirements and deliver tailored solutions.
• Ensure data quality, integrity, and security across all systems and processes.
• Optimise and troubleshoot existing data architectures to improve performance and reliability.
• Implement best practices for data engineering, including version control, testing, and documentation.
• Work closely with stakeholders to provide insights and support data-driven decision-making.
• Stay updated on emerging technologies and trends in data engineering and apply them to enhance operations.
• Mentor and guide junior team members, fostering a collaborative and knowledge-sharing environment.

A successful Lead Data Engineer should have:

• Strong experience designing and building scalable data platforms in Azure.
• Deep expertise in Azure Data Factory, SQL, and Python for ETL/ELT pipelines.
• Proven ability to lead, mentor, and develop data engineering teams.
• Hands‑on experience with data warehousing, modelling, and performance tuning.
• Solid understanding of data governance, quality, and lineage frameworks.
• Experience implementing monitoring, automation, and platform reliability practices.
• Strong stakeholder management skills, translating business needs into technical solutions.
• Exposure to financial services or regulated environments with data security awareness.

• A competitive salary ranging from 90,000 to 110,000 per annum.
• Comprehensive health and pension benefits.
• Generous holiday allowance to support work‑life balance.
• Hybrid working options for greater flexibility.
• A permanent role with opportunities for professional growth and development.