Lead Data Engineer
-
IT/Tech
Job Description & How to Apply Below
About the Role
Our client, a prominent e-commerce platform, is seeking an experienced Lead Data Engineer to join their growing data team in East London
. This role is responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support the company's analytics and machine learning initiatives. You will lead a team of data engineers, architect data solutions, and ensure the efficiency and reliability of the data platform. The ideal candidate has a strong background in data warehousing, ETL processes, big data technologies, and cloud data services.
This position offers a hybrid work arrangement, combining remote flexibility with essential in-office collaboration in East London
.
- Design, develop, and maintain robust and scalable ETL/ELT pipelines to ingest and process large volumes of data.
- Architect and build data warehouses and data lakes on cloud platforms (e.g., AWS , Azure , GCP ).
- Optimize data infrastructure for performance, scalability, and cost-efficiency.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Implement data governance and data quality best practices.
- Lead and mentor a team of data engineers, providing technical guidance and support.
- Monitor and troubleshoot data pipelines and infrastructure issues.
- Evaluate and implement new data technologies and tools.
- Ensure data security and compliance with relevant regulations.
- Automate data processes and workflows using scripting and programming languages.
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field;
Master's degree is a plus. - 5+ years of experience in data engineering, with at least 2 years in a lead or senior role.
- Proven experience designing and building data pipelines using tools like Apache Spark , Kafka , or similar.
- Strong experience with cloud data services (e.g., AWS Redshift, S3, Glue; Azure Data Factory, SQL Data Warehouse; Google Big Query, Cloud Storage).
- Proficiency in SQL and experience with relational and No
SQL databases. - Experience with programming languages such as Python or Scala.
- Familiarity with data warehousing concepts and dimensional modeling.
- Excellent problem-solving, analytical, and communication skills.
- Demonstrated leadership and team management capabilities.
- Experience working in an e-commerce environment is a significant advantage.
- Ability to work a hybrid schedule from our offices in East London
.
Our client offers a competitive salary, comprehensive health and wellness benefits, performance bonuses, and opportunities for continuous learning and professional development. This hybrid role provides flexibility while fostering team collaboration. Join a data-driven organization in East London that values innovation and offers a challenging and rewarding career path in the exciting field of big data.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction