Senior Data Engineer

Senior Data Engineer

Department: Technology:
Data Technology

Employment Type: Permanent - Full Time

Location: London or Manchester UK

The Senior Data Engineer will work as part of an Agile delivery squad with other data engineers and senior data engineers. The role involves delivering data engineering on a range of data products for use in insight, reporting and analytics, including AI. The position works closely with product owners, business analysts, data architects, data analysts, delivery project managers and data scientists.

• Managing quality of own and teams’ outputs
• Delivering data engineering on a range of complex marketing and research processes
• Working with clients to understand needs and implement technology solutions
• Working with a range of data sources such as CRM, sales, research and HR data
• Building Single Customer Views, CDPs or Data Warehouses/Data Lakes to merge disparate data sets for marketing or sales activation
• Building and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data

• Must have experience of using Azure or AWS Databricks and Medallion architecture
• Expert experience with Azure Data Factory or Python/Airflow and associated libraries for data processing and manipulation
• Experience with a range of database technologies including Azure SQL, SQL Server, Azure Data Lake, Postgre
  
  SQL, Snowflake, MySQL, Cosmos DB or Mongo DB
• Understanding of Azure Dev Ops and CI/CD processes
• Knowledge of data warehouse or data lakes with SCVs or in conjunction with CDP platforms
• Knowledge of data ingestion of streaming data using Databricks and Py Spark
• Understanding and application of statistical methods
• Ability to lead, and to work well as part of, a team using the agile methodology
• A growth mindset
• AI curious and ready to embrace opportunities

• Palantir Foundry (Pipeline Builder) experience
• Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend beneficial
• Experience mentoring junior to mid-level Data Engineers beneficial

• Holiday entitlement of 28 days with the option to buy/sell up to 5 days (3 days held for Christmas holidays)
• Day off on or in the week of your birthday
• Pension eligibility with up to 5% matched contributions
• Private healthcare
• Life assurance
• Enhanced maternity and paternity and shared parental leave
• Cycle to work schemes
• Gym and retail discounts
• Regular social events and activities
• A range of other benefits from a flexible benefits package

We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities and those with neurodiverse traits and disabilities. We want you to have the best opportunity to demonstrate your abilities.