Data Engineer

Location: City Of London

Data Engineer page is loaded## Data Engineer locations:
London time type:
Full time posted on:
Posted Todayjob requisition :
JR0095
** You will deliver
*** Hands on development on Nexus Platform
* Monitoring daily BAU data pipelines and ensure our data solution is refreshed up to date every day
* Enhance the daily BAU process. Making it easier to monitor and less likely to fail and hands on development on Data Lake build, change and defect fix
* Building new data pipelines using existing frameworks and patterns
* Working with the team within an Agile framework using agile methodology tooling that controls our development and CI/CD release processes
* Contributing to the new Data Lake technology across the organisation to address a broad set of use cases across data science and data warehousing
** Skills and Experience
**** Essential
* ** Experience with data solution BAU processes (ETL, table refresh etc.)
* Experience with integration of data from multiple data sources
* Experience in Big Data data integration technologies such as Spark, Scala, Kafka
* Experience in programming language such as Python or Scala.
Experience using AWS, DBT and Snowflake.
* Analytical and problem-solving skills, applied to data solution
* Experience of CI/CD
* Good aptitude in multi-threading and concurrency concepts
* Familiarity with the fundamentals of Linux scripting language
** Desirable
* ** Experience of ETL technologies
* AWS exposure (Athena, Glue, EMR, Step functions)
* Experience of Snowflake and DBT
* Experience with data solution BAU processes (ETL, table refresh etc
* Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio)
* Previous exposure to Python
* Previous exposure to own data solution BAU monitoring and enhancement
* Exposure to building applications for a cloud environment#LI-Hybrid#LI-TM1
** We work with Textio to make our job design and hiring inclusive.
** Permanent
#J-18808-Ljbffr