Data Engineer

Join the team, an exciting new project aiming to have us enter the Consumer Credit Bureau space in the United Kingdom and eventually become a fully-fledged Consumer Reporting Agency. We’re looking for a Data Engineer experienced in testing cloud-native software systems.

Privately owned and independently minded, at Creditsafe, we are guided by values of customer-focus, trust, respect, and a willingness to try new things. For over 20 years, these values have shaped a culture of growth, innovation, and support, where our team members build successful, long-term careers.

With a diverse team spread across 25 offices in 14 countries, we value collaboration, learning, and problem-solving together. We have been featured twice in The Sunday Times' '100 Best Companies to Work For' and continue to prioritize well-being, career growth, and inclusion.

Our continued success has made us the most used business data provider in the world and one of the industry’s strongest growing business intelligence providers. Today Creditsafe has 23 offices across 3 continents serving
110,000 customers from SMEs to enterprise businesses.

Join a team of highly technically skilledengineerswhoaredesigning

Creditsafe’snew Consumer Bureauwithdata quality,lineage, andauditabilityas primary goals whilstmaintaininghigh throughput and scalability.

Thedata platform will be builtusingAWSinfrastructure such as S3and S3-tables(Iceberg), Aurora Serverless, DynamoDB, Lambda,Fargate, ECS, Airflow,Sparkand Kinesis.

Theplatformisexpectedto manage overone hundred millionobjectswith a high volume of daily updateshandlingaddition, deletion,andcorrectionof our dataand indexesinanauditable manner.

The platform will employ a sophisticated matching algorithm to enable us to assign incoming updates to existing objects.

Our data processing application is entirely based on Pythonand designed toefficientlytransformincomingrawdata volume intoAPIconsumableschema.

The teamis alsobuildinghighlyavailableand low latency APIstoenableour clientswithfasterdata delivery.

Contributing actively to the codebaseandparticipatingin peer reviews.

This is not a passive "take a ticket and close it" role -- you will drive development from 3-Amigo's refinement sessions all the way to post-deployment observability.

Design and build metadata driven,eventbaseddistributeddata processing platform using technologies such as Python,Spark,Airflow, Iceberg,DynamoDB,AWS Glue, S3.

Playan active role in the design, development, and deployment ofour business-critical system.

Building and scaling

Creditsafe’sdata pipelines combining batch and streaming approachesandtargetingsub-500ms latency serving.

Understandingdomaindatatomake recommendations to improvetheexisting product.

Employing various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work.

You understand and can implement data engineering best practices.

You demonstrate the ability to write clean&efficient code and combine it with the cloud environment forbestperformance.

You have a minimum6years of development experience within a commercial environment creating production gradedatapipelines in python.

You are looking to growyour skills through daily technical challenges andenjoyproblem solving,whiteboarding in collaboration with team.

You have excellent communication skills,andability to explain your viewsclearlytotheteam andare open tounderstandingtheviews of others.

You have a proven track recordto draw from a deep and broad technicalexpertiseto mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.

You share your ideascollaborativelyviawikis,discussions boards, etcandshareany decisions made,for the benefit of…