Data Engineer

Contract Opportunity | Data & AI Consultancy | Databricks

yLocation
:
Fully Remote – U

KStart
: ASA

g
The Opportuni

ty Primus Connect is working with a growng Data & AI Consultan
cy that is delivering modern data platforms and Databricks solutions for a range of enterprise client

s.They are expanding their engineering capability and are looking for a Mid-Level Data Engine
er with strong commercial Databricks and Spark experience to join an active delivery tea

m.This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery team

s.
Key Responsibilit

• ies Design, build and mainta
  in ETL/ELT data pipeli
  nes using Databricks, PySpark and Spark
• SQL Develop and optimi
  se Delta Lake tables using Bronze, Silver and Gold medallion architect
• ure Ingest data from a variety of source systems into Databri
• cks Write clean, maintainable and well-tested Python/data engineering c
• ode Implement data quality checks, validation and monitor
• ing Participate in code reviews and collaborative developm
• ent Contribute to CI/CD pipeli
  nes for data engineering worklo
• adsWork with senior engineers to deliver scalable data platform soluti
• ons Collaborate with technical, analytics and business stakehold
• ers Participate in Agile ceremonies and delivery activit
• ence Commercial experience build
  ing data pipelines using Data
• icksStr
  ong PyS
  park and Spark SQL sk
• illsSo
  lid Py
  thon experience within data enginee
• ring Practical experience w
  ith Delta
• Lake Understanding of medallion architec
  ture and modern data platform princi
• ples Experience working w
  ith Azure, AWS or
• GCPGood understanding of Git and collaborative development pract
• ices Experience working within Agile delivery environm
• ents Strong communication skills and the ability to work effectively in a remote