Data Engineer

We are seeking experienced Data Engineer's in Snowflake OR Pyspark to support the design, assessment, and optimisation of modern cloud-based data platforms. This role will focus on Databricks and Medallion Architecture, working closely with stakeholders to evaluate existing data assets, improve data quality, and support the evolution of enterprise data platforms.

• Design, develop, and optimise cloud-based data platform solutions using Databricks.
• Assess and review existing ETL processes, identifying opportunities for improvement in performance, scalability, and maintainability.
• Analyse and validate data quality across multiple source systems and data pipelines.
• Review existing technical documentation and provide recommendations for enhancement.
• Evaluate source system data models and perform technical analysis to support platform design decisions.
• Implement and support Medallion Architecture (Bronze, Silver, Gold layers) within the Databricks ecosystem.
• Develop and maintain scalable data pipelines using PySpark and SQL.
• Collaborate with business and technical stakeholders to understand data requirements and deliver effective solutions.
• Support data modelling activities across operational and analytical workloads.
• Contribute to data governance, quality, and best practice initiatives.

• Strong hands‑on experience with Databricks.
• Advanced PySpark development experience.
• Strong SQL skills for data transformation, analysis, and optimisation.
• Experience designing and implementing cloud‑based data platforms.
• Practical knowledge of Medallion Architecture and modern data lakehouse concepts.
• Experience assessing and improving ETL processes.
• Strong understanding of data modelling principles.
• Experience performing data quality analysis and remediation.
• Ability to review and interpret technical documentation and source system data models.
• Strong analytical and problem‑solving skills.
• Experience with in Insurance or Banking/Financial Services environments.
• Knowledge of data governance and data management frameworks.
• Experience working within enterprise‑scale cloud environments.
• Familiarity with Azure Data Platform technologies.

• Strong stakeholder engagement and communication skills.
• Ability to work independently and provide technical recommendations.
• Detail‑oriented with a focus on data quality and accuracy.
• Comfortable working within complex enterprise environments.