Data Engineering Lead
Listed on 2026-09-03
-
IT/Tech
Data Engineering, Data Warehousing
Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. Our Snowflake data lake platform sits at the centre of that estate, and we are looking for a Data Engineering Lead to drive its implementation.
This is a deeply hands-on role. You will spend most of your time building on Snowflake and establishing how data is tagged, catalogued, governed and quality-assured across the business, working alongside our architects and directing strategic delivery partners who build with you.
Key Responsibilities:- Snowflake Development: Spend the majority of your time hands-on in Snowflake, architecting and building the platform and its surrounding ecosystem, including ingestion, transformation, data models, curated data products, and warehouse, performance and cost design for high-volume reinsurance placement, exposure, claims and market data.
- Tagging & Cataloguing: Establish and maintain data tagging, classification and cataloguing, so that data across the platform is discoverable, well described and correctly labelled for sensitivity and business meaning.
- Data Governance: Own governance for the platform, covering ownership and stewardship, lineage, access policies, retention obligations and cross-border data residency, working with security, risk and the business.
- Data Quality: Define and implement data quality controls, automated testing, monitoring and reconciliation, and make quality visible and measurable to data consumers.
- Scale & Archival: Design the platform to handle growing data volumes predictably, defining partitioning and clustering, storage tiering, retention and archival strategy, and keeping performance and cost under control as the estate grows.
- Architecture Contribution: Contribute to the data architecture, working with the Solution Architect and Head of Architecture & Engineering to shape target-state designs and feed real-world constraints back into them.
- Vendor Leadership: Direct and quality-assure the work of strategic delivery partners, reviewing their designs and code and holding them to the agreed standards.
- Engineering Standards: Set how the team builds, covering CI/CD for data, automated testing, observability and infrastructure-as-code.
- Grow the Team: Mentor engineers, raise the technical bar, and help shape how the data engineering function scales.
You are a hands-on data engineering leader who is comfortable owning delivery in a fast-moving, greenfield environment with a lean core team and strategic delivery partners. Ideally you will bring:
- Experience: 10 + years in data engineering, including experience leading the delivery of a significant data platform end to end.
- Snowflake Depth: Deep, current, hands-on Snowflake expertise, having both built and architected across the platform and its surrounding ecosystem. This includes warehouse sizing, performance and cost optimisation, RBAC and access design, object tagging and masking policies, ingestion (Snowpipe, Streams and Tasks), sharing and marketplace, AI and ML capabilities such as Cortex, and transformation and orchestration tooling such as dbt.
- Governance & Cataloguing: A strong track record establishing data governance in practice, covering tagging and classification, data catalogues, lineage, stewardship and access policies.
- Data Quality: Practical experience implementing data quality frameworks, automated testing and monitoring, and driving measurable improvement.
- Data Modelling: Deep expertise in data modelling and warehouse design, with sound judgement on schema design, performance and cost at high volume.
- Scale & Archival: Proven experience running data platforms at high volume, including partitioning and clustering strategies, storage tiering, and defining retention and archival approaches that satisfy long-term regulatory obligations without runaway cost.
- Technical Stack: Strong SQL and Python, with practical experience of pipeline orchestration, ELT tooling, CI/CD (Azure Dev Ops or Git Hub Actions) and infrastructure-as-code (Terraform/Bicep) on Azure.
- Architecture & Compliance: Enough architectural depth to shape platform…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).