Senior Data Engineer IRC

We are looking for an experienced Senior Data Engineer to support our client in optimising their Databricks Lakehouse setup and rebuilding key data pipelines to improve cost‑efficiency and performance. This role will be central to two work streams:

• Databricks Environment Changes — implementing environment-level changes including data deletion and instance control.
• Pipeline Rebuild POC — rebuilding a critical pipeline to assess cost/performance trade‑offs (e.g. SCD Type2 vs Type1), then extrapolating findings across other pipelines.

• At least 4 years of hands‑on experience in data engineering (or similar role) — ideally with substantial exposure to big data / lakehouse environments.
• Expert‑level proficiency with Databricks/Spark.
• Deep understanding of data modelling — especially around SCD Type 1 vs Type 2 — and familiarity with Delta Lake, DLT vs traditional ELT pipelines.
• Proven track record in performance tuning and refactoring of complex data pipelines.
• Ability to benchmark and clearly document performance and cost differences; comfortable leading technical implementation.
• Excellent communication skills, and ability to mentor/guide other engineers.

• Lead the design, development, and optimisation of the “Silver Claims” pipeline inside the DAVE2 POC environment.
• Implement technical improvements — e.g. SCD Type 2 modelling, removal of unnecessary DLT components, caching, and code refactoring.
• Set up monitoring and tagging to allow cost and performance comparison between baseline and optimised pipelines.
• Run pipelines in parallel, validate that output remains equivalent, and compare performance and cost metrics.
• Document pipeline architecture, build standards and reasoning behind optimisations for inclusion in deliverables.
• Provide technical guidance and mentorship to fellow Data Engineers; ensure compliance with internal (Nexus and AA) data‑engineering standards.

Culture of caring. At Global Logic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.

Learning and development. We are committed to your continuous learning and development. You’ll grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career h our Career Navigator tool as just one example, Global Logic offers a rich array of programs, training curricula, and hands‑on opportunities to grow personally and professionally.

Interesting & meaningful work. Global Logic is known for engineering impact for and with clients around the world. As part of our team, you’ll work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem‑solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting‑edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High‑trust organization. We are a high‑trust organization where integrity is key. By joining Global Logic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

Global Logic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward‑thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.