Data Platform Engineer

Location: Abu Dhabi
Employment Type: Full-time

We are seeking a Lakehouse Platform Engineer to manage, optimize, and evolve the entire Lakehouse technology stack
, ensuring platform reliability, scalability, and compliance with governance standards. This role is critical for maintaining the backbone of our data ecosystem and enabling self-service capabilities for data teams.

• Platform Management & Optimization
  • Manage and maintain Lakehouse components:
  • Storage: S3 bucket configurations, lifecycle policies, storage optimization.
  • Compute: AWS Glue job management, optimization, DPU allocation.
  • Catalog: AWS Glue Data Catalog and Iceberg table registry.
  • Semantic Layer: Deploy and integrate with our semantic layer.
  • Governance: Deploy, configure, and upgrade Open Metadata.
  • Quality: Maintain Soda Core infrastructure and integration.
  • Apply Iceberg best practices for table optimization and maintenance.
  • Implement automated table maintenance processes.
• Self-Service & Automation
  • Deploy self-service tooling for Data Factory squads.
  • Implement automated lineage capture from Glue jobs.
  • Configure audit logging (Cloud Trail, S3 access logs).
• Disaster Recovery & Reliability
  • Design and implement Disaster Recovery (DR) scenarios including failover, backup management, and runbooks.
  • Execute annual DR tests for the entire data landscape.
  • Ensure all critical platform components are monitored, with alerting and active follow-up.
• Migration & Decommissioning
  • Execute decommissioning roadmap.
• Collaboration
  • Work closely with platform engineers and architects to ensure alignment on optimization and tooling.
  • Partner with operational teams for monitoring and alerting.

• Technical Expertise
  • Strong experience managing Lakehouse platforms on AWS.
  • Proficiency in AWS services: S3, Glue, Cloud Trail, Athena.
  • Hands‑on experience with Apache Iceberg
    , Open Metadata
    , and Soda Core
    .
  • Knowledge of disaster recovery planning and execution.
• Tools & Technologies
  • Infrastructure automation using Terraform and Git.
  • Familiarity with Kafka (MSK) and Open Search.
  • Able to identify ways to automate their work / repetitive tasks.
• Soft Skills
  • Strong problem‑solving and troubleshooting skills.
  • Ability to work cross‑functionally and manage complex platform operations.
  • Ability to work in a fast‑paced environment and deliver aggressive migration targets.
  • Strong collaboration and communication skills.
  • Work with Jira and agile way of working.

• 8+ years in data platform engineering or related roles.
• Experience in financial services or banking domain is a plus.