Senior lead Data engineer

We are seeking a highly skilled EDO Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms supporting Asset Management business functions. The role will lead platform engineering, infrastructure automation, Dev Ops enablement, platform reliability, security, and operational excellence across the Enterprise Data Office (EDO).

The ideal candidate will have deep expertise in Databricks, dbt, AWS Cloud, Terraform, Python, Dev Ops, Platform Engineering, and Data Operations
, with strong experience supporting investment management organizations.

This role is responsible for establishing and managing a scalable, secure, and highly available data platform that supports analytics, reporting, regulatory compliance, portfolio management, risk management, and investment operations.

• Lead the design, implementation, and management of enterprise data platforms.
• Define platform engineering strategy aligned with EDO and enterprise architecture standards.
• Establish reusable platform frameworks, accelerators, and engineering best practices.
• Drive cloud-native modernization initiatives across data and analytics ecosystems.
• Own platform lifecycle management, scalability, availability, and reliability.
• Lead enterprise-wide Databricks platform architecture and administration.
• Design and implement Lakehouse architecture leveraging Delta Lake.
• Manage Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, MLflow, Structured Streaming, Cluster Policies, Security, and Access Controls.
• Optimize platform performance and cost efficiency.
• Build governance controls across development, test, and production environments.
• Lead cloud engineering activities using AWS services including S3, ECS, EKS, Lambda, Glue, Cloud Watch, IAM, Secrets Manager, and VPC.
• Implement Infrastructure as Code (IaC) practices.
• Build reusable Terraform modules.
• Automate environment provisioning and rollback strategies.
• Implement infrastructure standardization and governance.
• Ensure compliance through Infrastructure-as-Code practices.
• Design and implement CI/CD pipelines.
• Automate deployment and release management processes.
• Enable Infrastructure-as-Code and Git Ops methodologies.
• Improve deployment velocity and platform reliability.
• Support engineering teams with self-service platform capabilities.
• Utilize Git Hub Actions, Git Lab CI/CD, Jenkins, Azure Dev Ops, Terraform, Docker, and Kubernetes.
• Support API integrations and operational workflows.
• Establish Site Reliability Engineering (SRE) practices.
• Define platform SLAs, SLOs, and operational metrics.
• Lead platform monitoring, observability, and incident management.
• Drive root cause analysis and preventive actions.
• Collaborate with architecture, security, infrastructure, and application teams to ensure platform alignment with enterprise standards.
• Provide technical leadership, mentoring, and governance for platform engineering teams.

• Databricks Administration
• Lakehouse Architecture
• Unity Catalog
• MLflow
• Structured Streaming
• Terraform
• Infrastructure as Code (IaC)
• Git Hub Actions
• Jenkins
• Docker
• Python
• dbt
• Dev Ops
• Git Ops
• Site Reliability Engineering (SRE)
• API Integration
• Monitoring & Observability
• Data Platform Governance

• sBachelor's degree in Computer Science, Information Technology, Engineering, or a related field
• .12+ years of experience in Data Engineering, Platform Engineering, or Cloud Engineering
• .Strong experience supporting Asset Management or Investment Management organizations
• .Experience designing highly available, secure, and scalable data platforms
• .Strong understanding of Dev Ops, Infrastructure Automation, Platform Reliability, and Cloud Security
• .Excellent leadership, communication, stakeholder management, and problem-solving skills