Databricks Platform Engineer

Our client is seeking a Databricks Platform Engineer to manage and operate their deployment of the Databricks platform. This role focuses on infrastructure, automation, and operational excellence, enabling teams to use Databricks effectively while maintaining strong security, consistency, and governance.

As markets grow more data-driven and competitive, our ability to ingest, model, and deliver high-quality data at scale is fundamental to maintaining our trading edge. This role will offer ownership of a critical internal platform in a high-impact role with influence over platform standards and direction.

• Design, deploy, and operate Databricks work spaces and environments
• Manage workspace configuration, cluster policies, access controls, and platform settings
• Establish and enforce standards for reliability, security, and cost governance
• Support and Improve Databricks platform operations

• Build and maintain infrastructure using
• Automate platform operations and maintenance using Python and shell scripting

• Design and maintain CI/CD systems for infrastructure and platform configuration
• Implement automated validation, testing, and promotion of configuration changes
• Support Git-based workflows and environment lifecycle management
• Troubleshoot Platform level issues
• Help manage system configuration, networking, and access controls
• Improve observability, logging, and operational tooling

• Implement role-based access control, secrets management, and security best practices
• Ensure platform compliance with internal security and operational standards
• Participate in incident response, root cause analysis, and reliability improvements

• 2+ years experience administering Databricks environments
• Strong experience with Terraform and infrastructure-as-code practices
• Proficiency in Python for automation and tooling Solid understanding of CI/CD principles and tooling
• Experience with Git and collaborative development workflows Proficiency in using Linux CLI
• Understanding of cloud infrastructure concepts (networking, IAM, compute, storage)
• Familiarity with monitoring, alerting, and operational best practices
• Experience with AWS infrastructure using Terraform is beneficial
• Ideally experience operating shared developer platforms or internal tooling as well as with multi-environment or multi-account setups
• Knowledge of cloud cost management and governance is nice to have