Azure Databricks Platform Admin

Position:
Azure Databricks Platform Admin

Azure Functions, Databricks

We are looking for an experienced Azure Databricks Platform Admin with 57 years of experience in cloud data platform administration operations and support. The role is responsible for administering, securing, monitoring and optimizing Azure Databricks environments across development, test, and production landscapes. The ideal candidate should have strong hands‑on experience with workspace administration, cluster management, Unity Catalog, security controls, automation and Azure platform services.

• Administer and maintain Azure Databricks work spaces, clusters, jobs, notebooks, and platform configurations.
• Configure and manage Unity Catalog metastores, catalogs, schemas, external locations, and storage credentials.
• Implement and enforce security controls including access management, role‑based permissions, service principals, secret scopes, and integration with Microsoft Entra .
• Manage cluster policies, autoscaling, runtime versions, job clusters and cost‑optimization measures to improve platform efficiency.
• Integrate Azure Databricks with Azure services such as ADLS Gen2, Azure Key Vault, Azure Monitor, Private Link VNet, and managed identities.
• Monitor platform health, audit logs, usage patterns, job performance and troubleshoot failures, connectivity issues and performance bottlenecks.
• Support CI/CD and infrastructure automation using tools such as Terraform, Azure Dev Ops, Databricks CLI or REST APIs.
• Maintain environment standards across Dev, QA and Prod including deployment controls, documentation and operational runbooks.
• Collaborate with data engineering, architecture, security and support teams to ensure platform reliability, governance and compliance.
• Drive continuous improvement in platform operations, observability, security posture and cost management.

• 57 years of overall experience in cloud platform administration, data platform operations or infrastructure support.
• Hands‑on experience administering Azure Databricks in enterprise environments.
• Strong knowledge of Unity Catalog, Delta Lake, workspace governance, access controls and Databricks administration concepts.
• Good understanding of Azure services including ADLS Gen2, Key Vault, Entra , networking, private endpoints and monitoring services.
• Experience with cluster optimization, troubleshooting Spark job issues, workload tuning and platform monitoring.
• Exposure to automation and Dev Ops practices using Terraform, Azure Dev Ops, Git Hub Actions, Python, Bash or Power Shell.
• Knowledge of identity and access management, audit logging, compliance and data security best practices.
• Working knowledge of SQL and familiarity with Python or scripting for platform automation.
• Strong problem‑solving, stakeholder communication and documentation skills.

• Certification in Azure Administration, Azure Data Engineering or Databricks platform technologies.
• Experience supporting platform setup in secure enterprise environments with governance and network controls.
• Familiarity with Fin Ops practices, tagging strategies and cloud cost reporting.
• Exposure to data engineering workloads orchestration frameworks and performance optimization best practices.
• Experience creating SOPs, knowledge articles and platform support documentation.