Senior Databricks Administrator

Senior Databricks Administrator

We are seeking a Senior Databricks Administrator with 15+ years of overall IT experience and 5+ years of hands‑on Databricks Administration experience to lead the administration, governance, security, performance, and cost optimization of an AWS Databricks platform.

15+ years of overall IT experience with 5+ years in Databricks Administration.

• Databricks Workspace Administration
• Unity Catalog Administration and Governance
• RBAC, SSO, SCIM, and Security Administration
• Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)
• Databricks Cost Management, Pricing, and Fin Ops Optimization
• Platform Monitoring, Auditing, and Compliance
• Multi‑workspace Administration
• Hive Metastore and Hive Tables Administration

• Catalogs, Schemas, Tables, Views, and Storage Credentials
• Cluster Policies and Compute Governance
• User and Access Management
• Platform Upgrades and Runtime Management
• Workspace Provisioning and Environment Governance

Hands‑on experience administering Databricks on AWS.

• AWS IAM
• S3 Storage
• VPC, Security Groups, and Networking
• Secrets Management
• Cloud Governance and Security Best Practices

Although this is not a development role, the candidate must possess a good understanding of:
Databricks Lakehouse Architecture, Apache Spark, Delta Lake, Hive Metastore and Hive Tables, and Data Engineering workflows. This knowledge is required to troubleshoot platform issues, analyze job failures, perform root‑cause analysis, and support engineering teams when required.

• Experience with Hive Metastore to Unity Catalog migrations.
• Strong understanding of Databricks pricing models and consumption optimization.
• Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.
• Experience implementing enterprise security, governance, and compliance controls.
• Databricks certifications are a plus.

• Hands‑on Databricks Administrator, not a Databricks Developer.
• Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.
• Strong experience managing clusters, SQL Warehouses, and workspace administration.
• Deep knowledge of Hive Metastore and Hive Tables.
• Able to independently own and govern the Databricks platform on AWS.
• Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.

AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.