Azure Databricks Admin
Job in
Cincinnati, Hamilton County, Ohio, 45208, USA
Listed on 2026-10-23
Listing for:
TechDigital Group
Full Time
position Listed on 2026-10-23
Job specializations:
-
IT/Tech
Cloud Computing: Infrastructure & Operations, Data Engineering, Azure
Job Description & How to Apply Below
- Deploy, configure, and manage Azure Databricks work spaces in a scalable, cost-efficient, and secure manner.
- Administer clusters, jobs, notebooks, and workflows
, ensuring high availability and performance. - Monitor and optimize compute resource utilization and autoscaling strategies to improve cost efficiency.
- Manage Databricks Runtime versions, libraries, and dependencies across environments.
- Implement and manage Unity Catalog for fine-grained access control and data governance
. - Enforce Role-Based Access Control (RBAC) and integrate Databricks with Azure Active Directory (AAD).
- Ensure compliance with SOC 2, HIPAA, GDPR, and internal security standards
. - Set up audit logging, monitoring, and alerting for security and operational insights.
- Tune Apache Spark workloads to improve query performance and resource efficiency.
- Analyze and troubleshoot performance bottlenecks in ETL and ML workloads.
- Optimize Delta Lake storage, caching, and indexing strategies for better query execution.
- Automate Databricks workspace deployment using Terraform, ARM Templates, or Databricks REST API
. - Develop and maintain CI/CD pipelines for Databricks job deployment and configuration management.
- Implement monitoring solutions using Azure Monitor, Prometheus, or Grafana
.
- Work closely with data engineers, data scientists, and Dev Ops teams to support data pipelines and analytics workloads.
- Integrate Databricks with Azure Data Lake, Azure Synapse Analytics, and Snowflake
. - Provide technical guidance and best practices for efficient Spark job execution and cost optimization
.
Skills & Experience:
- 5+ years of experience in Azure Databricks administration and performance optimization
. - Expertise in Apache Spark, PySpark, SQL, and Scala
. - Hands-on experience with Databricks Unity Catalog, Delta Lake, and MLflow
. - Strong knowledge of Azure cloud services (Azure Data Lake, Azure Synapse, Azure Key Vault, etc.).
- Experience in Infrastructure as Code (Terraform, Bicep, or ARM Templates).
- Proficiency in CI/CD pipeline automation using Azure Dev Ops, Git Hub Actions, or Jenkins
. - Strong understanding of network security, identity management (AAD), and encryption best practices
. - Excellent problem-solving skills and ability to troubleshoot complex Databricks workloads.
- Strong communication and documentation skills.
- Databricks Certified Associate or Professional certification.
- Experience with Azure Kubernetes Service (AKS) and serverless computing
. - Familiarity with Kafka, Apache Airflow, and event-driven architectures
. - Knowledge of Python, Power Shell, or Bash scripting for automation
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×