Databricks DevOps Lead
Job in
Deerfield, Lake County, Illinois, 60063, USA
Listed on 2026-07-15
Listing for:
Veriipro
Full Time
position Listed on 2026-07-15
Job specializations:
-
IT/Tech
Cloud Computing: Infrastructure & Operations, SRE/Site Reliability, Azure, Data Engineering
Job Description & How to Apply Below
We are seeking a highly skilled Databricks Dev Ops Lead to drive automation, CI/CD, and infrastructure management for our data platforms on Azure. The ideal candidate will have deep experience with Databricks, Spark, Azure services, and Dev Ops practices, enabling seamless deployment, monitoring, and operational excellence of distributed data systems. This role also includes coordinating with offshore teams and mentoring junior engineers.
MandatorySkills
- Databricks and Apache Spark development & deployment
- Azure cloud services:
Cosmos DB, ADLS Gen2, Event Hubs, Key Vault, AKS - Infrastructure as Code (IAAS):
Terraform, Bicep, ARM templates - Dev Ops Tools:
Azure Dev Ops (Git Hub, CI/CD pipelines, Boards), Git Hub Actions - Scripting & Automation:
Python, Power Shell, Bash - Containerization & Orchestration:
Docker, Azure Kubernetes Service (AKS) - Monitoring & Observability:
Grafana, Azure Monitor, Log Analytics - Testing & Quality: JUnit, Postman, Sonar Qube
- 5+ years of Dev Ops or Site Reliability Engineering (SRE) experience supporting data platforms or distributed systems
- Strong expertise in CI/CD pipelines for Databricks, Spark jobs, and Azure data components
- Hands-on experience with provisioning Azure resources via IaC
- Knowledge of release strategies for notebooks, JARs, wheels, and configuration artifacts
- Understanding of security best practices (managed identities, secrets management, RBAC) for Azure data services
- Exposure to reliability engineering concepts such as error budgets, SLOs, and SLI dashboards
- Design, implement, and maintain CI/CD pipelines for Databricks, Spark jobs, and Azure data services
- Develop and maintain Infrastructure as Code (Terraform/Bicep/ARM) to provision and manage Azure resources
- Build automation scripts for deployment and release management of notebooks, JARs, wheels, and configuration artifacts
- Implement monitoring, logging, and alerting frameworks for Spark jobs and data pipelines using Azure Monitor, Log Analytics, or Grafana
- Coordinate with offshore teams to ensure alignment on deployments, releases, and support activities
- Ensure adherence to Dev Ops best practices, security standards, and operational excellence
- Mentor and guide junior team members on Dev Ops practices, CI/CD pipelines, and infrastructure management
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×