Senior Platform, DevOps Engineer
Listed on 2026-06-18
-
IT/Tech
SRE/Site Reliability, Cloud Computing: Infrastructure & Operations, Data Engineering, Azure
Senior Platform / Dev Ops Engineer
The Senior Platform / Dev Ops Engineer plays a critical role in designing, automating, and operating enterprise‑grade Databricks platforms in support of data and AI initiatives. This role partners closely with engineering, data, and cloud teams to ensure scalable, secure, and cost‑optimized platform services. The engineer operates with a high degree of autonomy, contributing deep technical expertise while supporting mission‑critical workloads.
Responsibilities- Automate and manage Databricks work spaces, clusters, Unity Catalog, identity, networking, and secret scopes using Infrastructure as Code tools such as Terraform.
- Design, implement, and maintain CI/CD pipelines using Git Hub Actions and Azure Dev Ops to support data and platform deployments.
- Establish and enforce platform guardrails including cluster policies, cost controls, logging, alerting, drift detection, and secure networking standards.
- Ensure platform health, scalability, reliability, and cost optimization across Databricks environments.
- Provide tier‑3 operational support, troubleshoot complex incidents, and drive root‑cause resolution.
- Collaborate with data engineering, analytics, and AI teams to enable efficient development and deployment of data solutions.
- Contribute to platform standards, documentation, and continuous improvement initiatives.
- 5 years of experience in designing, developing, and deploying solutions on the Databricks platform with strong understanding of its architecture and capabilities.
- Proficiency in Python, including PySpark, and SQL; experience with Scala or Java is a plus.
- Strong understanding of cloud platforms such as AWS, Azure, or GCP, including compute, storage, identity and access management, and networking services.
- Hands‑on experience with data warehousing, data lake, and lakehouse architectures, including Delta Lake and medallion architecture concepts.
- Proven experience building and maintaining ETL and ELT pipelines in enterprise environments.
- Experience using Git‑based version control and CI/CD practices for data and platform deployments.
- Strong problem‑solving, critical thinking, and communication skills, with the ability to operate independently in complex technical environments.
CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).