Principal Engineer - Senior Azure Databricks Administrator

Job Title

Principal Engineer I - Senior Azure Databricks Administrator

Block 23

As a Principal Engineer I embedded in the Enterprise Data & Analytics function, you will be responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, and visualize data.

You’ll provide SME expertise in designing, building, optimizing, streamlining, and automating the Azure Databricks platform to enable analytical workloads such as Machine Learning (ML), Model Development, Data Insights, and Data Science. In this role you’ll partner with ML engineers, data scientists, data analysts, and enterprise architects to provide frameworks, set standards, enforce best practices, and train and enable users on the Azure Databricks platform.

In this role, you will develop the technical skills of one or more junior team members.

• Take assignments that can be worked on individually without supervision, and manage work effort from concept to completion.
• Design, build, optimize, automate and maintain the Azure Databricks platform, ensuring scalability, security, governance, and performance.
• Design, implement, and manage Azure Databricks work spaces, clusters, jobs, and access management.
• Design, implement, and manage policies, monitoring, and observability for the Azure Databricks platform.
• Implement data analytics principles aimed at business enablement, reliability practices, and sound recovery procedures.
• Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements.
• Work closely with business and analytics teams to ensure reliable and governed data access for analytics.
• Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services.
• Stay current on emerging data analytics technologies, recommending enhancements to improve efficiency and governance.
• Act as a thought leader on Azure Databricks implementation, usage, end‑user enablement, and training.

• 8+ years of related experience in data analytics administration and development.
• 4+ years of Databricks‑related experience.
• Bachelor’s degree in a related field required;
  Master’s preferred.
• Previous leadership experience preferred.
• Advanced proven experience in Azure Databricks (Workspace management, clusters, jobs, Unity Catalog, Delta Lake, user access, APIs, SDKs).
• Knowledge of MLFlow & MLOps.
• Deep understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking.
• Experience with CI/CD pipelines (Azure Dev Ops preferred).
• Strong programming skills in SQL, Python, and/or PySpark.
• Advanced to expert knowledge of general Financial Services or Banking preferred.
• Advanced proven experience in leading cross‑functional teams and managing multiple projects simultaneously.
• Advanced ability to see the big picture and align projects with organizational goals. Capable of leading and motivating cross‑functional teams. Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level.
• Advanced communication skills, excellent teamwork experience, ability to mentor and develop more junior engineers.
• Occasional travel might be required.

We offer all the important things you’d want – competitive salaries, an ownership stake in the company, medical and dental insurance, time off, a great 401k matching program, tuition assistance, an employee volunteer program, and a wellness program. In addition you’ll have the opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands‑on experience to help grow your career!

Western Alliance Bank is a wholly owned subsidiary of Western Alliance Bancorporation. Alliance Bank of Arizona, Alliance Association Bank, Bank of Nevada, Bridge Bank, First Independent Bank, and Torrey Pines Bank are divisions of Western Alliance Bank;
Member FDIC. Ameri Home Mortgage is a Western…