Cloud Engineer Azure Databricks

Role Summary

A Bachelor’s or Higher Degree is the minimum entry required for the position

Location:
Toronto, ON

Job Type: Full time

To set clear expectations about how this position divides from adjacent teams:

• Production ETL/ELT pipeline development and Spark transformation work sit with the data engineering team.
• Model development, training, and tuning sit with the data science team.
• Dimensional modeling, dbt development, and BI/semantic layer work sit outside this role.
• Day to day Databricks administration is handled by a dedicated team; this role provides the standards, architecture, and senior technical partnership behind it.

• Experience:
  
  6+ years in cloud infrastructure or platform engineering, with at least 4 years focused on Microsoft Azure.
• Terraform:
  Expert level, hands on. You have authored and maintained production Terraform modules, managed remote state, and run infrastructure as code through CI/CD. This is a core daily skill in this role.
• Databricks Administration:
  Demonstrable hands on administration experience â€
  ¿ account and workspace administration, Unity Catalog, cluster policies, identity federation, and cost governance. You should be able to describe administrative decisions you have made and explain the tradeoffs behind them.
• Technical Partnership: A track record as a senior technical resource to adjacent teams, including guiding stakeholders from an initial request to the underlying requirement and building consensus around the recommended approach.
• Azure Networking & Security:
  Deep working knowledge of private endpoints, VNets and hub spoke design, NSGs, Entra , managed identities, RBAC, and Key Vault.
• Data Lake Architecture: ADLS Gen2 design and access control at enterprise scale.
• Azure Data Factory:
  Platform side experience with integration runtimes, managed VNet, credential management, and deployment automation.
• Automation & Scripting:
  Strong Python, plus Power Shell and/or Bash, for platform tooling and automation.
• Spark & SQL Literacy:
  Sufficient working knowledge to diagnose infrastructure and configuration level performance issues and engage credibly with data teams. Spark development depth is not a requirement for this role.

• Databricks Asset Bundles, the Terraform Databricks provider, and workspace as code patterns
• Experience leading a Unity Catalog migration or multi workspace consolidation
• Azure Machine Learning, MLflow, or model serving infrastructure experience
• Kubernetes / AKS and containerized workloads
• Policy as code Azure Policy, OPA, Sentinel, or Checkov
• Event driven infrastructure Event Hubs, Kafka, or Stream Analytics
• Formal Fin Ops practice experience
• Multi region or multi tenant Databricks deployments

• Databricks Certified Data Engineer Professional, or a Databricks platform administrator credential
• Microsoft Certified:
  Azure Solutions Architect Expert (AZ 305)
• Microsoft Certified:
  Azure Administrator Associate (AZ 104)
• Microsoft Certified:
  Dev Ops Engineer Expert (AZ 400)
• Hashi Corp Certified:
  Terraform Associate

Fulltime:
The pay range for this role is CAD $100,000 - CA $120,000 per annum including any bonuses or variable pay.

Tech Mahindra also offers benefits like

• medical
• vision
• dental
• life
• disability insurance
• paid time off (including holidays, parental leave, and sick leave, as required by law)

The exact offer terms will depend on the skill level, educational qualifications, experience and location of the candidate.

“AI tools may assist in the recruitment process; however, all hiring decisions are made by the recruitment team based on a comprehensive evaluation of candidates.