Azure Data Engineer – Azure Data Factory; ADF), Azure Databricks, PySpark Lake

Senior Azure Data Engineer – Azure Data Factory (ADF), Azure Databricks, PySpark & Delta Lake

Location:

1 Robert Speck Parkway, Mississauga (Hybrid – 3 days/week in office)

Contract Duration: 12+ Months

Experience

Required:

8+ Years

Seeking a highly skilled Senior Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, PySpark, Delta Lake, and enterprise‑scale data engineering frameworks.

• Design, develop, orchestrate, and implement enterprise-scale data ingestion and transformation pipelines using Azure Data Factory (ADF) and Azure Databricks.
• Build scalable data engineering solutions using PySpark, Delta Lake, and SQL.
• Develop and maintain Bronze, Silver, and Gold data layers.
• Optimize data pipelines for performance, scalability, and reliability.
• Implement data engineering best practices and support SDLC activities.
• Collaborate with architecture, Dev Ops, security, and business teams.
• Support cloud integration, monitoring, governance, and enterprise data architecture initiatives.

• Azure Data Factory (ADF)
• Azure Databricks
• Py Spark
• Delta Lake
• SQL
• Enterprise-scale data ingestion and transformation pipelines
• Performance tuning and optimization
• Bronze, Silver, and Gold data layer development
• Azure Data Engineering
• Azure Event Hub
• Azure Data Lake Storage (ADLS)
• Azure Key Vault
• Azure Synapse Analytics
• CI/CD
• Azure Dev Ops
• Monitoring and governance
• Enterprise data architecture
• SDLC

• Databricks AI Security Framework (DASF)
• Enterprise data governance
• Azure Monitor
• Log Analytics
• Data lineage and observability frameworks
• Financial Services or other regulated industry experience
• Architecture evaluations
• Proof of Concept (POC) development

• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
• Azure Data Engineer Associate and/or Databricks certifications preferred.