Senior Azure Data Engineer
Job in
Plano, Collin County, Texas, 75086, USA
Listing for:
Yoh, A Day & Zimmermann Company
Full Time
position
Listed on 2026-11-22
Job specializations:
-
IT/Tech
Job Description & How to Apply Below
Own enterprise-grade lakehouse data engineering on Azure, building and optimizing scalable ETL/ELT pipelines with Azure Databricks.
Responsibilities- Design and build scalable ETL/ELT pipelines using Azure Databricks with Py Spark and Spark SQL
- Develop ingestion workflows from multiple source systems into Bronze/Silver/Gold layers (e.g.,
Event Hub
, APIs
, Azure SQL
, Blob Storage
) - Apply best practices for Delta Lake and Unity Catalog
, including schema evolution
, versioning
, and governance - Optimize pipeline performance and cost using partitioning, caching, clustering, and Spark tuning
- Integrate Databricks with key Azure services including ADLS Gen2
, Azure Data Factory (ADF),
Azure Synapse
, Event Hub
, Key Vault
, and Azure Dev Ops - Implement secure access controls using managed identities
, RBAC
, and data protection practices such as masking - Collaborate with analytics and business teams to deliver trusted datasets
, metrics, and KPIs - Provide technical leadership through mentoring
, code reviews
, and architectural guidance - Work with enterprise architecture and security teams to align data solutions with data privacy/security policies
- Implement data quality checks
, alerting
, and lineage tracking using tools such as Great Expectations
, Unity Catalog
, and data observability platforms - Build monitoring dashboards, alerts, and recovery mechanisms for critical pipelines
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
- 5+ years of data engineering experience
- 3+ years with Azure Databricks / Apache Spark using Py Spark
- Strong experience with Delta Lake
, Unity Catalog
, Databricks notebooks
, and SQL-based warehousing patterns - Hands‑on experience with ADLS Gen2
, Event Hub
, ADF
, Key Vault
, and Synapse - Strong coding skills in Python and SQL
; Scala is a plus - Understanding of data modeling for OLTP/OLAP
, star/snowflake schemas
, and performance tuning - Experience implementing CI/CD for Databricks using Databricks CLI
, Terraform
, and/or Azure Dev Ops - Databricks certification (e.g.,
Databricks Certified Data Engineer Professional
) - Experience with streaming/real‑time pipelines using Structured Streaming and Event Hub (Kafka experience is referenced)
- ML platform exposure (e.g.,
MLflow or supporting ML pipelines) - Reporting/consumption layer experience such as Power BI
, Purview
, or Microsoft Fabric - Knowledge of governance/compliance standards including GDPR
, HIPAA
, and SOC2 - Must currently reside in the Dallas–Fort Worth (DFW) area and be able to work a hybrid schedule in Plano, TX
- Relocation is not available
- Candidates must be authorized to work in the United States without sponsorship now or in the future
- Azure Databricks
- PySpark, Spark SQL
- Delta Lake, Unity Catalog
- Python, SQL, Scala
- ADLS Gen2
- Azure Data Factory (ADF)
- Azure Synapse
- Event Hub
- Key Vault, Azure Dev Ops
- Managed identities, RBAC, masking
- Great Expectations
- Data observability platforms
- Databricks notebooks, Databricks CLI
- Terraform
- Structured Streaming, Kafka
- MLflow
- Power BI, Purview, Microsoft Fabric
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- Met Life Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Location: Plano, TX (onsite)
Compensation: USD 105, per year
Position Requirements
10+ Years work experienceTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction