Azure Data Engineer

** this is a hybrid, office based position working at our ellis preserve office located in newtown square, pa.*
* ** we will not consider remote candidates!*
* ** role overview*
* The  
** azure data engineer
** designs, builds, and optimizes large scale cloud data solutions on microsoft azure. The role requires deep hands on expertise with modern ingestion frameworks to ingest diverse data sources, on distributed compute, real-time streaming, and dimensional modeling, combined with agile delivery practices.

** work arrangement:*
* + this is a hybrid, office based position working in our ellis preserve office located in newtown square, pa.  Core offcie days are tuesday, wednesday, and thursday.

** responsibilities*
* +  
** architecture & implementation:
** design and implement scalable engineering solutions using azure data factory, azure databricks, azure event hubs, kafka, hvr, snowflake, and azure data lake storage

+  
** pipeline development:
** build robust etl/elt pipelines for batch and streaming workloads using pyspark and sql, ensuring fault tolerance, schema evolution handling, and idempotency

+  
** real time integration:
** design and operate event driven ingestion and processing using event hubs and kafka, and integrate cdc solutions using hvr

+  
** performance optimization:
** tune databricks jobs and clusters (cluster sizing, autoscaling, caching, partitioning, shuffle optimization, delta lake optimizations) to meet slas and cost targets

+  
** devops & ci/cd:
** use azure devops for backlog management, git workflows, yaml pipelines, automated testing, and repeatable deployments across environments

+  
** code quality & mentorship:
** perform code reviews, enforce coding standards and best practices, and mentor junior developers to raise team capability

+  
** stakeholder collaboration** : work with product owners, data scientists, analysts, and architects to translate business requirements into prioritized user stories and deliverables in agile sprints

+  
** identify, design, and implement internal process improvements:
** automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

+ identify and tackle issues concerning data management to improve data quality

+ understand and implement best practices in management of data, including master data, reference data, metadata, data quality and lineage

** education and experience*
* + bachelor's degree in computer science, information systems, software engineering

+  
** technical:
** hands on experience with azure data factory (4+ years), azure databricks (4+ years), hvr (2+ years), kafka (4+ years), event hubs (2+ years), snowflake (4+ years), azure data lake storage, pyspark (8+ years), and sql (8+ years)

+  
** modeling:
** expertise in dimensional modeling, scd implementation, and data warehouse best practices

+  
** agile delivery:
** proven experience delivering data projects in agile (scrum or kanban) teams

+  
** devops:
** practical experience with azure devops for ci/cd, branching strategies, and pipeline automation

+  
** performance:
** demonstrated ability to profile and optimize databricks jobs and large scale data processing workloads

+  
** leadership:
** track record of conducting code reviews, providing technical guidance

+  
** communication:
** clear communicator able to present technical tradeoffs to technical and non technical stakeholders

+ experience with collibra data governance features

+ familiarity with mlops patterns and integrating data platforms with ml pipelines

+ azure certifications such as dp 700, az 400, or databricks data engineer certification

+ prior work with cost optimization and observability tools for cloud data platforms

+ practical experience applying gen ai (llms, embeddings, retrieval augmentation) to data engineering workflows

** other skills*
* + problem solving: analytical approach to diagnose performance and data quality issues

+ collaboration: strong team player who partners effectively across product, analytics, and platform teams

+ mentorship: patient, constructive coach who elevates code quality and engineering practices

+ adaptability: comfortable with shifting priorities and…