Senior Azure Data Engineer
Listed on 2026-06-06
-
IT/Tech
Data Engineer, Data Analyst, Data Warehousing, Data Science Manager
Korn Ferry has partnered with our client on their search for Senior Azure Data Engineer
Company: Confidential
Location: Atlanta, GA (hybrid remote/onsite)
Purpose of the PositionThe Senior Azure Data Engineer role is focused on building and maintaining the scalable data foundation that powers enterprise reporting, analytics, and business decision-making across the organization.
At a high level, this person will serve as the bridge between raw operational data and trusted business insights—ensuring data from multiple systems is centralized, standardized, validated, and delivered in a way that supports reliable reporting and long-term scalability.
This is not simply a pipeline-development role — it is a strategic data engineering position focused on creating a governed, analytics‑ready data environment that enables consistency, transparency, and trust across the business. The role will play a key part in improving data quality, reducing reporting issues, and supporting a modern enterprise data platform built around Microsoft Fabric and Azure technologies.
Responsibilities- Design, build, and maintain scalable, reliable data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Warehouses, Notebooks).
- Ingest data from diverse sources (databases, APIs, files, SaaS platforms) into centralized data platforms.
- Implement efficient batch and incremental data processing patterns.
- Monitor, troubleshoot, and optimize pipeline performance, reliability, and cost.
- Cleanse, transform, and standardize data across multiple systems to establish consistent definitions and metrics.
- Engineer curated, analytics‑ready datasets for reporting, dashboards, and downstream analytics tools.
- Apply data modeling best practices to support enterprise reporting and self‑service analytics.
- Implement data validation, reconciliation, and quality checks to ensure accuracy, completeness, and reliability.
- Partner with analytics and business teams to define and enforce data quality rules.
- Proactively identify and remediate data issues before they impact reporting.
- Manage and mitigate schema drift across pipelines and datasets.
- Build and maintain data catalogs, including business‑friendly metadata, descriptions, and ownership.
- Enable and maintain data lineage to provide transparency into data sources, transformations, and downstream consumption.
- Support governance initiatives related to data standards, auditability, and compliance.
- Collaborate with IT, BI developers, analysts, and stakeholders to align system knowledge and data requirements with scalable, enterprise‑grade solutions.
- Contribute to data engineering best practices, standards, and documentation.
- 5+ years of experience as a Data Engineer or in a similar role.
- Strong experience with Azure data services, with hands‑on expertise in Microsoft Fabric.
- Familiarity with medallion (bronze/silver/gold) data architecture patterns.
- Proven experience designing and maintaining end‑to‑end data pipelines.
- Solid SQL and Python skills and experience with data transformation and modeling.
- Experience handling schema evolution and schema drift.
- Hands‑on experience with data quality validation and reconciliation processes.
- Demonstrated experience in data governance concepts such as cataloging, metadata, and lineage.
- Strong problem‑solving skills and attention to detail.
- Experience with CI/CD, version control, and infrastructure‑as‑code in data platforms.
- Knowledge of data security, access controls, and compliance requirements.
- Experience working in an Agile or Dev Ops environment.
- Reliable, well‑documented pipelines delivering trusted, standardized data.
- Clear visibility into data lineage, ownership, and quality.
- Reduced data issues impacting reporting and analytics.
- A scalable, governed data platform that supports current and future business needs.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).