Azure Integration Developer

About the Role

We are seeking a Senior Azure Data Integrations Engineer to support the development and operation of enterprise-scale data integration pipelines within Microsoft Azure. This is a hands‑on engineering role focused on building, maintaining, and supporting reliable data ingestion and transformation pipelines that enable analytics and reporting use cases in a large‑scale infrastructure environment. The role emphasizes strong execution, production support readiness, and collaboration with analytics, BI, and platform teams.

• Design & Build: Create and maintain data ingestion pipelines using Azure Data Factory (ADF) to move data from enterprise systems, APIs, and files into Azure Data Lake Storage Gen2 and Databricks.
• Ingestion Patterns: Implement batch and near‑real‑time ingestion patterns, including incremental processing, retries, error handling, and schema changes.
• Efficiency: Support reusable and parameterized ingestion patterns to efficiently onboard new data sources.
• Data Processing & Analytics Enablement
• Transformations: Develop and maintain data transformations using Databricks (Spark / PySpark) and Delta Lake.
• Architecture: Apply Medallion architecture concepts (Bronze / Silver / Gold) to organize raw, refined, and curated datasets.
• Collaboration: Support curated datasets consumed by analytics tools (Power BI, Sigma) and collaborate with BI teams to optimize data structures for reporting.
• Platform Operations & Environment Management
• Dev Ops: Support Dev/Test/Prod environment separation and participate in CI/CD processes for promoting ADF pipelines and Databricks notebooks.
• Deployment: Assist with deployment validation, configuration updates, and rollback procedures.
• Security, Governance & Reliability
• Security: Follow secure access practices using managed identities, service principals, Azure Key Vault, and RBAC.
• Reliability: Monitor pipeline execution, troubleshoot failures, and provide production support to ensure data quality and performance.

• Experience: 7+ years in data engineering, cloud data integration, or analytics platform development.
• Core Tech Stack:
• Azure Data Factory (ADF): Deep expertise in pipeline development and orchestration.
• Azure Databricks: Strong experience with Spark / PySpark and Delta Lake.
• Storage: Proficiency with Azure Data Lake Storage (ADLS Gen2).
• Languages: Strong SQL skills and working knowledge of Python for data transformations.
• Architecture: Familiarity with Medallion or Lakehouse‑style architectures.
• Ops: Understanding of CI/CD concepts in data platforms and experience working in enterprise production environments.

• Experience with API‑based ingestion or event‑driven data flows.
• Exposure to data center, digital infrastructure, or large‑scale enterprise environments.
• Familiarity with Microsoft Fabric, Synapse, or Power BI.
• Azure certification (DP-203 or similar) is a plus.

Rate: $40/hour

We are committed to diversity and inclusivity in our hiring practices.