Azure data factory developer Snowflake exp

6+ years of ADF data flows/Snowflake. if you just worked on ADF pipelines, this is not for you.

An Azure Data Factory (ADF) Integration Developer is responsible for building, maintaining, and optimizing data pipelines and integration solutions using Microsoft Azure Data Factory. This role is key in data engineering and ETL (Extract, Transform, Load) processes in a cloud-based environment.

Key Responsibilities:

Design and Develop Data Pipelines

Build end-to-end data workflows using ADF (v2) for batch and real-time data processing.

Create and manage Linked Services, Datasets, Pipelines, Activities, and Triggers.

Data Integration

Integrate data from multiple sources like SQL Server, Azure Blob Storage, Azure Synapse, REST APIs, SAP, Salesforce, etc.

Handle structured and unstructured data using Data Flows, Mapping Data Flows, or custom transformations.

ETL/ELT Development

Implement data transformations using Azure Data Flows, Stored Procedures, or Azure Functions.

Optimize performance and cost using best practices.

Monitoring and Troubleshooting

Set up pipeline monitoring, alerts, and logs using ADF Monitoring and Azure Monitor.

Debug failures and optimize pipeline performance.

CI/CD and Dev Ops

Use Azure Dev Ops or Git integration for version control, build, and release pipelines.

Implement ARM templates for infrastructure as code (IaC).

Security and Governance

Manage access through Azure RBAC, Key Vault, and Managed Identity.

Ensure compliance and data security standards.

Collaboration

Work closely with Data Architects, Business Analysts, and BI developers.

Translate business requirements into technical solutions.

️ Required Skills and Technologies:

Azure Data Factory

Azure Synapse Analytics, Azure SQL

This is a remote position.