Azure Data Engineer

Overview

Azure Data Engineer: As Azure Data Engineer you will be responsible for building and managing data pipelines on Microsoft Azure, integrating, transforming, and loading data for analytics using services like Azure Data Factory, Databricks, and Synapse, requiring strong SQL, Python, and cloud skills for creating reliable, scalable data solutions for analysts and scientists. The field is shifting towards Microsoft Fabric, a unified data platform, and demands expertise in big data, data modeling, and cloud architecture.

• Title: Azure Data Engineer
• Work Location: Weehawken, NJ 07086
• Contract duration: 12+ Months Contract
• Client: Infosys/Banking

• Build Data Pipelines:
  Design, develop, and maintain ETL/ELT processes to move and transform data.
• Data Transformation:
  Cleanse, map, and optimize data for analysis.
• Manage Data Stores:
  Work with data lakes, data warehouses (like Synapse), and databases.
• Automate Tasks:
  Deploy production code and automate data workflows.
• Collaborate:
  Support data scientists, analysts, and developers.

• Languages:
  
  SQL (essential for querying), Python (for scripting, PySpark).
• Azure Services:
  Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure Cosmos DB, Azure Dev Ops.
• Big Data:
  Apache Spark, Data Bricks, Hadoop (foundational knowledge).
• Concepts:
  Data Warehousing, Data Modeling, ETL, CI/CD.