Senior Azure Data Engineer - Big Data, Hadoop, Lakehouse Architecture

Job Description

Essential

Skills:

· Data Engineering

· Big Data and Hadoop Ecosystems

· Microsoft Azure

Role

Description:

· Requires experience in:
Hadoop, Rahona, Synapse, Data Analytics, Lakehouse architecture and Databricks.

· Design, build and maintain scalable data solutions on Microsoft Azure.

· Develop and manage data pipelines using Azure Data Factory, Databricks and related services.

· Implement data storage solutions such as Azure Data Lake, Azure SQL Database and Cosmos DB.

· Ensure data quality, security and compliance across all Azure data platforms.

· Perform data integration, transformation and migration tasks from various sources to Azure.

· Monitor, troubleshoot and optimize data workflows for performance and cost efficiency.

· Collaborate with data architects, analysts and business stakeholders to understand data requirements.

· Automate data processing and reporting tasks using Azure tools and scripting languages.

· Document data processes, architectures and best practices.

· Stay updated with the latest Azure data services and recommend improvements or new technologies as needed.

Experience

Required:

6-8

Requirements
Essential

Skills:

• Data Engineering
• Big Data and Hadoop Ecosystems
• Microsoft Azure Role

Description:

• Requires experience in:
Hadoop, Rahona, Synapse, Data Analytics, Lakehouse architecture and Databricks.
• Design, build and maintain scalable data solutions on Microsoft Azure.
• Develop and manage data pipelines using Azure Data Factory, Databricks and related services.
• Implement data storage solutions such as Azure Data Lake, Azure SQL Database and Cosmos DB.
• Ensure data quality, security and compliance across all Azure data platforms.
• Perform data integration, transformation and migration tasks from various sources to Azure.
• Monitor, troubleshoot and optimize data workflows for performance and cost efficiency.
• Collaborate with data architects, analysts and business stakeholders to understand data requirements.
• Automate data processing and reporting tasks using Azure tools and scripting languages.
• Document data processes, architectures and best practices.
• Stay updated with the latest Azure data services and recommend improvements or new technologies as needed. Experience

Required:

6-8