Senior Data Engineer

About the Role

Landmark Digital, part of the Landmark Group, is seeking a Senior Data Engineer to join their team in Dubai, United Arab Emirates. This role is crucial for designing, implementing, and optimizing data solutions within the Azure ecosystem. You will be instrumental in shaping the organization's data-driven journey, driving innovation through data analytics and insights, especially with a deep understanding of the retail domain.

• Responsible for the design, implementation, and optimization of data solutions as an expert Azure Data Engineer.
• Develop efficient ETL pipelines using Azure Data Factory and ensure data quality and storage via Azure Data Lake
  .
• Utilize proficiency in complex stored procedures within Azure Databricks to enable advanced analytics on data volumes exceeding 50TB.
• Collaborate cross-functionally to contribute to data-driven initiatives, leveraging Azure Synapse Analytics to provide actionable insights.
• Apply deep understanding of the retail domain to enhance data strategies and solutions for retail-specific challenges.
• Play a pivotal role in shaping the organization's data-driven journey, driving innovation through data analytics and insights.
• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage services (such as Azure Data Lake Storage
  , Azure SQL Database
  , etc.), data processing services (such as Azure Data Bricks
  , Azure Synapse
  , etc.) and data visualization (
  PowerBI
  , Qlik
  , etc.) & integration services (
  Data API builder
  , Logic Apps
  , etc.).
• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for continuous improvement.
• Collaborate with Dev Ops teams to automate deployment, configuration, and monitoring processes using Azure Dev Ops
  , Power Shell
  , or other relevant tools.
• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting new technologies or features to enhance the data platform.
• Document technical designs, procedures, and guidelines for data platform engineering and operations.

• Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.
• Proven 6-8 years experience in designing, implementing solutions on the Azure ecosystem including expertise in Azure services such as Azure Data Factory
  , Azure Databricks
  , Azure Machine Learning
  , Azure Data Lake Storage
  , Azure SQL Database
  , Azure Synapse
  , PowerBI etc.
• Proficiency in programming languages like Python
  , SQL
  , or Scala for data manipulation, transformation, and analysis.
• Expertise in data modelling, data warehousing, and data integration concepts.
• Sound knowledge of data governance practices, data quality management, and data security principles.
• Experience with big data technologies such as Apache Spark
  , Hadoop
  , or similar frameworks.
• Solid understanding of cloud computing concepts and experience with cloud infrastructure management and provisioning.
• Solid understanding of network security concepts and technologies (such as firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security concepts and technologies (such as access controls, encryption, observability, privacy laws/regulations, etc.).
• Experience in a Retail setup is preferred.
• Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect Expert is preferred.

The position will require someone with the following:

• Strategic Planning
• Communication and Collaboration
• Problem Solving Skills