Data Engineer

Job Overview

As an Azure Data Engineer on our team, you will be responsible for managing and assessing complex new data sources from both SAP and non‑SAP systems, transforming them into business‑ready data sets. You will engage in new scope and requirements, break‑fix tasks, testing, and support activities to meet business needs. Implementing processes that ensure high‑quality and sustainable solutions will be a key aspect of your role.

• Partner with the product owner, scrum master, and solution architect to deliver solutions.
• Understand business requirements and translate them into technical solutions.

• Review and analyze business requirements.
• Design and govern the implementation of technical solutions.

• Work with internal and external implementation teams and partners to develop, test, and deploy solutions.
• Adhere to software development and maintenance standards, maintaining knowledge of best practices.

• Estimate and deliver multiple project assignments and system change requests within agreed timelines and quality standards.

• Conduct detailed analysis of structured, semi‑structured, and unstructured data sources for quality, completeness, and business value.
• Govern and implement robust data pipelines using the Microsoft toolset and Databricks.
• Create reusable and scalable data pipelines.

• Expertise in Azure Stream Analytics is desirable.
• Knowledge of Scala is desirable.
• Strong analytical skills for working with unstructured datasets.

• Expertise in data ingestion, processing, and analytical pipelines for big data, relational/non‑relational databases, and data warehouse solutions.
• Experience in designing and developing cloud‑based analytics solutions.
• Proficiency in designing and developing warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.
• Ability to build workflows using data from various sources, including on‑premises databases, external data sources, REST APIs, and harvesting tools.
• Essential knowledge of Dev Ops processes, including CI/CD and Infrastructure as Code.
• Hands‑on experience with Agile software development.
• Thorough understanding of Azure/AWS Cloud Infrastructure offerings.
• Over 8 years of experience with Azure and Databricks.
• At least 5 successful implementations of analytics capabilities on the Azure platform, from conceptualization to delivery.
• Bachelor’s degree in Computer Science or a related field.
• Knowledge of SAP IS‑Auto, SAP FICO, SAP BW/BO, Tableau, Power BI, and Scala is an added advantage.
• Certification in Azure platform toolsets is an added advantage.