PURPOSE
As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines that support data migration, analytics, business intelligence functions, and integration with Microsoft Dynamics 365 (D365) applications. You will work closely with analysts and business stakeholders to ensure that data flows seamlessly through the organization and is ready for analysis.
KEY RESPONSIBILITIES AND ACCOUNTABILITIES
The responsibilities of this position include, but are not limited to the following:
Data Engineering & Integration:
o Design, develop, and maintain ETL (Extract, Transform, Load) pipelines to ensure smooth, efficient processing of large datasets, including data integration from Microsoft Dynamics 365 (D365) and other systems.
o Build and optimize data architectures, including data lakes, data warehouses, and data marts, with specific attention to integrating data from D365.
o Ensure data consistency, quality, and availability for analytics use cases and business reporting, particularly focusing on D365-related datasets.
o Collaborate with cross-functional teams to define data requirements and help implement data solutions, particularly with regards to integrating and analyzing data from D365.
• Data Infrastructure:
o Develop scalable data solutions to handle high-volume, high-velocity data processing, including D365-related data.
o Implement and manage cloud-based data environments (Azure, GCP, AWS) and ensure their security, scalability, and reliability.
o Optimize data storage, retrieval, and processing for performance and cost efficiency, particularly for D365 integration scenarios.
• Data Governance & Security:
o Establish data governance practices to ensure data quality, integrity, and security, especially regarding sensitive data from D365.
o Maintain compliance with data privacy regulations (such as GDPR) and best practices when dealing with data from D365 and other integrated systems.
• Collaboration & Communication:
o Work closely with data analysts, business analysts, and product managers to ensure that data infrastructure meets business needs, particularly as it relates to D365 data.
o Communicate data-related issues and updates clearly to both technical and non-technical stakeholders, with a focus on data from D365.
TECHNICAL/PROFESSIONAL COMPETENCIES
• Bachelor’s degree (or equivalent) in Computer Science, Engineering, Mathematics, or a related field.
• Proven experience as a Data Engineer, with a strong understanding of data engineering principles.
• Proficiency in programming languages like Python, Hadoop, SQL, Java, and/or Scala.
• Experience with ETL frameworks and data processing tools such as Apache Spark, Hadoop, or similar.
• Experience with Microsoft Dynamics 365 (D365) integration, data management, and data pipeline development.
• Strong understanding of cloud platforms (Azure, GCP, AWS) and cloud-based data storage solutions (e.g., Redshift, Big Query, etc.).
• Knowledge of database technologies (SQL and No
SQL).
• Familiarity with version control tools (e.g., Git) and agile development processes.
PREFERRED QUALIFICATIONS
• Experience with data orchestration tools.
• Familiarity with D365 APIs and connectors for data extraction and integration.
• Experience with data containerization and cloud infrastructure automation.
• Knowledge of data pipeline testing, monitoring, and debugging practices.
• Familiarity with data security, encryption, and privacy best practices
Participate in technical meetings and discussions with internal and external teams. Collaborate on complex data architectures and cloud integrations requiring strong English proficiency to ensure effective communication and project success.
Data Protection Policy:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search: