Data Engineer

General Summary

The Data Engineer is responsible for supporting enterprise data integration initiatives, with tasks including ETL pipelines, data warehousing, on‑premises databases (such as SQL Server and DB2), Microsoft Fabric, Microsoft Dataverse (particularly Dynamics CE), message brokers, data governance, data orchestration, and master data management (MDM). The role also includes programming duties involving the analysis, design, development, and maintenance of solutions to address various business problems or components of more complex systems.

This position helps ensure that data remains consistent, high‑quality, and accessible across customer‑facing, operational, and internal business systems.

• CRM Integration (Microsoft Dynamics CE)
• Designs and maintains data pipelines to ingest, transform, and synchronize data between internal systems and Microsoft Dataverse.
• Enriches CRM data with policy, claims, billing, and customer interaction data from various sources.
• Collaborates with CRM administrators and business teams to support reporting, segmentation, customer lifecycle automation, and customer data enrichment.
• ETL Development and Support
• Builds and optimizes ETL workflows using tools such as SSIS and Azure Data Factory.
• Automates data ingestion from structured and unstructured sources including APIs, flat files, JSON, images, and databases.
• Data Warehousing
• Designs and maintains enterprise data warehouse solution.
• Implements dimensional modeling, medallion architecture, and delta storage to support analytics and BI reporting.
• Builds and manages Lake houses for unified storage and analytics.
• On‑Premises Databases
• Collaborates with DBAs to implement mirroring, replication, and synchronization between on‑premises databases and data warehouse, Dataverse, and analytics platform.
• Monitors and mitigates ETL and replication impact on on‑premises databases.
• Data Governance and Master Data Management (MDM)
• Establishes MDM initiatives to ensure consistent and accurate customer data across systems.
• Defines and maintains data governance policies, standards, and procedures.
• Programming
• Works with application users on projects to identify new program needs, boundaries and priorities of system development projects.
• Formulates logic to meet needs and prepares specifications for desired programs.
• Designs and codes complex solutions using various languages and technical techniques.
• Tests and debugs programs.
• Interacts with users to ensure software produces desired results and puts results into production.
• Reviews, analyzes and modifies existing systems and programs in order to incorporate complex changes in user requirements and innovations in computer processing capabilities.
• Serves as a resource for related user questions.
• Troubleshoots and fixes more complex problems.
• Maintains knowledge of current trends and developments in the field through reading relevant publications, attending conferences and seminars, and participating in related networking opportunities.

• Normal office working conditions.
• Sitting for extended periods of time.
• Continuous use of the computer and fatigue associated with computer work.
• Stress associated with meeting deadlines.

• Strong understanding of data governance, privacy and compliance (GDPR).
• Excellent communications and collaboration skills across technical and business teams.

• Bachelor’s Degree in data or computer science, Information Systems, or related field.
• Minimum of three (3) years of experience in data engineering, preferably in the insurance or financial services fields.
• Experience and proficiency in SQL, Python, PySpark, Notebooks, and ETL tools (SSIS, Azure Data Factory).
• Experience with cloud data platforms (Azure, Fabric).
• Experience or familiarity with BI tools, preference to SAS Viya or Power BI.
• Experience or familiarity with Data Governance and MDM tools and practices.
• Preferred experience and knowledge with:
  • Microsoft Dataverse data structures and Dynamics CE integration.
  • Data publishing (REST APIs, Webhooks, Azure Functions, Event Grid).
  • Insurance data domains (policy, claims, billing, agencies, customer service).

• Limited supervision with choice in selection, development, and coordination of methods to use.
• Generally, develops own methods to perform work.

• None

Mid‑Senior level

Full‑time

Information Technology

Insurance