Data Engineer; MCC

Title:

Senior Data Engineer

Location:

Carmel, IN

Contract to Hire

We are seeking a highly skilled Data Engineer with expertise in Microsoft Fabric, Python, and business intelligence, along with a strong background in data engineering, analytics, and cloud solutions. This role is critical in designing, optimizing, and maintaining scalable data pipelines, ensuring efficient data processing and integration across business systems. You will collaborate with cross‑functional teams to enhance data accessibility, automation, and analytics‑driven decision‑making.

• Design, build, and optimize Fabric Pipelines for seamless data movement, transformation, and automation.
• Implement Fabric Data Factory workflows for ETL orchestration, ensuring performance, scalability, and efficiency within a Fabric-driven ecosystem.
• Architect Lakehouse structures using Fabric’s Bronze, Silver, and Gold Medallion methodology for organized, high-quality data processing.
• Develop warehouse best practices, ensuring optimal data partitioning, indexing, and retrieval strategies.
• Ensure data integrity, security, and governance through Microsoft Purview and Fabric compliance frameworks.
• Optimize query performance within Lakehouse and Warehouse environments, leveraging Delta Lake & SQL engines for efficient data access.
• Integrate APIs and external systems to enhance interoperability, automation, and data accessibility across Fabric environments.
• Collaborate with business leaders and engineering teams to drive data-driven decision-making and automation.
• Stay ahead of emerging trends in Microsoft Fabric, cloud-native data processing, and AI-enhanced analytics.

• Bachelor’s or master’s degree in computer science, Data Engineering, Business Intelligence, or related fields.
• Minimum experience requirements:
  At least one year of relevant experience with a master’s degree or three years with a bachelor's degree in data engineering, analytics, or cloud data management.
• Expertise in Microsoft Fabric, Medallion Architecture, Fabric Data Factory, and Lakehouse design principles.
• Strong proficiency in Python, SQL, Power Query, and Delta Lake management.
• Experience designing and managing data models optimized for efficient processing within cloud environments.
• Solid understanding of cloud computing, Dev Ops, and containerization (Docker, Kubernetes).
• Excellent problem‑solving and analytical skills, ensuring scalable, automated, and highly performant data systems