Senior Data Engineer

Job Details

Job Location:

MBI TN - Loudon, TN 37774

The Senior Data Engineer designs, builds, and supports the data pipelines, integrations, and platform capabilities that power Malibu Boats, Inc.’s business applications, manufacturing operations, dealer ecosystem, analytics, and enterprise reporting.

This is a hands‑on senior engineering role that bridges MBI’s current SQL‑based environment with its modern Microsoft Fabric data platform. The Senior Data Engineer will maintain the reliability of business‑critical production integrations while progressively modernising legacy ETL, stored procedures, linked‑server processes, and middleware workflows.

The ideal candidate combines strong SQL and production‑support experience with modern cloud data engineering skills, including Microsoft Fabric, lakehouse architecture, Python, PySpark, Delta Lake, APIs, and automated deployment practices. Success requires technical depth, practical judgment, end‑to‑end ownership, and the ability to collaborate effectively across a fast‑moving organization.

• Design, develop, test, deploy, and operate scalable ETL/ELT pipelines within Microsoft Fabric or a comparable cloud data platform.
• Build and maintain Fabric lake houses, warehouses, Data Factory pipelines, notebooks, SQL analytics endpoints, and related platform components.
• Develop PySpark and Delta Lake solutions supporting full loads, incremental processing, merge/upsert patterns, partitioning, and schema evolution.
• Apply medallion architecture principles, preserving source fidelity in Bronze, creating validated and conformed data in Silver, and delivering business‑ready datasets through Gold.
• Build pipelines using reusable, version‑controlled Python components rather than embedding complex business logic entirely within notebooks.
• Implement watermark‑based incremental loading, write‑back‑on‑success controls, checkpointing, and idempotent processing so pipelines can be safely restarted or rerun.
• Design data models and transformation patterns that balance source‑system fidelity, enterprise consistency, performance, and business usability.

• Build and support bidirectional integrations between the enterprise data platform and operational systems, including ERP, CPQ, CRM, dealer portals, internal applications, vendor platforms, and third‑party SaaS solutions.
• Develop integrations using REST APIs, webhooks, SFTP, JSON, flat files, scheduled exports, middleware, and database‑based interfaces.
• Support operational write‑back scenarios such as ERP transactions, CRM updates, dealer‑system exchanges, and downstream application feeds.
• Design integrations with appropriate transactional boundaries, correlation identifiers, retry logic, reconciliation, auditability, and delivery confirmation.
• Account for the different performance, latency, validation, and recovery requirements of analytical pipelines and operational integrations.
• Implement secure connectivity using service principals, managed identities, Azure Key Vault, on‑premises data gateways, and other approved security patterns.

• Develop, optimise, and troubleshoot complex SQL queries, stored procedures, views, database objects, SQL Agent jobs, and production ETL processes.
• Maintain and safely modify existing data solutions, including unfamiliar or insufficiently documented code.
• Support linked servers and cross‑system queries while identifying their performance, security, and reliability limitations.
• Operate and troubleshoot existing middleware and iPaaS workflows, such as Workato, including error resolution, record reprocessing, and changes required by source or target systems.
• Support batch‑processing solutions and file‑based integrations using SFTP, CSV, Excel, and other standard enterprise formats.
• Plan data extraction around production OLTP workloads, considering locking, resource utilisation, operational schedules, and system performance.
• Apply a modernisation mindset to legacy support: stabilise the process, document its business purpose and dependencies, and prepare it for…