Senior Data Engineer – Databricks & SQL

Overview

We are seeking a skilled Databricks professional with strong analytical capabilities to support a short-term migration initiative. The project involves analyzing the current and future state of data migration to Databricks and reviewing core business warehouse solutions in MARC and MLMC (Product).

• Conduct a comprehensive analysis of the existing data warehouse architecture and future migration strategy to Databricks.
• Review and assess core business warehouse solutions in MARC and MLMC.
• Understand and align with the Standard Assurance Agreement and One Essential documentation.
• Collaborate with ITPM and Business Owners to ensure process alignment and documentation compliance.
• Provide insights and recommendations to optimize data workflows and analytics post-migration.

• Proven expertise in Databricks, Microsoft SQL Server and Unity catalog
  .
• Strong analytical skills with experience in data migration and transformation projects.
• Familiarity with enterprise data warehouse environments and business intelligence tools.
• Ability to interpret and align with compliance and assurance documentation.
• Excellent communication and stakeholder engagement skills.

• Comprehensive knowledge of Databricks internals, including RDDs, DLT, and Delta Lake. Expertise in Databricks Workflows, data access control management, lineage, auditing, and CI/CD processes.
• Prior involvement in short-term, high-impact migration projects.