Senior Data Engineer - Corporate Intelligence Platform

Company Description

The Enterprise Business Systems team is building Epsilon's next-generation enterprise Corporate Intelligence Platform (CIP) on Databricks. CIP brings together critical data from HR, Finance, Product Development, Revenue Operations, Resource Planning, and other enterprise systems into a governed, enterprise-scale data foundation. The platform enables business leaders to leverage AI, analytics, dashboards, and Databricks Genie to make faster, smarter decisions using trusted corporate data.

The Enterprise Business Systems team is building Epsilon's next-generation enterprise Corporate Intelligence Platform (CIP) on Databricks. CIP brings together critical data from HR, Finance, Product Development, Revenue Operations, Resource Planning, and other enterprise systems into a governed, enterprise-scale data foundation. The platform enables business leaders to leverage AI, analytics, dashboards, and Databricks Genie to make faster, smarter decisions using trusted corporate data.

As a Senior Data Engineer, you will architect and build the foundational data platform that powers CIP. You will design scalable ingestion frameworks, implement Medallion Architecture patterns, establish data governance controls, build enterprise semantic models, and create certified data products consumed by executive dashboards, AI copilots, and business intelligence solutions.

This role reports to the MIS Engineering Director and partners closely with Product Management, Enterprise Architecture, Business Systems leaders, Data Architects, Data Analysts, AI Engineers, Platform Engineers, Product Owners, and business partners across Finance, HR, Sales, Revenue Operations, and Product Engineering. You will collaborate daily with Databricks platform specialists, source system owners, and cross-functional delivery teams to ensure successful delivery of CIP capabilities.

• Build Epsilon's Enterprise Data Foundation:
  Design and implement the strategic platform that centralizes enterprise intelligence across multiple business domains and serves as the long-term system of record for corporate analytics and AI.
• Lead Databricks Architecture at Scale:
  Drive architecture decisions across Delta Lake, Unity Catalog, Databricks Workflows, Delta Live Tables, semantic modeling, governance, and enterprise AI enablement.
• Solve Highly Visible Business Problems:
  Support executive initiatives around resource planning, product investment management, engineering cost transparency, sales operations, client profitability analysis, workforce planning, and enterprise reporting.
• Influence Platform Strategy:
  Play a key role in defining governance standards, certified metrics, enterprise taxonomies, semantic layers, and reusable data products that will be leveraged across the company.

• Build Enterprise Data Architecture:
  Design and implement scalable Bronze, Silver, and Gold data layers using Databricks and Delta Lake architecture patterns. Develop reusable ingestion frameworks, transformation pipelines, and governed data products that support enterprise reporting and AI initiatives.
• Deliver Enterprise Data Integrations:
  Build and manage ingestion pipelines from systems including HRIS, Jira, Salesforce, Finance platforms, Resource Forecasting systems, and additional enterprise applications.
• Establish Governance and Data Quality:
  Implement data quality monitoring, metadata management, lineage tracking, security classifications, masking strategies, governance controls, and certification processes to support trusted analytics and AI outcomes.
• Enable AI and Semantic Layers:
  Create semantic models, curated datasets, feature layers, and optimized data structures consumed by Databricks Genie, AI applications, executive dashboards, and self-service analytics platforms.

• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related technical discipline.
• 5+ years of experience building enterprise-scale data platforms and modern cloud-based analytics solutions.
• Deep expertise with Databricks, Delta Lake, Unity Catalog, and Medallion Architecture design patterns.
• Advanced proficiency using Python, SQL, and data engineering frameworks.
• Experience designing Bronze, Silver, and Gold layer architectures.
• Experience building enterprise ETL/ELT pipelines and scalable data ingestion frameworks.
• Strong data modeling skills including dimensional modeling, semantic modeling, canonical data models, and enterprise taxonomy design.
• Experience implementing data governance, metadata management, lineage tracking, and data quality frameworks.
• Working knowledge of cloud platforms, preferably AWS.
• Strong communication and stakeholder management skills with the ability to translate business requirements into scalable technical solutions.
• Ability to independently lead technical initiatives from architecture through…