Databricks Program Lead

Databricks:
Program Lead (Data Warehouse Migration)

The Databricks:
Program Lead owns end-to-end delivery of an enterprise data warehouse migration from Azure Synapse Analytics and Azure Data Factory to the Databricks Lakehouse Platform. This role directs multiple concurrent work streams — platform foundation, pipeline re-engineering, data migration and reconciliation, and BI/consumer cutover — running delivery through Agile ceremonies and tooling (Jira, Confluence, Azure Dev Ops) while serving as the primary technical and executive interface to client stakeholders.

• Owns the target-state Databricks Lakehouse architecture — Unity Catalog governance, medallion layering, Delta Lake table design, cluster and SQL warehouse sizing, and workspace topology across dev, test, and production. Experienced in full-cycle enterprise databricks implementation preferably in Azure environment.
• Directs the conversion of Azure Synapse dedicated SQL pool objects to Databricks — T‑SQL stored procedures, external tables, and distribution/partitioning strategies re‑engineered into Spark SQL, Delta tables, and Databricks Workflows
• Governs migration of Azure Data Factory pipelines to Databricks‑native orchestration (Workflows, Delta Live Tables, or Lakeflow Declarative Pipelines),
• Establishes the data migration and reconciliation approach — historical load strategy, row and aggregate validation, checksum testing, and dual‑run parallel operation until cutover sign‑off
• Defines CI/CD and environment promotion standards using Databricks Asset Bundles, Git‑based version control, and automated deployment pipelines
• Leads BI and consumer cutover planning for Power BI and downstream applications, including semantic model repointing, performance benchmarking against Synapse baselines, and query optimization
• Sets cost and performance guardrails — DBU consumption forecasting, Photon and serverless adoption decisions, autoscaling policies, and ongoing platform cost optimization
• Reviews and approves technical designs, code, and test evidence produced by engineering pods, resolving escalated architectural decisions
• Leads through influence across client and internal teams — sets delivery cadence, holds pods accountable, and drives decisions to closure without escalation
• Runs Agile delivery discipline in Jira — owns the program backlog and epic structure, enforces sprint planning, refinement, stand‑up, and retrospective rhythm, and keeps burndown, velocity, and dashboards credible
• Communicates with executive presence — translates technical migration risk into business impact for client sponsors and steering committees
• Manages conflict and competing priorities directly, negotiating scope and sequencing with stakeholders rather than absorbing schedule pressure

• Owns the program plan, budget, and resource model — forecasts burn against budget
• Manages scope formally — identifies change through the Jira intake path, quantifies impact, and drives change orders with the client rather than absorbing creep
• Runs program governance: steering committee cadence, RAID log ownership, status reporting, and stage‑gate sign‑offs for each migration wave

Headquartered in San Diego, CA truData is a technology services provider and a data‑oriented company specializing in data and analytics and integration offerings delivered through cloud solutions. We partner with clients in their Digital Transformation journey, ensuring improved consumer insight, reduced complexity whilst increasing revenues, and streamlined processes.

Every truData employee is unique. We each have our own diverse experience, and that’s what enables us to innovate and deliver excellence to our customers. At truData you will have a voice, you will be heard, and you will make a difference. Come join us!

At truData we embrace change and diversity. Our culture is based upon inclusivity, because when new perspectives are brought to the table, magic happens. Come join our team and help lets achieve greatness together.

Tru Data is proud to be an Equal Opportunity Employer