Lead Databricks Platform Engineer

Job Description

How You’ll Make an Impact

A subsidiary of Publicis Groupe, Epsilon powers data-driven marketing at massive scale for some of the world’s leading brands.

We’re hiring a Lead Databricks Administrator to own and evolve our Databricks platform across cloud environments. This is a high-impact role focused on driving platform standards, strengthening governance, and improving reliability across enterprise data systems. You’ll support large-scale Data Lake environments across AWS, Azure, and GCP, helping enable critical data operations for key clients.

• Lead and scale Databricks platform administration across enterprise work spaces and multi-cloud environments (AWS, Azure, GCP)
• Establish and enforce standards for workspace provisioning, access controls, compute configuration, and governance to improve platform consistency and stability
• Drive operational excellence by implementing repeatable processes, automation, and best practices across Databricks environments
• Strengthen platform reliability, performance, and cost efficiency through proactive monitoring, optimization, and issue resolution
• Partner cross-functionally with Engineering, Security, Cloud, and Operations teams to ensure secure, compliant, and scalable platform architecture
• Own and improve identity and access management practices (least privilege, group management, service principals, admin controls)
• Lead troubleshooting and resolution of complex issues across Databricks, cloud infrastructure, networking, and data workloads
• Evaluate and adopt new Databricks capabilities to enhance governance, scalability, and operational efficiency
• Build and maintain documentation, runbooks, and platform standards to support long-term maintainability and audit readiness
• Mentor team members and promote best practices to elevate overall platform maturity
• Support production operations, incident response, and ongoing platform health in a high-impact, enterprise environment

• BS in Computer Science or related technical discipline, or equivalent practical experience
• 7+ years of experience in data platform, database administration, or cloud infrastructure roles
• 3+ years of hands‑on experience administering Databricks (work spaces, clusters, jobs, SQL Warehouses, platform services)
• Strong expertise in:
  • Databricks workspace and account management
  • Platform governance, access controls, and administration best practices
  • Compute configuration, cluster policies, and workload optimization
  • Experience supporting Databricks across AWS, Azure, or GCP environments
• Hands‑on experience with infrastructure provisioning and automation (Terraform, APIs, scripting, CI/CD pipelines)
• Strong understanding of identity and access management:
  • SSO, SCIM provisioning, RBAC
  • Service principals, group management, least privilege models
• Working knowledge of Unity Catalog, data governance frameworks, and secure data access patterns
• Experience implementing and maintaining platform standards (naming conventions, provisioning workflows, configuration baselines, access controls)
• Proven ability to monitor, troubleshoot, and optimize platform performance, reliability, and cost efficiency
• Experience diagnosing issues across Databricks, cloud infrastructure, networking, identity, and data pipelines
• Strong SQL, Unix/Linux, and scripting skills;
  Python or Scala is a plus
• Experience building and maintaining documentation, runbooks, and operational processes to support audit readiness and platform scalability
• Familiarity with incident response, change management, and production support in enterprise environments
• Ability to operate independently, manage multiple priorities, and contribute to a high-ownership, cross-functional environment
• Strong communication skills with the ability to work effectively across engineering, security, and platform teams

We offer a comprehensive benefits package including:

• Time to Recharge:
  Flexible time off (FTO), 15 paid holidays
• Time to Recover:
  Paid sick time
• Family Well-Being:
  Parental/new child leave, childcare & elder care assistance, adoption assistance
• Extra Perks:
  Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional…