Senior Databricks Platform Administrator

Job Description

How You’ll Make an Impact

We are seeking a Senior Databricks Administrator with a balance of skills in database design, physical implementation, and performance tuning. You will be part of a team that supports cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon’s most prominent Database Marketing clients. You will get a chance to pursue advanced certifications in Databricks, AWS, Azure and related disciplines to deepen your expertise and expand your qualifications.

You will collaborate with delivery and product teams to gain insights into business analytics, data science, and software development, enabling a well-rounded understanding of data-driven decision‑making processes. Contribute by writing documentation, creating tutorials, or training end users, establishing yourself as an inspiring leader and contributing to personal growth and company success.

What You’ll Achieve

• Effectively deploy and configure Databricks work spaces to optimize data processing and analytics capabilities.
• Perform secure and efficient post‑deployment workspace setup, including the creation of IAM policies, storage solutions, and cluster policies, to support data‑driven operations.
• Develop robust role‑based access controls using Unity Catalog to ensure secure and seamless access for administrators, data engineers, scientists, and business users.
• Facilitate smooth data migration from on‑premises and cloud databases to Databricks, maintaining the integrity and security of all data assets.
• Integrate and troubleshoot third‑party tools effectively, enhancing overall system connectivity and functionality.
• Design and implement insightful dashboards that provide users with a clear understanding of job and storage costs, driving cost‑efficiency.
• Develop and deploy monitoring controls and dashboards that allow for comprehensive visualization of job runtime metrics, compute, and storage utilization.
• Automate routine administration tasks using Databricks notebooks to enhance operational efficiency and reduce manual workload.
• Adhere to industry standard processes for security, backup, and recovery, ensuring data catalogs' integrity.
• Handle data replication, retention, and archiving processes to maintain compliance and accessibility of critical data.
• Collaborate with application teams to optimize jobs and ensure alignment with cost‑efficiency and SLA objectives.
• Enhance performance through collaborative Spark SQL optimization, driving improved outcomes for end users.
• Proactively evaluate and integrate new Databricks features to boost platform efficiency and performance.
• Liaison with Databricks support to steer enhancement requests and address defects, ensuring optimal system functionality.
• Demonstrate effective time management skills to balance multiple client engagements and consistently meet or exceed project deliverables.
• Contribute to planning and innovative projects, helping develop creative data solutions to achieve organizational objectives.
• Mentor junior administrators or other team members to share your expertise and cultivate a collaborative and growth‑oriented environment.

Who You Are

• What you’ll bring with you :
  • Bachelor’s degree in computer science or a related technical field, or equivalent hands‑on experience.
  • Minimum of 2 years of experience in administering the Databricks platform.
  • 3-4 years of experience in general database administration.
  • In‑depth knowledge of AWS or Azure infrastructure essential for Databricks operation.
  • Demonstrable experience working with vendor support to resolve issues within established SLA timelines.
  • Strong problem‑solving skills with the ability to diagnose and resolve issues across multiple layers, including application, database, network, and appliance.
  • Proficient in writing and analyzing complex SQL queries to optimize performance.
  • Capability to work independently with minimal supervision.
  • Exceptional written and verbal communication skills.

Base Salary: $97,600- $146,400

Actual compensation within the range will be dependent upon, but not limited to the individual’s skills, experience, qualifications, location and application employment laws. The…