Sr Databricks Data Engineer

Join Deloitte's AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through innovation. As a Senior Consultant - Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business and technology leaders to modernize data platforms, enable analytics and artificial intelligence use cases, and drive measurable business outcomes.

This role offers the opportunity to deliver enterprise-scale Databricks solutions that improve performance, expand digital capabilities, and help clients scale data-driven decision-making across the enterprise.

Recruiting for this role ends on 07/03/2026.

• Champion Best Practices:
  Establish, document, and promote best-in-class approaches for data architecture, integration, and modelling.
• Pipeline Ownership:
  Oversee the design, development, and maintenance of robust data pipelines and data architectures that support large-scale, enterprise data needs.
• Drive Excellence:
  Initiate and manage efforts to improve data quality, operational efficiency, and process scalability.
• Team and Technology Lead:
  Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge. Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery.
• Data Governance:
  Consult on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
• Communication:
  Communicate technical concepts and business value to diverse stakeholders, including executives, business leads, and technology teams.
• Dev Ops and Automation:
  Oversee the implementation of CI/CD practices with tools such as Azure Dev Ops, AWS Code Pipeline, Jenkins, TFS, or Power Shell for streamlined deployments and operations.
• Provide clear guidance to others.

• Five or more years of hands‑on experience in data engineering with a focus on Databricks on AWS, Azure, or GCP.
• Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud‑native databases, storage solutions, and distributed compute platforms.
• Experience with data warehousing, third normal form (3NF), dimensional modelling, enterprise data lakes, incremental data loads, and metadata‑driven ingestion and data quality frameworks using PySpark.
• At least one year of leading complex, cross‑functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated CI/CD pipelines, and performance optimisation of data engineering pipelines, code, and compute resources.
• A bachelor's degree in Computer Science, Engineering, or a related field.
• Ability to travel up to 50% on average.
• Limited immigration sponsorship may be available.

• Master's degree in Computer Science, Engineering, or a related field.
• Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services.
• Experience tuning and optimizing performance in Databricks and Apache Spark environments.
• Experience with Databricks Lakeflow.
• Experience with artificial intelligence and machine learning solutions.

• Ability to work independently and collaborate as part of a team.
• Effective written and verbal communication skills.
• Meticulous attention to detail and quality of work product.
• Ability to build and sustain professional relationships.
• Ability to lead projects or work streams.
• Ability to manage and prioritise multiple tasks in a fast‑paced and dynamic environment.
• Strong interpersonal skills and professional demeanor.
• Ability to meet deadlines.

Deloitte's Core AI & Data practice helps organisations modernise data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence across the business. The team works with clients to architect, engineer, and deploy cloud‑based data solutions that improve decision‑making, enable innovation, and support large‑scale transformation. Practitioners collaborate across business and technology functions to solve complex challenges in data modernisation, governance, platform engineering, and insight delivery.

The wage range for this role is $137,500 to $193,600. You may also be eligible to participate in a discretionary annual incentive programme.

Deloitte is an equal‑opportunity employer and welcomes diversity.