Principal Data Engineer at Databricks

Lead enterprise-level data solutions as a Principal Data Engineer at Databricks in Toronto, Ontario. Utilize your expertise in Databricks and Spark to design and optimize scalable data platforms.

We are looking for a highly skilled Principal Databricks Data Engineer to enhance our data initiatives. This role requires deep knowledge in Apache Spark, data lakes, and financial risk data domains. You will drive strategic projects, mentor teams, and collaborate with business stakeholders to deliver high-performance data solutions.

Key Responsibilities:

• Architect and implement data solutions with Databricks

• Design enterprise data lakes and warehouses

• Develop robust ETL/ELT pipelines for diverse datasets

• Collaborate with Finance & Risk to meet regulatory needs

• Optimize Spark workloads for performance and cost Requirements:

• Extensive Databricks and Apache Spark experience

• Expertise in data lake and warehouse architectures

• Hands-on with cloud platforms like AWS or Azure

• Strong SQL and programming skills in Python or Scala

• Experience with CI/CD and data governance practices

Utilize your expertise to innovate data solutions within an esteemed financial setting in Toronto.
#J-18808-Ljbffr