Senior Data Engineer

Embark on a rewarding journey as a Senior Data Engineer in Toronto, ON. With a focus on migrating complex data pipelines to AWS, leverage your Python and PySpark skills while working a hybrid schedule.

This 6-month contract role in the Investments Industry demands a highly autonomous Data Engineer with 8-10+ years of experience. You will be involved in transforming existing Databricks pipelines and optimizing them for AWS. Collaborate with stakeholders and ensure production readiness as you design scalable data solutions.

Key Responsibilities:

• Migrate Databricks Spark pipelines to AWS EMR

• Optimize data pipelines for performance and scalability

• Structure and store data using Parquet and Iceberg

• Improve legacy data pipelines over time

• Ensure production monitoring and orchestration readiness

Requirements:

• 8-10+ years of Data Engineering experience

• Strong expertise in Python and Py Spark

• Deep knowledge of Apache Spark in distributed systems

• Experience with Databricks and AWS data ecosystem

• Problem-solving skills in ambiguous environments

Lead impactful data transformations with your extensive skills as a Senior Data Engineer.
#J-18808-Ljbffr