Lead Data Engineer Ontario, CA

Lead Data Engineer

Location:

Toronto, ON - Hybrid

Duration:
Long Term contract

Experience Level: 8+ years

• Develop and maintain backend systems using Python and PySpark ensuring high performance, scalability, and reliability.
• Participate in the design and implementation of data engineering and ETL pipelines using PySpark.
• Collaborate with Dev Ops and Operations teams to ensure smooth deployment and operation of applications.
• Expert in Dev Ops practices and tools for CICD pipelines.
• Experience with cloud platforms, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
• Experience with PySpark for data engineering ETL pipelines.
• Familiarity with containerization using Docker and orchestration using Kubernetes.

• 8+ years of strong design, development experience using C#, .NET Core, Web API, Angular/React, ASP.NET MVC.
• 3+ years of strong development experience with SQL Server/Oracle/Sybase, complex procedures, and SSIS/SSRS.
• Working experience in the financial domain.
• Experience working with Dev Ops, source code management tools like Git, SVN, Jira, UCD, Jenkins.
• Experience working with Agile/Scrum/RAD development methodology.
• Nice to have: container-based technologies like Docker, Kubernetes, Open Shift, cloud platform familiarity and big‑data and cloud‑based technologies.