Data Engineer Consultant

Role Name:
Data Engineer
Location:
Toronto, hybrid
Contract role

JOB DESCRIPTION:

"Primary skill - SQL Python Databricks
Exp - Yrs

We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have strong experience in building and maintaining scalable data pipelines and infrastructure, with a focus on cloud technologies, particularly AWS. This role requires proficiency in Python and SQL, and offers opportunities to work with modern data platforms like Databricks.

Key Responsibilities:

Design, develop, and maintain robust data pipelines and ETL processes.
Work with large-scale datasets to ensure data integrity, quality, and availability.
Collaborate with data scientists, analysts, and other engineers to support data needs.
Optimize data workflows for performance and scalability in cloud environments.
Implement data governance and security best practices.

Required Qualifications:

Proficiency in Python and SQL for data manipulation and pipeline development - min - years of experience.
Hands-on experience with AWS services such as S, Lambda, Glue, IAM, etc.
Strong understanding of data modeling, warehousing, and distributed systems.

Experience with version control systems (, Git) and CI/CD pipelines.

Preferred Qualifications:

Experience with Databricks or similar data platforms.
Familiarity with Java for backend or data-related development.
Exposure to API development and integration with data services.
Nice to Have:
Knowledge of data lake architectures and real-time data processing.

Experience with orchestration tools like Airflow or AWS Step Functions.
Understanding of Dev Ops practices in data engineering contexts."