Hybrid Data Engineer

Join our data team in Toronto as a Hybrid Data Engineer. Leverage your expertise in cloud storage and real-time data streaming to enhance our data solutions.

This hybrid role combines 2-3 days onsite in Toronto with remote work flexibility. You will be pivotal in utilizing Amazon S3, AWS Glue, and Apache Kafka while maintaining data ingestion pipelines. Your experience with Amazon Redshift and AWS Step Functions will directly impact our data architecture.

Key Responsibilities:

• Design and maintain data ingestion pipelines for efficient processing

• Utilize AWS Glue and Apache Spark for data processing tasks

• Implement real-time data streaming with Apache Kafka

• Ensure data quality through performance tuning and validation

• Monitor and troubleshoot operational data workflows and pipelines

Requirements:

• Proven experience with Amazon S3 and cloud storage solutions

• Solid expertise in AWS Glue and Apache Spark

• Hands-on with Apache Kafka and real-time data technologies

• Proficient in Amazon Redshift for data warehousing

• Understanding of data governance in financial services

Utilize cloud technologies, data streaming, and warehousing expertise in a dynamic Toronto team.
#J-18808-Ljbffr