Senior Data Engineer Infrastructure

Contribute to transformative data solutions as a Senior Data Engineer in Toronto. This hybrid role requires experience in managing and operating high-volume data systems.

As part of the Data Infrastructure teams, your role involves significant ownership of major platform components. You will leverage your skills in Spark-on-Kubernetes, Flink, and Kinesis to develop infrastructure that handles billions of events daily, ensuring reliability and efficiency.

Key Responsibilities:

• Configure and support Spark-on-Kubernetes for data processing

• Develop event ingestion pipelines with Rust and Flink

• Utilize Terraform for cross-account AWS provisioning

• Govern real-time ML pipelines in MemoryDB environments

• Deploy Airflow DAGs for data quality and monitoring

Requirements:

• 3+ years of relevant experience in production environments

• Proficient in creating and managing Kubernetes platforms

• Hands-on AWS experience with EKS, Kinesis, S3

• Proven responsibility for critical platform components

• Strong coding skills in Rust, JVM, or Python

Join us in advancing data engineering initiatives from our Toronto office while applying your technical mastery.
#J-18808-Ljbffr