Senior Data Engineering Specialist - Databricks

Location: Saint-Antoine-sur-Richelieu

Elevate your career as a Senior Data Engineering Specialist focused on Databricks and Scala in Montreal, QC. This hands-on role involves migrating regulatory reporting pipelines to a cloud-based platform.

VLink is seeking an experienced candidate for a contract position to drive the modernization of data pipelines. You'll design, implement, and test production pipelines ensuring compliance with strict reporting requirements. Essential skills include Scala, Spark, SQL, Snowflake, and Azure experience, which are critical for success in this role.

Key Responsibilities:

• Design and implement complex regulatory reporting pipelines

• Migrate legacy ETL systems to Databricks and Snowflake

• Write and optimize Spark applications using Scala

• Build automated data quality and reconciliation tools

• Collaborate on CI/CD processes using Git Hub Actions

Requirements:

• Extensive Scala and Spark experience in production

• Proficient in SQL and Azure services

• Familiar with orchestration tools like Airflow

• Knowledge of data migration strategies

• Experience in TDD and automated testing

Utilize your expertise in data engineering to transform legacy ETL systems into modern solutions at VLink in Montreal.
#J-18808-Ljbffr