Senior Data Bricks​/Scala​/Spark Engineering Specialist - Inc; Saint-Antoine-sur-Richelieu

Position: Senior Data Bricks/Scala/Spark Engineering Specialist - VLink Inc (Saint-Antoine-sur-Richelieu)
Senior Data Bricks/Scala/Spark Engineering Specialist

Location:

Montreal, QC (Onsite)

Employment Type:

Contract
Duration:  12 Months

Job Description  We’re migrating complex on‑prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a contemporary Databricks + Snowflake platform on Azure. The role is hands‑on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements.
Must‑have   Scala / Spark — production experience writing Spark applications in Scala (not just notebooks); comfortable with the Data Frame API, joins, window functions, partitioning, and performance tuning
Databricks — Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI
SQL fluency — comfortable writing, analyzing and extracting requirements from complex SQL scripts
Snowflake — schema design, performance, Spark‑Snowflake connector
Azure — ADLS, networking basics, secrets/identity (EntraID / managed identities)
Orchestration — Airflow (DAG authoring, sensors, retries, SLAs)
CI/CD — Artifactory, Git Hub Actions pipelines: build, sharded test matrices, artifact promotion through dev → QA → UAT → prod
Testing — experience in TDD, writing unit tests (Scala Test, Any Flat Spec ) and BDD (Concordion or equivalent)
Data quality & reconciliation — building automated parity checks against legacy outputs, drift detection, row‑level reconciliation tooling
Large‑scale migrations — proven track record migrating legacy ETL to cloud data platforms, including dependency mapping and cutover planning
Modern data engineering practices — medallion architecture (Bronze/Silver/Gold), idempotent pipelines, schema evolution, lineage, observability
Nice‑to‑have   Financial services / regulatory reporting domain
Python (Databricks utilities, tooling)
Spec‑driven development workflows (specs → plans → tasks → implementation)
Gradle (composite builds) and JVM tooling
Employment Practices  EEO, ADA, FMLA Compliant
VLink is an equal opportunity employer committed to fostering an inclusive environment where diversity is celebrated. All qualified applicants will be considered for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Employment is contingent upon successful completion of a background check. Applicant information will be handled in accordance with VLink’s privacy policy.

#J-18808-Ljbffr