Sr. Developer Databricks & Scala

Position

Description:

This role is hybrid and requires you to be at our Client office at a minimum 2 days per week - subject to change at any time.

Your future duties and responsibilities:

Seeking a Senior Developer with strong hands on experience in Databricks and Scala to build and optimize scalable data pipelines. This role is delivery focused with opportunities to contribute to design and mentor junior engineers.

1. Lead the design and development of scalable data processing solutions using Databricks and Scala
2. Develop and optimize batch and/or streaming data pipelines using Apache Spark (Scala API)
3.Build, maintain, and monitor Databricks jobs, workflows, clusters, and notebooks
4.Write high-quality, production-ready Scala code following functional programming principles
5.Develop complex SQL queries for data transformations and analytics
6.Work with cloud-based storage and services on Microsoft Azure
7. Collaborate with cross-functional teams to deliver reliable and performant data solutions
8. Implement and follow best practices for version control, CI/CD, and code reviews

Required qualifications to be successful in this role:

1. 5+ years of experience in Leading and Developing solutions with Databricks and Scala.
2. Strong proficiency in Scala (2.x/3) for production workloads
3. Understanding of Databricks components.
4.

Experience with Databricks notebooks (Scala / SQL / Python)
5. Advanced SQL skills for analytics and transformations
6. Handson experience with Azure cloud
Must Have Technical Skills
. Scala (production experience; functional programming preferred)
. Apache Spark (Scala API) – batch and/or streaming
. Databricks platform (jobs, workflows, clusters, notebooks)
. Advanced SQL
.

Experience with cloud storage
. Cloud hand-on :

Azure
. Git, CI/CD, and code review practices

"CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95,–$,. This role is an existing vacancy."

#LI-AV1

Skills: