Senior Software Engineer

Requisition

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

As a Senior Software Engineer on Scotiabank’s Data & AI Technology team, you will lead the design, development and scaling of our enterprise data catalog and data management solutions leveraging the Databricks ecosystem. In this role, you will play a key part in enabling data discovery and governance across the organization by developing robust, scalable and secure data services. This position is ideal for someone who is ambitious, enjoys mentoring others, thrives on tackling intricate technical issues, is motivated by making an impact, and is enthusiastic about shaping the future of the data platform.

• Design and build scalable components of an enterprise data catalog, using automation to streamline data governance processes
• Integrate enterprise data catalog with Databricks and other data platforms
• Design and develop data quality, data profiling and data classification solutions
• Lead technical design discussions and drive architectural decisions for data management solutions
• You will advocate for good engineering and development practices within your squad. Collaborate, generate ideas, and develop a deep level of expertise in priority projects
• Evaluate trade-offs between correctness, robustness, performance, and customer impact to ensure we build the right solution
• Identify technical risks and proactively propose scalable, long-term solutions
• Strong ownership mindset and attention to detail
• Mentor and guide junior engineers
• Communicate with stakeholders, work with product managers to understand the product requirements and ensure that the data infrastructure supports the product goals

Do you have the skills that will enable you to succeed in this role? We'd love to work with you if you have:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field
• Solid understanding of common design patterns, lakehouse architecture, and experience working with backend and frontend development frameworks
• Strong programming skills (Python and/or Java)
• Proven experience with Data Bricks, Unity Catalog, Delta Lake and Apache spark
• Experience building or integrating enterprise data catalog tools (e.g. Atlan, Alation, Collibra, Data Hub, Open Metadata)
• Experience designing and building reusable data quality, data profiling and data classification frameworks
• Experience implementing data security and access control models
• Solid understanding of data governance, metadata management, and data lineage concepts
• Experience with cloud platforms (Azure, GCP) and infrastructure-as-code tools (Terraform)
• Familiarity with restful APIs, microservice architecture and distributed designs
• Knowledge of streaming technologies (Kafka, structured streaming)
• Creative and persistent approach to problem-solving and strong analytical skills
• Understanding of product development process and data infrastructure requirements
• 7+ years of experience in developing enterprise cloud native applications, with at least 4 years in enterprise data system focused on Data Bricks/Azure
• 2+ years of experience leading or mentoring a team of engineers, with a track record of successful project delivery

• Diversity, Equity, Inclusion & Allyship
  - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias‑free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
• Accessibility and Workplace Accommodations
  - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
• Upskil…