Lead Software Engineer; Python | Databricks

Position: Lead Software Engineer (Python | Databricks)
Requisition
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.
The Team  Global Banking and Markets Engineering (GBME) is the fast-moving, award-winning technology engine that powers Scotiabank’s Corporate, Investment Banking and Capital Markets businesses.

The Role  GBME is searching for Software Engineers who are continuous learners and are eager to boost capabilities of capital markets products and analytics platforms.
The successful candidate will have a strong technical and engineering mindset. You will work closely with business teams and cross functional engineering leaders to develop and implement market leading solutions for the various projects within GBME.
Is this role right for you? In this role you will:
Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
Partner with Architecture on the design and integration
Deliver and enhance new and current solutions and applications
Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
Design, deliver and implement data models, database schema and data pipelines
Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
Support the solution in production (as needed)
Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
Effectively communicate with technical and non-technical audiences
Able to work with and refactor legacy code (as needed).
Coach and train end users (as needed).
Participate and run SCRUM Meetings (as needed).
Skills  Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:
4+ years’ experience with Python (PySpark, Pandas),
4+ years’ experience with designing scalable ETL pipelines & data modeling
4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
4 + years’ experience reading, writing, and running SQL scripts.

Working experience with data technologies and databases, preferably in one or more of:
Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache Elastic Search, comfortable working with large datasets

Working experience with data platforms:
Data Bricks or Snowflake

Working experience with cloud platforms (Azure/GCP)

Working experience with workflow orchestration tool such as Airflow or Data Factory

Working experience with Web Services & API
Hands-on experience with Dev Ops: CI/CD (Jenkins, Git)
Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
Bachelor’s degree in computer science, Engineering or relevant experience.

Preferred Qualifications (Nice To Have)   Understanding of networking protocols and security principles
Capital Markets product knowledge
Dockers, Kubernetes experience
Experience working with real-time, high availability and low latency systems
Experience in multi-threaded applications
What's in it for you?
Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race,…