Senior Data Engineer

Overview

As Senior Data Engineer in the Halifax Risk IT Data Services team, you will design, implement, and support Data architecture best practices and processes across the global organization in line with the corporate vision. We are looking for a strategic thinker and passionate data management enthusiast to drive and support the leadership team in executing the data strategy.

Responsibilities

• Provide consulting services on new initiatives (small to large of varying complexity).
• Explore new emerging technologies and how they best suit our applications.
• Develop, code, document, and execute unit, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.
• Ensure adequate technical documentation and training.
• Optimize Spark jobs and Java applications.
• Architect, design, and implement solutions that meet stakeholder needs.
• Participate actively in requirements gathering, data modeling, and design sessions.
• Prepare high‑level and detailed technical specifications for projects in accordance with PLC, security, and architecture documentation objectives.
• Develop detailed plans and accurate estimates for completion of build, system testing, and implementation phases of a project.
• Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts.

Qualifications

• 5+ years of application development experience in Hadoop, Spark, and Java/Scala.
• 2+ years of application development experience in Java and Spring Framework.
• 7+ years of full development life cycle experience, from architecture through testing and deployment, and cross‑platform skills.
• Experience leading a team of developers.
• Bachelor’s degree in Information Technology, Computer Science.

Must Have

• Experience in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.
• Experience in building data pipelines.
• Experience in developing/designing micro‑service architecture.
• Experience in developing applications in Spring & Spring Boot.
• Working knowledge of Jenkins CI, Git, JIRA.
• Ability to seek improvements to all aspects of the development process.

Nice to Have

• Knowledge of Credit Risk Markets.

Job Skills

• Big Data Management
• Cloud Computing
• Database Development
• Data Mining
• Data Warehousing (DW)
• ETL Processing
• Group Problem Solving
• Quality Management
• Requirements Analysis

Benefits

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable.
• Leaders who support your development through coaching and managing opportunities.
• Opportunity to make a difference and lasting impact.
• Work in a dynamic, collaborative, progressive, and high‑performing team.
• A world‑class training program in financial services.
• Flexible work/life balance options.
• Opportunities to do challenging work.