Senior Data Engineer

Job Description What is the opportunity?

As Senior Data Engineer, in our Halifax team, in the Risk IT Data Services team, you will design, implement and support Data architecture best practices and processes within Risk IT Data Services across the global organization in line with corporate vision. We are looking for a strategic thinker, and passionate data management enthusiast to drive and support the leadership team in executing data strategy.

As a member of a dynamic, fast-paced team, this role brings strong data architecture and data engineering skills and leadership, effective written and verbal communication skills, a strong work ethic, and a demonstrated capability to multi-task effectively. This role requires strong interpersonal, organizational, and problem-solving skills as well as a demonstrated sense of urgency to respond to changing priorities s is complemented by a positive attitude and a willingness to take accountability for the results achieved.

• Provide consulting services on new initiatives (small to large of varying complexity).
• Explore new emerging technologies and how they best suit our applications.
• Develop, code, document, and execute unit tests, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.
• Ensure adequate technical documentation and training.
• Optimize spark jobs and java applications.
• Architect, design, and implement solutions that meet the stakeholder’s needs.
• Participate actively in requirements gathering, data modeling, and design sessions.
• Prepare high-level and detailed technical specifications for the projects in accordance with PLC, security, and architecture documentation objectives.
• Develop detailed plans and accurate estimates for the completion of build, system testing, and implementation phases of a project.
• Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts.

• 5+ years of application development experience in Hadoop, Spark, and Java/Scala.
• 2+ years of application development experience in Java and Spring Framework.
• 7+ years of full development life cycle experience, from architecture through test and deployment and cross-platform skills.
• Experience leading a team of developers.
• Bachelor’s degree in Information Technology, Computer Science.

Must Have

• Experience in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.
• Experience in building data pipelines.
• Experience in developing/designing micro-service architecture.
• Experience in developing applications in Spring & Spring Boot.
• Working knowledge of Jenkins CI, Git, JIRA.
• Ability to seek improvements to all aspects of the development process.

• Knowledge of Credit Risk Markets.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable.
• Leaders who support your development through coaching and managing opportunities.
• Ability to make a difference and lasting impact.
• Work in a dynamic, collaborative, progressive, and high-performing team.
• A world-class training program in financial services.
• Flexible work/life balance options.
• Opportunities to do challenging work.

• Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis.