Senior Data Engineer; Cloud/AWS
Job Description
Supports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. Applies experience and seasoned knowledge, skills, and practices to perform a variety of assignments.
What is the opportunity?Supports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. Applies experience and seasoned knowledge, skills, and practices to perform a variety of assignments.
What will you do?- Develop and maintain backend systems using Python, PySpark ensuring high performance, scalability, and reliability
- Participate in the design and implementation of data engineering and ETL pipelines using Py Spark
- Collaborate with cross-functional teams to identify and prioritize project requirements
- Mentor and guide engineers, providing technical guidance and code reviews
- Stay up-to-date with the latest technologies and frameworks, and apply this knowledge to improve existing systems and processes
- Lead the technical direction of the team, including architecture, design, and implementation of software systems
- Collaborate with product owners to define and prioritize requirements
- Develop and maintain technical documentation, including architecture diagrams, and technical specifications
- Participate in code reviews, ensuring high-quality code and adherence to coding standards
- Collaborate with Dev Ops and Operations teams to ensure smooth deployment and operation of applications
- 5+ years of professional experience with cloud platforms, including Amazon Web Services (AWS), and OCP (Open Shift)
- 5+ years of experience with PySpark for Data Engineering/ETL pipelines
- Familiarity with containerization using Docker and orchestration using Kubernetes
- Expert in Dev Ops practices and tools for CI/CD pipelines
- Willingness to learn new technologies and adapt to new challenges
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
- Ability to drive technical innovation, including researching new technologies, evaluating technical options, and recommending technical solutions
- Strong problem-solving skills, with the ability to debug complex issues, optimize system performance, and ensure high-quality software deliverables
- Experience with Agile development methodologies, including Scrum or Kanban, and the ability to apply these principles to lead the team
- Proven experience in leading technical teams, including technical guidance, mentoring, and coaching
- Strong technical leadership skills, including the ability to make technical decisions, prioritize tasks, and manage technical resources
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Flexible work/life balance options
- Opportunities to do challenging work
Amazon S3, Amazon Sagemaker, AWS Architecture, AWS Devops, AWS Ecosystem, AWS Glue, Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Python (Programming Language), Quality Management, Requirements Analysis
Additional Job DetailsAddress: RBC CENTRE, 155 WELLINGTON ST W:
TORONTO
City:
Toronto
Country:
Canada
Work hours/week: 37.5
Employment Type:
Full time
Platform: TECHNOLOGY AND OPERATIONS
Job Type: Regular
Pay Type:
Salaried
Posted Date:
Final date to receive applications:
NoteApplications will be accepted until 11:59 PM on the day prior to the Final date to receive applications date above
Inclusion and Equal Opportunity EmploymentAt RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities.
RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search: