GenAI QE Strategy Lead

Overview

Lead QE to design, develop and implement testing strategy and automation tools for a GenAI based development project. The role involves creating the testing framework that will be integrated into a CI/CD pipeline and working closely with Business Analysis and Development leads in Vancouver, as well as team members across Toronto, Halifax and offshore locations.

• Collaborate with Dev and BA leads to define QE scope within an agile sprint approach.
• Create a testing framework to be used in the CI/CD pipeline.
• Design and implement application programs, performing testing on developed applications.
• Review, analyze and modify programming systems, including encoding, testing, debugging and installing for large‑scale systems.
• Ensure operating efficiency of existing application systems and maintain documentation of system development and revisions.
• Conduct analysis of organizational needs and goals for the development and implementation of application systems.

• Undergraduate degree and experience managing change in complex programs with high request frequency and multiple priorities.
• Strong written and oral communication skills, with the ability to present information clearly to stakeholders.
• Excellent organizational and time‑management capabilities.
• Deadline‑driven and results‑oriented, consistently meeting high quality standards while managing multiple tasks.
• End‑to‑end test architecture and integration experience for GenAI development projects.
• Experience testing and evaluating GenAI models, prompt engineering frameworks and RAG systems.
• Technical proficiency in Python and AI evaluation tools such as Lang Chain.
• Knowledge of cloud‑based architecture (AWS, Azure, GCP).
• Deep understanding of the Software Testing Life Cycle (STLC), CI/CD pipelines and API testing.
• Hands‑on automation experience in Python focused on LLMs.
• Experience integrating multiple tools with automation beyond Selenium.
• Database experience with SQL or Snowflake.
• Experience with CI/CD and test automation.

• Ability to facilitate communication and influence key decision makers while collaborating with team members across different time zones.
• Experience with regulatory reporting projects or the financial services industry.
• Familiarity with QTest or other defect management tools.
• Experience working in Unix environments.

• Comprehensive total rewards program, including bonuses, flexible benefits, competitive compensation and stock options where applicable.
• Leadership support through coaching and professional growth opportunities.
• Opportunity to have a lasting impact and work in a dynamic, collaborative, high‑performing team.
• World‑class training program in financial services.
• Flexible work/life balance options.
• Opportunities to take on challenging work.