Senior Systems Testing-QA Specialist Job Toronto area,Ontario Canada,Quality Assurance

RQ00822 - Senior Systems Testing-QA Specialist Duration: - Working Status:
Hybrid: 3 days onsite/2 days remote (subject to HM’s discretion)

NOTE:

HM is looking for strong AI testing experience.

Must Haves:

Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms.
Proven ability to execute AI testing activities utilizing specialized tools such as Deep Eval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.

Nice to Have:

Public Sector Experience

Qualifications

The Quality Assurance Specialist (QA lead) is responsible for performing application testing tasks and Quality Assurance activities including Functional Testing, Automation Testing, and various AI testing as described below.
The Quality Assurance Specialist (QA lead) will participate in planning and estimating the activities required to test the new solutions and enhanced applications. He/She will participate in the development of Master Test Plans, Test
Cases, Test Scripts, Test Completion Reports, etc. while providing advice to business users for the development of Test Cases for User Acceptance Test.
Executing the tests as required, performing issue tracking and resolution.
The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability, and ensure alignment with business requirements and quality standards.

Key Responsibilities:

Quality Assurance Leadership
Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities.
Assess risks to quality based on verification and validation results and provide recommendations for mitigation.
Implement and maintain quality processes that support development and production change management.
Test Design & Planning
Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.
Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.
Collaborate with development leads and business analysts to design and create test data to support test execution.
Test Execution & Management
Perform various types of testing manually and/or using automation tools, including:
Functional Testing
Regression Testing
Integration Testing
Usability/Accessibility Testing
Performance Testing
Perform the following types of AI testing activities:
Functional AI Testing
Response accuracy
Hallucination testing
AI-Security and privacy testing (prompt injection)
AI-Safety Testing (inappropriate behaviours)
Execute test cycles, monitor progress, and manage defect resolution and issue tracking.
Maintain detailed records of test results and discrepancies using designated QA tools.
Work closely with project managers, implementation team, system administrators, architects, vendors (as needed) and database administrators to ensure testing activities are aligned with project timelines and technical requirements.
Lead and assist business users in conducting User…