Bilingual QA Automation Engineer - AI​/IVR

Bilingual QA Automation Engineer - AI/IVR

Infoya is a global IT solutions provider specializing in transforming complex challenges into streamlined, AI-powered outcomes. Through proprietary technology accelerators and full-scale enterprise services, Infoya automates workflows, enhances operational efficiency, and drives digital transformation across industries. With a presence in Canada, the US, India, and Costa Rica, we blend technical depth with creative problem-solving to deliver measurable impact.

This is a remote position.

The QA Engineer is responsible for end-to-end test coverage across manual and AI-driven automated testing. This role requires the ability to design and execute traditional manual test cases as well as build and prompt AI agents to autonomously generate and execute test cases, making AI-based test automation a mandatory, hands-on skill rather than a nice-to-have.

Toronto

Permanent

Hybrid (2 days in office)/Remote

• Analyze requirements/user stories and design comprehensive manual test cases (functional, regression, integration, UAT, edge cases).
• Execute manual test cases, log results, and track defects through resolution.
• Design and configure AI agents (e.g., via prompt engineering / agentic AI test tools) to autonomously generate test cases from requirements or application context.
• Prompt and direct AI agents to execute generated test cases, validate outcomes, and interpret AI-produced results.
• Continuously refine prompts/agent configurations to improve accuracy, coverage, and reliability of AI-generated tests.
• Perform regression testing (manual and AI-assisted) to ensure new releases don’t break existing functionality.
• Maintain traceability between requirements, test cases, and defects.
• Log, triage, and track defects in tools such as JIRA/Azure Dev Ops; work with developers to verify fixes.
• Prepare test summary reports, coverage metrics, and quality sign-off documentation for releases.
• Collaborate with developers, product owners, and Dev Ops to align testing with release/deployment schedules.
• Evaluate and recommend AI testing tools/frameworks to expand automation coverage over time.
• On-call/off-hours testing flexibility - IVR changes often deploy during low-traffic windows (nights/weekends)

• 5-7 years of hands-on QA experience with hands-on experience creating and prompting AI agents to generate and execute test cases (AI-driven test automation).
• Must be proficient in Java, node JS, automation frameworks and Test Design Patterns (Page Object Model, Factory, Singleton, BDD)
• Strong manual testing fundamentals: test plan/test case design, exploratory testing, bug reporting.
• IVR/telephony testing experience - testing call flows, voice menus, DTMF (touch-tone) input, call routing, transfers, hold/voicemail scenarios.
• Familiarity with IVR/telephony platforms - e.g., Avaya, Genesys, Nuance, Twilio, Five9, NICE in Contact (pick whichever your stack actually uses).
• Conversational fluency in French (spoken) - testers must be able to interact directly with the French-language voice bot (IVR) and chat bot to validate prompts, natural language understanding, call/chat flows, and response accuracy. French is mainly required for live interaction/testing purposes.
• Understanding of prompt engineering concepts as applied to test generation and execution workflows.
• Familiarity with defect tracking and test management tools (JIRA, Azure Dev Ops, Test Rail, or similar).
• Working knowledge of SDLC/Agile methodologies.
• Basic SQL skills for data validation.
• Ability to read logs/API responses to validate results from AI-executed tests.

• Experience with…