×
Register Here to Apply for Jobs or Post Jobs. X

Senior AI QA Analyst - RQ

Job in Ottawa, Ontario, Canada
Listing for: S.i. Systems
Contract position
Listed on 2026-02-28
Job specializations:
  • IT/Tech
    IT QA Tester / Automation, Systems Analyst, Data Analyst
Job Description & How to Apply Below
Position: Senior AI QA Analyst - RQ02103

Duration - Until 30 Apr (Possibility of extension)

Location
- Remote

Senior AI QA Analyst, take ownership of designing, implementing, and maintaining both manual and automated testing processes. Your work will span functional, system, integration, and performance testing, ensuring that our AI technologies are thoroughly evaluated and meet rigorous acceptance standards.

Role Deliverables

  • Participate in all testing activities throughout agile product implementation
  • Facilitate communication between development teams, UX/UI designers, and product managers
  • Contribute to project insights, risk evaluations, and estimation discussions for testing
  • Analyze requirements, user feedback, and design documents to ensure completeness and testability
  • Formulate and execute robust test strategies tailored to AI projects
  • Craft comprehensive test plans and test cases for AI solutions
  • Update test documentation and create reports with traceability to project requirements
  • Utilize defect tracking systems for issue resolution and documentation
  • Propose innovative ideas and improvements to enhance testing effectiveness, speed, and quality
  • Identify and implement in-house test automation frameworks
  • Skills:

  • 5+ years experience in QA
  • 3+ years experience creating detailed test plans & test cases
  • Experience testing complex applications
  • Proficiency using automated testing tools and platforms
  • Background with Azure Dev Ops, Jira, and defect tracking systems
  • Experience with automation tools such as Playwright, JMeter, SoapUI, and Postman
  • Ability to experiment with Python or Typescript
  • Database experience (SQL) for testing and analysis
  • Knowledge of Python for AI development and testing
  • Testing AI-generated responses for factual correctness and relevance
  • Experience with observability tools like Lang Smith or Lang Fuse
  • Agile methodologies and working with UX principles, user stories, and customer research
  • Position Requirements
    10+ Years work experience
    Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
    To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
     
     
     
    Search for further Jobs Here:
    (Try combinations for better Results! Or enter less keywords for broader Results)
    Location
    Increase/decrease your Search Radius (miles)

    Job Posting Language
    Employment Category
    Education (minimum level)
    Filters
    Education Level
    Experience Level (years)
    Posted in last:
    Salary