×
Register Here to Apply for Jobs or Post Jobs. X

AI Quality Engineer Position

Job in Toronto, Ontario, C6A, Canada
Listing for: Rootly
Full Time position
Listed on 2026-07-01
Job specializations:
  • Engineering
  • Quality Assurance - QA/QC
    AI QA / Validation Engineer
Salary/Wage Range or Industry Benchmark: 80000 - 100000 CAD Yearly CAD 80000.00 100000.00 YEAR
Job Description & How to Apply Below
Position: Rootly AI Quality Engineer Position
Enhance Rootly's AI capabilities as an AI Quality Engineer focused on rigorous testing and evaluation.

Your role will ensure our incident management platform performs flawlessly.

As an AI Quality Engineer, you'll bring over 5 years of experience in QA to Rootly, designing test scenarios and evaluating AI features. You'll be responsible for building frameworks, addressing failure modes, and collaborating with product teams to refine new features. This is an opportunity to leave a significant impact in a high-paced environment.

Key Responsibilities:

• Design and conduct tests covering diverse AI inputs

• Analyze outputs for accuracy and consistency

• Maintain robust test libraries and evaluation standards

• Identify unexpected AI behaviors and develop solutions

• Collaborate on metrics to assess quality and performance

Requirements:

• 5+ years of QA or AI evaluation experience

• Familiarity with testing LLM-powered products

• Capability in prompt engineering and analysis

• Strong written communication for all stakeholder levels

• Knowledge of evaluation methodologies and frameworks

Your expertise in AI will elevate Rootly’s platform and customer satisfaction.
#J-18808-Ljbffr
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary