×
Register Here to Apply for Jobs or Post Jobs. X

AI Quality Engineer - Test Automation Expert

Job in Vancouver, BC, Canada
Listing for: Centraprise
Full Time position
Listed on 2026-07-01
Job specializations:
  • Quality Assurance - QA/QC
    AI QA / Validation Engineer, IT QA Tester / Automation
Salary/Wage Range or Industry Benchmark: 80000 - 100000 CAD Yearly CAD 80000.00 100000.00 YEAR
Job Description & How to Apply Below
Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.

With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.

Key Responsibilities:

• Build and maintain automated tests for AI workflows and behaviors

• Test multi-turn scenarios, scripts, and approval checks

• Collaborate with engineering to define quality metrics

• Debug quality issues by tracing requests and logs

• Identify risks and document testing processes

Requirements:

• 4+ years in QA engineering or similar hands-on roles

• Strong skills in Python for production-quality tests

• Experience with testing LLMs and AI systems

• Familiarity with pytest or similar testing frameworks

• Strong written communication for documentation

Utilize your automation and AI testing expertise to make an impact.
#J-18808-Ljbffr
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary