Skip to content
×

LLM Application Test Engineer

Job in Toronto, Ontario, C6A, Canada
Listing for: TribalScale
Full Time position Listed on 2026-11-20
Job specializations:
Salary/Wage Range or Industry Benchmark: 90000 - 130000 CAD Yearly CAD 90000.00 130000.00 YEAR

Job Description & How to Apply Below

Test LLM-powered applications at Tribal Scale using automation, API validation, and failure analysis for complex agent interactions. The location remains to be confirmed.
As an Agentic QA Engineer, you will assess applications whose outputs are dynamic, nondeterministic, and dependent on multi-step reasoning. Your work will cover agent tool usage, external systems, integrations, and production behavior.

Experience with AI agents or generative AI products is especially relevant.

Key Responsibilities:

Validate agent tools, APIs, and external system interactions
Design end-to-end testing strategies for agentic workflows
Reproduce unexpected outputs and tool-use failures
Apply automated quality checks to development pipelines
Improve agent behavior through production findings
Requirements:
Professional QA, quality engineering, SDET, or software engineering experience

Experience with automated testing and framework development
Understanding of API and end-to-end testing
Experience debugging complex applications
Familiarity with Git and CI/CD pipelines
Use software testing, automation, and AI application knowledge to strengthen LLM workflow quality and reliability at Tribal Scale.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary