×
Register Here to Apply for Jobs or Post Jobs. X

AI Agent Evaluation Engineer OpenClaw

Job in Moncton, New Brunswick, Canada
Listing for: Outlier
Full Time position
Listed on 2026-11-04
Job specializations:
  • Software Development
    AI QA / Validation Engineer, AI Engineer (Applied/Software)
Job Description & How to Apply Below
Evaluate autonomous agents through rubric writing and trace debugging with Outlier, working remotely on flexible freelance projects.
Outlier helps innovative companies improve AI agents through human feedback. This engineering work supports large language models designed for proactive, multi-step operation. You will assess complex system behavior, identify subtle failures, and contribute technical judgment to agent training projects.

Key Responsibilities:

Create rubrics for evaluating agent performance
Debug multi-turn agent traces and interactions
Stress test agents across real-world workflows
Identify privacy leaks and authority escalation
Detect indirect prompt injection failures
Requirements:
Two or more years of relevant experience
Strong attention to detail during technical evaluation
Clear, high-density feedback on complex behaviors
Experience handling live, non-mocked system interactions
Backend, automation, or integration engineering background
Use agent evaluation, failure analysis, and technical feedback expertise to improve Open Claw systems with Outlier.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary