×
Register Here to Apply for Jobs or Post Jobs. X

Autonomous Agent Evaluation Engineer

Job in Moncton, New Brunswick, Canada
Listing for: Outlier
Full Time position
Listed on 2026-11-04
Job specializations:
  • Software Development
    AI Engineer (Applied/Software), AI QA / Validation Engineer
Job Description & How to Apply Below
Evaluate autonomous agents remotely for Outlier, applying backend engineering and technical feedback skills to Open Claw workflows. This is freelance work.
Outlier collaborates with leading AI organizations to train large language models as proactive, multi-step agents. As an Agentic AI Engineer, you will assess complex system behaviors through structured evaluation and debugging. The work includes designing feedback for architectural workflows and identifying subtle failures. Candidates need at least two years of backend engineering, AI automation, or complex systems integration experience.

Key Responsibilities:

Create evaluation rubrics for agent performance
Debug traces from autonomous agent interactions
Stress test agents against complex workflows
Identify privacy leaks and authority escalation
Detect indirect prompt injection failures
Requirements:
Maintain production-grade modular software
Work with live tools and non-mocked environments
Handle multi-turn system interactions
Deliver clear, high-density technical feedback
Two or more years of relevant experience
Apply careful agent evaluation, debugging, and systems expertise to improve Open Claw and other advanced generative systems.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary