Job Description & How to Apply Below
Elevate AI solutions reliability with Zafin as an AI Evaluation Engineer in Toronto, Canada. Drive evaluations to ensure AI agents meet rigorous quality and compliance standards in regulated environments.
At Zafin, the AI Evaluation Engineer plays a critical role in validating AI agent performance within the banking sector. This position necessitates expertise in AI evaluation, quality engineering, and structured testing methodologies. You will be responsible for shaping the evaluation processes to align with business logic, regulatory requirements, and industry standards.
Key Responsibilities:
• Design structured evaluation scenarios for AI agents
• Validate agent behaviour against defined business rules
• Conduct regression evaluations and monitor performance
• Identify and track quality issues and risks
• Support production-readiness decisions with objective evidence
Requirements:
• 3-10+ years in software quality or AI evaluation
• Strong understanding of large language models
• Experience with regression evaluation and quality engineering
• Degree in Computer Science or related field
• Proficient in Python or SQL for evaluation tasks
Deliver reliable AI solutions and build trusted outcomes for Zafin's clients in the financial sector.
#J-18808-Ljbffr
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×