AI Evaluation Engineer at Appnovation

Location: Montreal

Elevate quality assurance in AI with Appnovation as an AI Evaluation Engineer. This role encompasses large-scale evaluations and statistical analysis for improving answer accuracy.

Join a talented team at Appnovation focused on technology-driven solutions. As an AI Evaluation Engineer with a minimum of four years of QA experience, you will conduct detailed evaluations across vast question sets. Key skills include Python programming, data analysis, and LLM frameworks, enhancing both product quality and client experience.

Key Responsibilities:

• Run scalable evaluations on diverse question sets

• Measure factual grounding and accuracy systematically

• Build and maintain a quality improvement metrics framework

• Collaborate with engineering to ensure effective problem resolution

• Automate regression and integrate QA processes into CI/CD pipelines

Requirements:

• Bachelor’s Degree in a technical field, or equivalent experience

• 4+ years in QA or test engineering

• Strong data-science techniques for answer quality

• Familiarity with LLM evaluation frameworks

• Excellent analytical and communication skills

This role demands strong technical skills and a commitment to enhancing AI evaluation processes at Appnovation.
#J-18808-Ljbffr