AI Quality Engineer Python Skills

Position: AI Quality Engineer with Python Skills
Join an innovative team as an AI Quality Engineer, focusing on Python-based test automation and AI workflows. This role emphasizes the development of automated tests for various AI agent functionalities.

We are seeking a candidate with 4+ years of QA engineering experience, specifically in SDET or test automation roles. You will design evaluation suites for advanced AI behaviors and work with frameworks such as Pydantic Evals. Key responsibilities include debugging issues, validating scenarios, and collaborating with the engineering team to establish quality metrics.

Key Responsibilities:

• Build automated tests for AI workflows and APIs

• Design evaluation suites for LLM behaviors

• Debug quality issues by reading logs and requests

• Validate multi-turn support scenarios and clarify flows

• Contribute to CI quality checks and regression suites

Requirements:

• 4+ years in QA engineering or related roles

• Strong Python skills for production tests

• Experience with test frameworks like pytest

• Knowledge of LLM applications and agentic systems

• Ability to document risks and test plans

Leverage your QA expertise and Python experience to enhance AI technology quality.
#J-18808-Ljbffr