AI Quality Engineer

We are seeking a AI Quality Engineer to join our dynamic team. The ideal candidate will have strong experience in AI and ML quality assurance, test automation, and model validation and a proven ability to design and execute comprehensive testing strategies that ensure reliability, fairness, and performance of AI systems in production
.

Responsibilities:

• Quality assurance strategy and standards for AI and ML models, including Generative AI solutions and autonomous agents.
• Test strategy and plan development covering objectives, scope, resources, and schedules for ethical and robust AI evaluation.
• Test case design and execution across functional, non-functional, performance, stress, regression, and adversarial testing.
• AI robustness and functionality testing against edge cases and unexpected scenarios to ensure consistent and accurate results.
• Performance and scalability testing of model inference speed, resource utilization, and behavior under load.
• Data quality and model bias assessment in partnership with data scientists to identify and mitigate fairness issues.
• Automation development for AI/ML pipelines, model validation, and system integration.
• Defect management including identification, documentation, prioritization, and coordination for resolution.
• Metric definition and reporting of accuracy, precision, recall, F1-score, latency, and reliability to stakeholders.
• Collaboration with cross-functional teams to embed quality throughout the AI lifecycle.
• Continuous improvement through adoption of advancements in AI testing methodologies, tools, and practices.