×
Register Here to Apply for Jobs or Post Jobs. X

AI QA Engineer

Job in Alpharetta, Fulton County, Georgia, 30022, USA
Listing for: Ova Technologies
Full Time position
Listed on 2026-07-01
Job specializations:
  • Software Development
    AI Engineer (Applied/Software), AI QA / Validation Engineer, Machine Learning/ ML Engineer
Job Description & How to Apply Below

About The Role

We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.

Key Responsibilities
  • Design, develop, and execute test plans and test cases for AI/ML-based products.

  • Validate AI models for accuracy, fairness, robustness, and performance.

  • Test data pipelines, feature engineering processes, and model integration with production systems.

  • Develop automated test scripts for model APIs, training pipelines, and inference workflows.

  • Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.

  • Implement monitoring and alerting mechanisms for deployed AI systems.

  • Conduct regression testing to ensure changes do not degrade model performance.

  • Ensure compliance with data privacy, security, and responsible AI standards.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

  • 3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.

  • Strong knowledge of QA methodologies, tools, and processes.

  • Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).

  • Familiarity with ML frameworks (Tensor Flow, PyTorch, Scikit-learn).

  • Experience testing RESTful APIs and microservices.

  • Proficiency in Python (preferred), Java, or other programming languages.

  • Strong problem-solving skills and attention to detail.

Preferred Qualifications
  • Experience with ML model validation, monitoring, and drift detection.

  • Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).

  • Understanding of bias, fairness, and explainability in AI systems.

  • Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.

  • ISTQB or equivalent certification in QA.

What We Offer
  • Competitive salary and benefits package.

  • Opportunity to work on cutting-edge AI products.

  • Collaborative, innovative, and growth-focused work environment.

  • Professional development and learning opportunities.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary