AI Tester​/AI QA Analyst

POSITION OVERVIEW

MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer journeys, drive scalability and reduce costs.

At MCI we are committed to fostering an environment where professionals can build meaningful careers, access continuous learning and development opportunities and contribute to the success of a globally expanding, industry-leading organization.

AI Tester / AI QA Analyst to ensure the quality, reliability, and effectiveness of AI-powered products, machine learning models, and Generative AI applications. This role is responsible for validating AI functionality, identifying defects, and ensuring AI systems meet business, user, and compliance requirements.

The successful candidate will play a critical role in delivering trustworthy AI solutions that provide exceptional user experiences.

Key Responsibilities:

AI Testing & Validation

• Ensure AI systems perform as expected across multiple use cases.
• Design and execute AI testing strategies and test cases.
• Validate model outputs against expected outcomes.
• Assess system reliability, consistency, and performance.
• Identify defects, anomalies, and areas for improvement.

Quality Assurance & Compliance

• Support the delivery of high-quality AI solutions.
• Conduct functional, regression, and user acceptance testing.
• Verify compliance with business and regulatory requirements.
• Maintain testing documentation and evidence.
• Support release readiness assessments.

Performance Analysis & Reporting

• Provide insights into AI system effectiveness.
• Analyze testing results and identify trends.
• Develop reports and recommendations.
• Track quality metrics and performance indicators.
• Support root cause analysis activities.

Collaboration & Stakeholder Engagement

• Work closely with technical and business teams.
• Collaborate with AI engineers and product managers.
• Participate in requirements and solution reviews.
• Provide feedback throughout the development lifecycle.
• Support continuous quality improvement initiatives.

Innovation & Continuous Improvement

• Help advance AI testing practices across the organization.
• Evaluate new AI testing methodologies and tools.
• Recommend enhancements to quality frameworks.
• Stay informed about AI and Generative AI developments.
• Contribute to best practices and standards.

WONDER IF YOU ARE A GOOD FIT FOR THIS POSITION?

All positive, and driven applicants are encouraged to apply. The Ideal candidates for this position are highly motivated and dedicated and should possess the below qualities:

• Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field.
• Minimum 3 years of software testing, QA, or technology-related experience.
• Experience creating and executing test plans and test cases.
• Strong analytical and troubleshooting skills.
• Experience documenting defects and test outcomes.
• Understanding of software development lifecycle methodologies.
• Familiarity with AI, machine learning, or Generative AI concepts.
• Strong attention to detail.
• Ability to analyze large volumes of information and identify patterns.
• Strong written and verbal communication skills.
• Experience working within Agile environments.
• Ability to collaborate effectively with technical teams.

Nice to Have

• Experience testing AI or machine learning solutions.
• Knowledge of chatbot testing and conversational AI evaluation.
• Experience with QA automation tools.
• Familiarity with prompt engineering concepts.
• Understanding of AI governance and compliance requirements.
• Experience with in SaaS, technology, or BPO environments.
• Certifications in software testing or quality assurance.
• Exposure to AI evaluation frameworks.