AI QA - Lead Engineer​/Manager

AI QA - Lead Engineer / Manager

Join to apply for the AI QA - Lead Engineer / Manager role at Lenovo

Lenovo is a US $69 billion revenue global technology powerhouse, ranked #196 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services.

Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere.

This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit , and read about the latest news via our Story Hub.

Quality is what makes AI trustworthy. Lenovo is hiring an AI QA - Lead Engineer/ Manager that ensures our AI systems are not just powerful but reliable, fair, and safe for deployment 'll shape the quality culture that allows the Core Intelligence team to innovate rapidly while maintaining production excellence. You will lead the AI Quality Engineering function in the AI Ecosystem team, building the testing infrastructure and quality gates that ensure our AI/ML models, agentic systems, and data pipelines meet the highest standards of accuracy, fairness, and reliability before reaching millions of users.

Chicago, IL – Hybrid (3 days on‑site, 2 days remote)

• Design and implement comprehensive test frameworks for AI/ML systems: LLMs, vision models, RAG pipelines, agentic workflows.
• Build automated evaluation systems for model outputs—accuracy, relevance, bias detection, hallucination monitoring.
• Create quality benchmarks and continuous testing pipelines for generative AI (content quality, safety, brand alignment).
• Develop performance monitoring infrastructure: model drift detection, data quality validation, inference latency tracking.
• Establish AI‑specific quality gates and work with product/engineering teams in Agile sprints to define acceptance criteria.
• Lead a team of AI QA engineers and drive best practices for responsible AI development.
• Stay ahead of AI testing trends: adversarial testing, red‑teaminig, AI safety evaluation.

• 7+ years in QA/test engineering, with 3+ years focused on AI/ML systems.
• Bachelor’s degree in Engineering or Computer Science.
• Experience with ML model evaluation: classification metrics, NLP evaluation (BLEU, ROUGE, human eval), vision model testing.
• Experience building test automation frameworks (Python, pytest, CI/CD pipelines).

• Strong collaboration skills—comfortable working with data scientists, ML engineers, and product managers.
• Passion for AI quality and keeping current with testing methodologies for generative AI.
• Knowledge of AI risks: bias, fairness, safety, hallucinations, adversarial attacks.

Base salary budgeted range: $180K–$220K. Individuals may also be considered for bonus and/or commission.

Lenovo’s benefits can be found at

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, national origin, status as a veteran, and basis of disability or any federal, state, or local protected class.