More jobs:
Lead Technology Product Manager, AI Quality & Evaluation
Job in
Springfield, Sangamon County, Illinois, 62701, USA
Listed on 2026-10-26
Listing for:
Wolters Kluwer
Full Time
position Listed on 2026-10-26
Job specializations:
-
Quality Assurance - QA/QC
AI Business & Operations -
IT/Tech
AI Business & Operations
Job Description & How to Apply Below
As Senior Product Manager, AI Quality & Evaluation, you will play a core role in translating clinical quality standards and evaluation strategy into scalable product capabilities. Working under product leadership and in close partnership with clinical, technical, and data experts, you will help define the requirements, workflows, tooling, automation, and reporting needed to evaluate AI-enabled experiences before and after launch.
This role does not own the clinical quality standard or statistical methodology. It helps make those standards operational at scale through usable tools, repeatable workflows, measurable signals, and clear evidence that supports product decisions, customer trust, and responsible AI. What You'll Do Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities. Drive discovery and delivery for defined AI quality and evaluation capabilities, including tooling, automation, monitoring, evidence capture, and reporting.
Partner with clinical, data science, engineering, product, legal, compliance, and customer-facing teams to operationalize AI evaluation before and after launch. Identify opportunities to automate and scale evaluation workflows while preserving appropriate expert oversight. Define product requirements for review workflows, issue triage, launch readiness, post-launch monitoring, and quality reporting. Use evaluation insights to inform product improvements, user experience, content quality, model behavior, and operational processes.
Track emerging market practices and customer expectations related to AI quality, evaluation, benchmarking, and responsible AI. Translate AI quality and evaluation practices into clear narratives for product leaders, customer-facing teams, and internal stakeholders. What You'll Bring 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas. Strong product discovery and execution skills, including requirements definition, roadmap planning, experimentation, and metrics-driven decision-making.
Ability to translate complex clinical, technical, quality, or risk concepts into practical product requirements and workflows. Experience working with engineering, data, clinical, compliance, customer-facing, or operational stakeholders. Strong analytical thinking and comfort defining metrics, dashboards, workflows, and decision criteria. Strong communication skills, especially around quality, trust, tradeoffs, evidence, and customer value. Curiosity and learning agility around AI, evaluation methods, responsible AI, and emerging technologies.
Preferred Background
Experience with AI-enabled products, healthcare technology, quality tooling, data products, search/retrieval quality, content quality, clinical validation, or decision-support products. Familiarity with AI evaluation methods, benchmarks, monitoring, human-in-the-loop review, automation, or applied machine learning concepts. Experience in healthcare, clinical workflows, regulated environments, or professional-information products. Experience supporting customer-facing narratives around product quality, trust, or responsible technology. What Success Looks Like Expert-defined quality standards are translated into scalable product workflows, tools, and requirements.
Evaluation processes become more automated, repeatable, measurable, and usable by cross-functional teams. Product teams have clearer quality signals and launch-readiness criteria for AI-enabled experiences. Evaluation insights improve product quality, customer trust, user experience, and responsible AI practices. Customer-facing teams can clearly explain how AI quality and trust are evaluated.#LI-Hybrid Our Interview Practices To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts.
Our interview process is designed to…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×