Principal Clinical AI Evaluation Specialist - MN

Position: Principal Clinical AI Evaluation Specialist - MN Preferred
** Requisition number:
** 2391744

** Job category:
** Business & Data Analytics

At United Healthcare, we're simplifying the health care experience, creating healthier communities and removing barriers to quality care. The work you do here impacts the lives of millions of people for the better. Come build the health care system of tomorrow, making it more responsive, affordable and optimized. Ready to make a difference? Join us to start  
** Caring. Connecting. Growing together.*
* This Principal-level role serves as a senior technical evaluation and AI governance expert within a multidisciplinary team supporting the UHC Clinical AI Governance Council. This individual contributor role is responsible for ensuring that AI-enabled clinical products and use cases are appropriately tested, evaluated, and documented prior to implementation and that evidence presented to the Council is rigorous, reproducible, and aligned with clinical risks, performance metrics, AI safety considerations, and defined success thresholds.

The position owns the evaluation framework and evidence standards used to support AI vendor vetting and clinical AI review. The role ensures that each use case is evaluated against clearly defined risks, metrics, and thresholds to enable objective and consistent Council decision-making. The role advises on and reviews evaluation strategies for clinical AI use cases and, when needed, conducts independent assessments to validate performance claims, testing results, and evidence submitted for Council review.

The role serves as the primary technical and methodological liaison among Council leadership, program consultants, and subject matter experts across clinical, data science, engineering, Legal, and Compliance domains. The position provides independent evaluation of AI-enabled solutions and translates complex AI concepts and evidence into clear, decision-ready recommendations for senior clinical leadership.

You'll enjoy the flexibility to work remotely
* from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.

*
* Primary Responsibilities:

*
* + Partner with Council leadership and program consultants to apply the submission framework to each use case, ensuring analytic components align the AI's intended use and defined risks, metrics, and thresholds

+ Define use case-specific measurable performance, success criteria, translating clinical risks into measurable metrics and thresholds for decision-making

+ Ensure complete and clearly defined evaluation methods at intake, including data, populations, comparators, metrics, test methods, and study design

+ Serve as the primary technical liaison across data science, clinical, and engineering SMEs, synthesizing inputs into a consistent evaluation approach

+ Ensure that evaluation results support clear decisions against defined performance and success thresholds

+ Develop concise, decision-ready summaries of performance against defined thresholds, including key limitations of the AI supported program and AI evaluation methodology

+ Serve as a senior methodological resource during Council review, addressing questions on evaluation design and results

+ Integrate analytic, clinical, and operational inputs into a single, aligned recommendation

+ Define requirements for post-deployment monitoring, including metrics, thresholds, accountable governance groups, and triggers for re-review

+ Design and execute analytic evaluations of clinical AI use cases using real-world healthcare data

+ Perform hands-on data programming, analysis, and interpretation to support Council reviews and broader evaluation initiatives

You'll be…