Director - AI Validation and Monitoring

** Why Mayo Clinic*
* Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans ((Use the "Apply for this Job" box below).)  - to take care of you and your family, now and in the future.

And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.

** Benefits Highlights*
* + Medical:
Multiple plan options.

+ Dental:
Delta Dental or reimbursement account for flexible coverage.

+ Vision:
Affordable plan with national network.

+ Pre-Tax Savings: HSA and FSAs for eligible expenses.

+ Retirement:
Competitive retirement package to secure your future.

** Responsibilities*
* The Director - AI Validation and Monitoring is the organizational architect of Mayo's policies and processes for measuring, monitoring, and reporting on the real-world effectiveness of AI systems used in clinical practice. As the AI portfolio grows to encompass predictive analytics, generative AI, and agentic AI across clinical and patient experience activities in the Practice, this leader will ensure that every deployed model meets Mayo performance and safety standards and continues to perform as intended - and that performance is defined not just by technical accuracy, but by clinical impact, patient safety, and return on investment.

Reporting to the Senior Director, AIA, the Director will build the talent, infrastructure, and culture necessary to make rigorous AI evaluation a continuous organizational capability rather than a one-time validation event.

The Director also designs and operationalizes a pre- and post-deployment performance monitoring and reporting program that tracks model performance across diverse care settings, patient populations, and time horizons - detecting drift, degradation, and disparate impact before they translate into low performance, clinical harm or operational inefficiency. This leader will develop standardized evaluation frameworks that define success metrics for each AI use case in collaboration with clinical, operational, and financial stakeholders, ensuring alignment between technical performance indicators and meaningful outcomes such as patient benefit, patient volume, and clinician burden.

The Director will oversee the build-out of dashboards and reporting pipelines that surface AI performance data to AIA and Practice leadership. They will also support structured retrospective reviews when AI-assisted decisions contribute to adverse events or near-misses, working in close partnership with patient safety, quality, and legal teams to drive corrective action and continuous improvement.

Additionally, the Director partners with other AIA components to ensure that performance evaluation supports AIA and Mayo goals for high-performing, transformative clinical care. The Director will be the enterprise nexus for advancing Mayo's leadership in robust yet practical performance and risk evaluation to elevate current standards of care, partnering closely with Practice leaders across departments and sites, as well as other enterprise governance leaders and bodies.

Above all, the successful candidate will be a credible, collaborative leader who can work across the boundaries of AI technology, data science, clinical medicine, and operations - translating evaluation findings into the institutional learning that makes AI better and safer for every patient we serve.

Key Responsibilities

+  
** AI Strategy & Program Leadership:
** Lead development and execution of enterprise AI strategy and multi-year roadmaps aligned with organizational goals.

+  
** Portfolio Oversight:
** Oversee intake, prioritization, and sequencing of AI initiatives; balance value, feasibility, risk, and capacity across portfolios.

+  
** Cross‑Functional Leadership:
** Partner with clinical, operational, technical, legal, compliance, and data leaders to advance AI initiatives from concept through deployment.

+  
** Governance & Responsible AI:
** Ensure AI initiatives…