AI Resilience and Incident Manager - Conversational AI - Remote

You will enjoy the flexibility to work remotely from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.

• Develop & implement AI Resilience Strategy:
  Create a comprehensive, documented strategy outlining processes for identifying, escalating, and remediating AI‑related issues within our conversational healthcare applications—specifically focusing on mitigating hallucinations, inaccurate responses, and other unexpected behaviors. Given our industry, accuracy and patient safety are paramount.
• Simulation & Testing:
  Design and execute rigorous simulation testing scenarios—including adversarial testing—to proactively assess our AI systems’ robustness in conversational contexts. This includes creating repeatable testing plans, documenting results, and identifying areas for improvement.
• Process Development:
  Define detailed, step‑by‑step processes for various levels of intervention, ranging from assisting Product Owners with prioritization to coordinating executive responses if challenges occur. Clear escalation paths and communication protocols are vital.
• Documentation & Policy Creation:
  Meticulously document all processes, risk assessments, remediation strategies, and incident response procedures, establishing clear guidelines for teams globally. Detail orientation and adherence to HIPAA and other relevant regulations (e.g., guidance on AI, data privacy laws) are critical.
• Risk Assessment & Prioritization:
  Analyze potential AI risks—particularly those impacting patient safety, data privacy, and compliance—and develop a framework for prioritizing remediation efforts based on impact and probability.
• Communication & Influence:
  Clearly and concisely communicate complex technical information to diverse audiences—including product teams, engineering, clinical stakeholders, and potentially external media—often under pressure. You’ll be a key spokesperson during incidents.
• Crisis Management:
  Remain calm and focused during high‑pressure situations, guiding teams through responses to AI outages and ensuring a measured and effective recovery—particularly in situations requiring rapid escalation to executive leadership.
• P1/P2 Outage Involvement:
  Actively participate in the response and recovery efforts for P1 (High Priority) and P2 (Medium Priority) outages of the AI platform, contributing to rapid root‑cause analysis and implementing corrective actions.
• Media Response Support:
  Work closely with the Communications & Public Relations team to prepare and disseminate accurate information to the media in the event of high‑profile AI incidents.
• Conversational Experience Focus:
  Specifically analyze and mitigate risks associated with generative AI in conversational healthcare applications—including the potential for biased responses, inappropriate recommendations, and the impact on patient‑clinician interactions. We primarily focus on applications such as mobile applications, member portals, conversational dialog, and Decision Support Systems.
• AI Legal & Regulatory Monitoring:
  Proactively monitor and analyze emerging AI laws, regulations, and industry best practices, particularly those impacting the healthcare sector. Translate these developments into actionable insights and recommendations for the organization.

You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

• 5+ years of experience in Product Risk, AI Governance, Operational Risk, Data Science, Analytics, or a related technical field, preferably within the healthcare industry.
• Deep understanding of generative AI models, conversational AI, and the potential challenges associated with deployment—specifically focusing on biases, hallucinations, and prompt injection vulnerabilities.
• Proven excellent analytical and problem‑solving skills, with the ability to interpret data, identify root causes, and…