AI Auditor, Principal

Job Description

The Internal Audit Services team provides independent, objective assurance and advisory services to help Blue Shield of California manage risk, strengthen internal controls, and improve business processes. The AI Internal Audit Principal will serve as a manager-level leader responsible for overseeing audit, compliance, fraud detection, and investigative work related to the use and misuse of artificial intelligence systems.

In this role, you will lead and oversee AI-focused audits looking at usage, systems, algorithms with a focus on identifying inappropriate, nefarious, fraudulent, and non-compliant activity. In this role you will essentially look for bad actors / activity via AI. Experience with fraud, compliance and investigations is preferred. The AI Internal Audit Principal will partner closely with audit leadership, business stakeholders, technology teams, data science teams, Compliance, Legal, HR, Privacy, Information Security, Corporate Security, and investigations partners to identify AI-related fraud risks, detect suspicious activity, and strengthen controls that prevent, identify, and respond to misuse of AI.

Our leadership model is about developing great leaders at all levels and creating opportunities for our people to grow – personally, professionally, and financially. We are looking for leaders that are energized by creative and critical thinking, building and sustaining high-performing teams, getting results the right way, and fostering continuous learning.

In this role, you will:

• Lead AI-focused internal audits, advisory reviews, and investigative projects designed to detect inappropriate, nefarious, fraudulent, unauthorized, unethical, or non-compliant AI activity
• Develop audit and investigative methodologies for detecting fraud, insider threat, compliance violations, data leakage, unauthorized automation, and misuse of internal or third-party AI platforms
• Evaluate AI system activity, user behavior, prompts, outputs, access patterns, model interactions, system logs, configuration changes, and workflow data for indicators of bad actors or suspicious activity
• Assess controls designed to prevent unauthorized disclosure of confidential, proprietary, regulated, member, provider, employee, or business-sensitive information through AI systems
• Identify emerging AI-enabled fraud risks, including AI-assisted scams, synthetic identities, prompt manipulation, deepfakes, falsified documentation, automated abuse, model circumvention, and inappropriate use of generative AI tools
• Lead cross-functional fact-finding and root-cause reviews involving suspected AI misuse, fraud, compliance violations, inappropriate data use, or circumvention of control processes
• Design continuous monitoring approaches and analytics to identify patterns of high-risk AI usage, anomalous behavior, suspicious system interactions, and potential policy violations
• Develop risk-based audit plans, control matrices, testing procedures, investigative workplans, and evidence standards for AI fraud, misuse, and compliance monitoring engagements
• Supervise and coach audit team members, including review of investigative documentation, testing evidence, work papers, issue summaries, and audit deliverables for quality, accuracy, and audit readiness
• Communicate fraud patterns, emerging threats, root causes, control gaps, and practical recommendations to audit leadership, business partners, technology leaders, Compliance, Legal, HR, Privacy, Information Security, and executive stakeholders
• Support annual audit planning by identifying AI platforms, business processes, high-risk use cases, data sources, and enterprise initiatives that may warrant fraud-focused audit coverage
• Drive continuous improvement in AI fraud detection playbooks, control libraries, audit analytics, investigative templates, issue rating approaches, and remediation validation procedures
• Promote ethical technology use, strong accountability, effective monitoring, compliant AI adoption, and a culture that identifies and escalates inappropriate AI activity

In this role, you will:

• Requires a Bachelor's degree in Accounting, Information Systems, Computer Science, Data Science, Business Administration, Cybersecurity, Criminal Justice, Engineering, or related field; advanced degree preferred, or equivalent experience
• Requires a minimum of 10 years of prior related experience in internal audit, IT audit, technology risk, compliance, fraud detection, investigations, information security, data governance, model risk management, or related assurance functions
• At least 3 years of experience auditing, reviewing, investigating, governing, implementing, or monitoring artificial intelligence, machine learning, advanced analytics, automation, or data-driven decision systems
• CISA certification required, or equivalent certification such as CIA, CISSP, CRISC, CISM, CPA, CDPSE, CFE, or other relevant audit, risk, security, privacy, investigations, fraud, or technology…