AI Auditor, Senior

Job Description

The Internal Audit Services team provides independent, objective assurance and advisory services to help Blue Shield of California manage risk, strengthen internal controls, and improve business processes. The AI Internal Audit Consultant will support audit, compliance, fraud detection, and investigative activities focused on the use and misuse of artificial intelligence systems.

In this role, you will assist with AI-focused audits looking at usage, systems, algorithms with a focus on identifying inappropriate, nefarious, fraudulent, and non-compliant activity. In this role you will essentially look for bad actors / activity via AI. Experience with fraud, compliance and investigations is preferred. The AI Internal Audit Consultant will help evaluate AI activity, system usage, data flows, prompts, outputs, logs, access patterns, process documentation, and control evidence to identify suspicious behavior, potential compliance violations, fraud indicators, or inappropriate use of AI tools.

Our leadership model is about developing great leaders at all levels and creating opportunities for our people to grow – personally, professionally, and financially. We are looking for leaders that are energized by creative and critical thinking, building and sustaining high-performing teams, getting results the right way, and fostering continuous learning.

In this role, you will:

• Support AI-focused audits, advisory reviews, and investigative activities designed to identify inappropriate, suspicious, fraudulent, unauthorized, unethical, or non-compliant AI activity
• Perform testing and analysis of AI system activity, user behavior, prompts, outputs, logs, access patterns, workflow data, and system usage trends to identify indicators of misuse or fraud
• Assist with investigations involving AI-enabled fraud, insider threat, policy violations, unauthorized data use, inappropriate AI activity, suspicious automation, or circumvention of controls
• Review system documentation, AI platform configuration, model documentation, data flows, policies, procedures, control evidence, monitoring reports, and technical artifacts to identify risks and control gaps
• Analyze AI platform data and business process data for anomalous behavior, unusual usage patterns, excessive access, suspicious outputs, unauthorized automation, or high-risk user activity
• Document audit procedures, investigative steps, evidence reviewed, testing results, exceptions, conclusions, and work papers in accordance with internal audit methodology
• Support interviews, walkthroughs, and fact-gathering activities with business stakeholders, technology teams, data scientists, Compliance, Legal, HR, Privacy, Information Security, and control owners
• Assist in developing clear audit observations and investigative findings that explain risk, root cause, impact, evidence, and practical recommendations
• Conduct data analytics to identify patterns, clusters, outliers, and trends that may indicate nefarious activity, fraud risk, control failure, or non-compliant AI usage
• Research emerging AI misuse and fraud techniques, including prompt manipulation, synthetic content, deepfakes, data leakage, AI-assisted scams, automated abuse, and unauthorized decision support
• Track remediation activities and support follow-up testing to validate whether corrective actions address identified AI misuse, fraud, compliance, or control issues
• Contribute to AI fraud detection playbooks, audit templates, investigative procedures, control libraries, testing scripts, dashboards, and methodology improvements
• Maintain strong professional relationships with stakeholders while preserving internal audit independence, objectivity, confidentiality, and evidence integrity

Your Knowledge and Experience

• Requires a Bachelor's degree in Accounting, Information Systems, Computer Science, Data Science, Business Administration, Cybersecurity, Criminal Justice, Engineering, or related field, or equivalent experience
• Requires a minimum of 5 years of prior related experience in internal audit, IT audit, technology risk, compliance, fraud detection, investigations, information security,…