AI Solutions Analyst; Analyst Sr

AI Solutions Analyst (ITS Analyst Sr)

Cal Optima

Join Us in this Amazing Opportunity

We are a mission driven community-based organization that serves member health with excellence and dignity, respecting the value and needs of each person. If you are ready to advance your career while making a difference, we encourage you to review and apply today and help us build healthier communities for all.

We are hoping you will join us as a AI Solutions Analyst (ITS Analyst Sr) and help shape the future of healthcare where you'll be an integral part of our IT - Data Warehouse and Analytics Technology team, helping to strive for excellence while we serve our member health with dignity, respecting the value and needs of each of our members through collaboration with our providers, community partners and local stakeholders.

This position has been approved to be Full Telework.

• If telework is approved, you are required to work within the State of California only and if Partial Telework, also come in to the Main Office in Orange, CA, at least two (2) days per week minimum.

The AI Solutions Analyst will serve as a subject matter business analyst for the AI solution lifecycle, from opportunity identification and use case intake through implementation, adoption measurement, and outcome realization. You will lead this work and will be accountable for the quality and business relevance of the solutions delivered. You will identify and scope AI use cases and translate them into well-defined solution designs, partnering with clinical, quality, and operations Information Technology (IT) functional business leaders to define problem statements, document requirements, and establish how success will be measured.

On each use case, the incumbent will work with the AI Solutions Engineer on technical build and Enterprise Architecture on design and platform decisions. A core responsibility is validating AI model outputs and downstream inferences for accuracy, consistency, business relevance, and algorithmic bias before results are acted upon, escalating any identified fairness or bias findings to the AI/ML Governance Committee for adjudication.

You will measure and communicate AI program performance, adoption, and value to department leadership, including building explainability and outcome dashboards. As the program matures, the incumbent will help build an AI Community of Practice, enabling business unit AI Champions to identify, scope, and submit high-quality use cases. The AI Solutions Analyst will ensure AI-assisted workflows operate within Health Insurance Portability and Accountability Act (HIPAA) requirements, enterprise AI governance standards, and applicable vendor agreement obligations, partnering with cybersecurity, data governance, compliance, and analytics functions as needed.

Together, we are building a stronger, more equitable health system.

• 90% - Technical Responsibilities
• Participates in a mission-driven culture of high-quality performance with a member focus on customer service, consistency, dignity, and accountability.
• Assists the team in carrying out departmental responsibilities and collaborates with others to support short- and long-term goals and priorities for the department.
• Collaborates with clinical, quality, and operations IT functional business leaders to define business problems holistically before any AI solution is evaluated, ensuring use cases are grounded in clearly articulated business metrics and measurable outcomes.
• Translates validated business problems into structured AI solution designs, documenting solution requirements, success criteria, data readiness assessments, and infrastructure dependency findings for each use case entering the governance pathway.
• Validates AI model outputs for accuracy, consistency, hallucinations, and business relevance prior to business use.
• Reviews AI model outputs across operational, clinical, and quality workflows to detect patterns where the AI may produce inconsistent or inequitable results across member populations.
• Builds and maintains AI program explainability, adoption, and outcome dashboards within the organization's Power BI environment, communicating to department leadership what the AI flagged, what was human-reviewed, model confidence levels, and program value against defined success criteria.
• Establishes baseline metrics for each use case and tracks realized business value (productivity gains, cost…