Generative AI Monitoring Analyst, Compliance & Control, Ratings

About the Role

Grade Level (for internal use): 11

The Generative AI Monitoring Analyst designs and executes a monitoring program focused on the performance and utilization of Generative AI tools within S&P Global Ratings. They are part of the Risk & Compliance Department, serving as a critical control function for S&P Global Ratings. This role supports mitigating risks and enhancing controls for the ongoing quality of S&P’s ratings, research, and other products as the organization expands its use of Generative AI tools.

The Analyst participates in risk-based activities, including reviewing large data sets and developing tests and tools to detect unusual or problematic performance or usage, and collaborates with other control team members to investigate findings.

The role is part of a global, collaborative team and requires excellent multi-tasking, attention to detail, strong verbal and written communication, and the ability to analyze and solve problems in a timely and insightful manner. It will suit a diligent, analytically curious self-starter with a strong work ethic and the drive to succeed.

Key Responsibilities

• Risk and Controls Analysis:
  Assess the effectiveness of controls over the operation of Generative AI tools and models and review structured and unstructured data from internal and external sources used in Generative AI tools and models.

• Demonstrates an understanding of AI tools and risks, gaining a comprehensive working knowledge of S&P’s relevant tools, and assists in generating and preparing metrics and reporting on AI-generated data input/output.

• Evaluates the performance of Generative AI tools to ensure they function as expected and that uses remain as intended through risk-based monitoring reviews.

• Assesses the adequacy and effectiveness of governance of AI tools from development to operation and subsequent revisions.

• Coordinates with global offices to ensure data analyses and reports are accessible to all relevant stakeholders and treated consistently.

• Assists with planning, organizing, executing, and documenting all activities. Conducts ad-hoc research as necessary.

• Conducts regular reviews and audits to ensure compliance with established standards.

Analytical Platforms

• Applies knowledge of Excel or other programming languages, such as Python or R, to contribute to the oversight of the development and application of tools that utilize AI to facilitate analyses, visualizations, and the development of risk-based monitoring reviews.

(This section is only applicable to US candidates) S&P Global states that the anticipated base salary range for this position is $116,000 to $143,000. Final base salary for this role will be based on geographic location, experience level, skill set, training, licenses and certifications.

Basic

Required Qualifications:

• 3+ years of relevant experience in financial services.

• Knowledge of risk management and framework development to conduct compliance monitoring reviews.

• Knowledge of automation techniques.

• Knowledge of AI and machine learning.

• Understanding of financial markets, the business environment, and financial data.

• Proficiency with Excel, SQL, and Python required.

• Experience in data mining, data warehousing, and data mapping.

• BA or BS in a business or financial engineering field.

Preferred Qualifications:

• MBA

• Proficiency with VBA and R

Right to Work Requirements: This role is limited to persons with an indefinite right to work in the United States.

Hybrid Work Requirements: All employees are required to work from the office a minimum of 2 days per week.

Interview Requirements: All candidates who reach the final stage of our interview process must attend at least one in-person interview, ordinarily at the nearest S&P Global Ratings office, before we can proceed to an offer.

At S&P Global Ratings, our analyst-driven credit ratings, research, and sustainable finance opinions provide critical insights that translate complexity into clarity for market participants to uncover opportunities and make decisions with conviction. We enable growth across a wide variety of…