AI Development and Enablement Analyst

The AI Development and Enablement Analyst supports the Bank’s responsible adoption of artificial intelligence by designing, building, testing, publishing, and maintaining approved AI agents and related automation capabilities. This role helps translate business needs into practical, governed AI solutions that improve efficiency, improve access to internal knowledge, support process consistency, and mature the Bank’s use of AI in a safe, controlled, and measurable manner.

The position is responsible for creating and supporting centrally published agents, validating agents developed by other Bank groups or third parties, maintaining the inventory of AI use cases and published agents, and partnering with Technology, Information Security, Risk, Compliance, Legal, Audit, Model Risk Management, and business stakeholders to ensure AI solutions are aligned with approved standards, governance expectations, and business objectives.

The analyst serves as a hands‑on builder, tester, documentation owner, and lifecycle support resource for AI agents across the Bank.

• Design, build, configure, test, publish, and support approved AI agents using Bank-approved platforms such as Microsoft Copilot Studio, Microsoft 365 Copilot, enterprise knowledge sources, workflow automation tools, and other approved AI capabilities.
• Partner with business units to evaluate AI use case requests, clarify business objectives, define scope, identify intended users, document expected outputs, and establish appropriate guardrails before development or deployment.
• Develop and maintain agent instructions, prompts, knowledge source configurations, connectors, fallback responses, DISCLAIMERS??
• Perform structured testing of AI agents before release, including expected answer testing, source grounding validation, boundary testing, unauthorized information request testing, hallucination checks, prompt injection or misuse testing, and user acceptance testing.
• Review, test, and maintain AI agents or AI-enabled solutions created by other Bank teams, citizen developers, vendors, or third parties to ensure alignment with Bank standards, approval conditions, access controls, and lifecycle requirements.
• Maintain the enterprise inventory of AI use cases, approved tools, published agents, agent owners, business purposes, knowledge sources, risk classifications, review dates, test results, deployment status, exceptions, and retirement status.
• Coordinate with the Application and Architecture Review Board, Technology Steering Committee, Information Security, Model Risk Management, Legal, Compliance, Audit, Third Party Risk Management, and business owners to support governance review and approval processes.
• Monitor published agents after release by reviewing usage, user feedback, failed searches, inaccurate responses, escalation activity, knowledge source freshness, access issues, and other operational indicators.
• Create and maintain documentation for each published agent, including purpose, scope, data sources, permissions, ownership, test evidence, change history, known limitations, support procedures, and periodic review records.
• Support ongoing maintenance of AI agents by updating instructions, refreshing knowledge sources, adjusting configurations, remediating defects, retiring outdated agents, and ensuring changes are documented and approved as required.
• Develop metrics, dashboards, and management reporting related to AI use cases, agent adoption, user feedback, operational performance, control effectiveness, issue remediation, and AI maturity progress.
• Assist with AI awareness, training, and enablement activities by helping users understand appropriate AI use, effective prompt practices, agent limitations, responsible use…