AI Engineer​/Architect

Senior AI Engineer/Architect

We CGI is seeking a highly skilled and experienced Senior AI Engineer/Architect to join our Health Care client in one of our selected client locations. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest leaders in the Health Care industry.

This Senior AI Engineer will be instrumental to design, develop, and lead enterprise grade Generative AI solutions. This role requires deep hands-on expertise in Python, Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and agent-based architectures.

The role will work closely with the AI Center of Excellence (AI CoE) to ensure alignment with enterprise AI standards, governance, and best practices while driving adoption across delivery teams.

This position can be performed from any Client site Bloomfield, CT, Raleigh, NC or Lafayette, LA in a Hybrid working Model.

The AI Engineer/Architect will own the architecture and technical direction for enterprise agentic AI solutions, balancing hands-on engineering with design governance. The role will establish reusable patterns for multi agent orchestration, MCP enabled tool ecosystems, secure backend services, integration, observability, and production reliability.

Key Responsibilities

• AI Architecture & Multi Agent Orchestration
• Architect and implement robust multi agent orchestration using Python and Lang Graph, including intelligent routing, dynamic handoffs, shared state management, long term memory, tool calling, error recovery, and follow up conversation flows.
• Define target and reference architectures for agentic AI, retrieval augmented generation (RAG), model access, memory, evaluation, and human in the loop controls.
• Establish reusable architecture patterns, engineering standards, guardrails, and design review practices for enterprise AI solutions.
• MCP & Agent Ecosystem
• Design, develop, and maintain MCP servers using FastAPI and Python to expose tools, resources, prompts, and custom capabilities as part of the agent ecosystem.
• Define standards for tool contracts, discovery, versioning, permissions, schema validation, error handling, and safe execution.
• Build and maintain custom tools and integrations that connect AI agents with internal APIs, enterprise data sources, and legacy systems.
• AI Powered Products & Domain Solutions
• Design complex AI powered chatbots and insights engines for critical healthcare and pharmacy benefit management workflows, including claims, pharmacy search, drug coverage, and prior authorization.
• Translate business and product requirements into scalable technical designs and guide solutions from proof of concept through production implementation.
• Select appropriate model, RAG, memory, orchestration, and tool use patterns based on quality, latency, cost, security, and compliance requirements.
• Backend Services, Integration & Security
• Own the architecture and development of high-performance FastAPI services, including streaming responses, asynchronous processing, custom middleware, rate limiting, caching, and authentication and authorization strategies.
• Design resilient integration patterns for APIs and legacy platforms, including retries, idempotency, timeouts, circuit breakers, fallbacks, and auditability.
• Ensure solutions follow security, privacy, responsible AI, secrets management, input/output validation, and regulated data handling best practices.
• Observability, Reliability & Optimization
• Implement comprehensive observability using Lang Smith, distributed tracing, monitoring, logging, evaluation, error handling, and performance tuning for AI agent workloads.
• Define service level objectives and quality measures for latency, answer quality, tool accuracy, task completion rate, reliability, and cost.
• Identify and prioritize technical improvements in agent performance, latency, tool accuracy, scalability, and overall system architecture.
• Technical Leadership & Collaboration
• Collaborate cross functionally with frontend, Dev Ops, product, security, data, and enterprise architecture teams to deliver end to end AI capabilities with high reliability.
• Lead…