System Architect Director - AI Platform Engineering
Job in
Chicago, Cook County, Illinois, 60290, USA
Listed on 2026-06-23
Listing for:
01460 Continental Casualty Company
Full Time
position Listed on 2026-06-23
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Software Architect, DevOps
Job Description & How to Apply Below
The System Architect (SA) Director for AI Platforms Engineering serves as the technical owner for the enterprise AI platform, the shared foundation powering all AI and GenAI products across the organization. This leader owns the platform's architecture, engineering standards, and delivery roadmap, translating strategic AI capabilities into reliable, scalable, and governed platform capabilities that accelerate every product team building on top of them.
Responsibilities- Own and continuously evolve the enterprise AI Platform reference architecture, encompassing all critical layers including model serving, orchestration engines, data and knowledge grounding pipelines, observability infrastructure, and ensuring the platform scales reliably to enterprise‑grade workloads and usage patterns.
- Define and enforce platform‑wide standards, reusable design patterns, and golden‑path templates that enable product and feature teams to build, deploy, and operate AI solutions safely, consistently, and with significantly reduced time‑to‑production.
- Drive end‑to‑end delivery of new platform capabilities — from initial technical discovery and architecture design through prototyping, hardening, and full production rollout while maintaining meaningful hands‑on involvement at critical technical milestones to ensure quality and coherence.
- Architect and operationalize the core platform service catalog, including LLM gateway and routing layers, prompt lifecycle management, agentic orchestration frameworks, Retrieval‑Augmented Generation (RAG) pipelines, vector stores, model registries, and rigorous automated evaluation infrastructure.
- Build and maintain robust CI/CD and AIOps pipelines specifically designed for AI systems, incorporating automated evaluation gates, model and data versioning controls, staged deployment promotion, and continuous cost and performance optimization guardrails.
- Architect enterprise‑grade multi‑agent and single‑agent workflow patterns for high‑value business use cases, establishing clear standards for orchestration design, state and memory management, tool and API integration, and safe autonomy controls including human‑in‑the‑loop approvals, permission scoping, and comprehensive audit trails.
- Design and implement knowledge grounding systems — spanning hybrid retrieval strategies, semantic reranking, ontology‑driven entity modeling, and knowledge graph integration — to measurably improve AI output accuracy, traceability, and readiness for regulatory audit.
- Embed responsible AI and compliance‑by‑design principles into every layer of the platform, covering data privacy protections, enterprise secrets management, granular access controls, output leakage prevention, and model risk governance practices aligned to enterprise and regulatory standards.
- Actively shape PI Planning by authoring well‑defined Enabler Epics and articulating architectural outcomes that anchor near‑term delivery and long‑horizon platform capability roadmaps, while contributing expert WSJF input to balance platform investment against feature team needs, risk reduction, and time‑to‑impact.
- Directly manage, mentor, and grow a high‑performing team of platform engineers, solution architects, and technical specialists — hiring hands‑on builders, coaching technical leadership skills, and sustaining a healthy innovation pipeline that continuously advances the organization’s AI platform maturity.
- May perform additional duties as assigned.
- Deep AI Platform and AIOps engineering expertise, including hands‑on experience designing, deploying, and operating shared AI platform capabilities such as model serving layers, LLM gateway and proxy services, prompt registries, vector databases, and automated evaluation harnesses at enterprise scale.
- Proven agentic system design capability, with hands‑on experience architecting multi‑agent and single‑agent workflow systems using orchestration frameworks such as Lang Graph, Google ADK — including tool and function calling patterns, state and memory persistence strategies, and robust safe autonomy controls.
- Applied GenAI depth spanning LLM solution architecture patterns, model…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×