AI​/ML Platform Architect

AI/ML Platform Architect

Req number: R7127

Employment type: Full time

Worksite flexibility: Hybrid

CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

As the AI/ML Platform Architect, you will be responsible for defining technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions.

We are looking for an AI/ML Platform Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time, hybrid, and based in Bangalore.

Enterprise AI Architecture & Strategy

• Define technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions

• Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes, and API management platforms

• Establish architectural standards for LLM integration (Claude, OpenAI), RAG systems, vector databases, and AI orchestration

• Drive technology selection for frontend (React/Angular), backend (FastAPI, Node.js), databases (Postgre
  
  SQL, Mongo
  
  DB, Open Search), and AI frameworks (Lang Chain, Llama Index)

AI Governance & Security Architecture

• Design AI governance frameworks including usage tracking, cost optimization, access control (RBAC/ABAC), and compliance enforcement (SOC 2, GDPR)

• Architect API security patterns (OAuth 2.0, JWT, mTLS), data encryption, and audit logging for AI platforms

• Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation

Technical Leadership & Collaboration

• Provide technical leadership to engineering teams (backend, frontend, AI/ML, Dev Ops) across India CoE and Singapore

• Conduct architecture reviews, design reviews, and guide implementation decisions for high-impact GenAI projects

• Collaborate with product managers, business stakeholders, and executive leadership to align technical architecture with business objectives

• Mentor architects and senior engineers on cloud-native design, AI/ML best practices, and enterprise integration patterns

MLOps & Integration Architecture

• Design MLOps pipelines for AI model deployment, versioning, monitoring, and A/B testing

• Architect enterprise integrations with APIs, message brokers (Kafka, Rabbit
  
  MQ), and legacy systems using event-driven patterns

• Define observability and monitoring strategies using Prometheus, Grafana, Datadog, and Cloud Watch

Required:

Enterprise Architecture Expertise

• 15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions

• Deep expertise in cloud-native architectures (AWS/Azure), microservices, API design, and distributed systems

• Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering, agentic frameworks)

• Proven experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements

Technical Depth

• Expert-level knowledge of backend frameworks (FastAPI, Node.js, Django), frontend frameworks (React, Angular), and database systems (SQL, No
  
  SQL, vector databases)

• Strong understanding of AI/ML frameworks (Lang Chain, Llama Index, Hugging Face), model serving (Tensor Flow Serving, Triton), and MLOps practices

• Proficiency in API management (Mule Soft, Apigee, Kong), event-driven architectures, and message brokers (Kafka, Rabbit
  
  MQ)

• Deep knowledge of security (OAuth 2.0, JWT, encryption, OWASP), compliance (SOC 2, GDPR), and data privacy

Leadership & Communication

• Proven ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment

• Excellent communication skills with ability to…