×
Register Here to Apply for Jobs or Post Jobs. X

Generative AI Platform Manager, Vice President

Job in Quincy, Norfolk County, Massachusetts, 02171, USA
Listing for: State Street
Full Time position
Listed on 2026-10-08
Job specializations:
  • Software Development
    AI Engineer (Applied/Software)
Salary/Wage Range or Industry Benchmark: 120000 - 203000 USD Yearly USD 120000.00 203000.00 YEAR
Job Description & How to Apply Below
About the Role

We're seeking a strategic, hands-on VP to lead the design and delivery of our enterprise Generative AI platform. Primary depth required in AWS Bedrock, Azure AI Foundry, Azure OpenAI, and Databricks
, with strong skills in IaC authorship, Harness CI/CD, Fin Ops, and AI-assisted developer tooling. You'll set technical direction, author production-grade constructs, mentor senior engineers, and enable data scientists and application teams to ship Gen AI solutions at scale.

Key Responsibilities

AWS Bedrock Platform (Primary)

  • Own enterprise Bedrock strategy: model access governance, provisioned throughput, cross-region inference, multi-account architecture
  • Operationalize Knowledge Bases, Agents, Guardrails, Prompt Management, Flows, and Model Evaluation
  • Lead FM lifecycle across Claude, Nova/Titan, Llama, Mistral, and Cohere
  • Design RAG on Bedrock with Open Search Serverless, Aurora pgvector, and Kendra
  • Optimize consumption: on-demand vs. PT, model routing, prompt caching, token efficiency

Azure AI Foundry & Azure OpenAI (Primary)

  • Own Foundry hub/project architecture, model catalog governance, and quota management
  • Lead Azure OpenAI patterns (PTU vs. PAYG, capacity planning, content filters) across GPT-4o, GPT-4.1, and o-series models
  • Architect RAG/agent workloads with AI Search, prompt flow, and Agent Service
  • Implement Content Safety, private networking, Entra , CMK, and data residency controls

Databricks & Data-Centric AI (Primary)

  • Own Databricks strategy on AWS and Azure: workspace architecture, Unity Catalog, cluster policies
  • Lead Mosaic AI adoption:
    Model Serving, Vector Search, Feature Store, AI Gateway, MLflow
  • Architect fine-tuning/pretraining pipelines and lakehouse-native RAG on Delta Lake
  • Establish DBU cost controls and serverless governance

Infrastructure as Code & Golden Paths

  • Author L2/L3 CDK constructs (Type Script/Python), Bicep modules, and Terraform for multi-cloud AI infra
  • Codify secure-by-default "golden paths" enabling teams to launch Gen AI workloads in hours
  • Standardize config-as-code, secrets management, and drift detection

Harness CI/CD

  • Own Harness pipelines, templates, and delegates for Bedrock, Azure OpenAI, Foundry, and Databricks Asset Bundles
  • Integrate with Git Ops, Terraform/CDK/Bicep, OPA policy-as-code, and approval gates
  • Establish reference pipelines with linting, security scanning, model eval, and cost checks

Developer Experience

  • Champion Claude Desktop, MCP servers, and AI coding assistants (Copilot, Cursor, Claude Code)
  • Build internal MCP servers exposing enterprise systems to agentic clients
  • Define secure usage patterns for regulated environments; measure productivity impact

Governance & Leadership

  • Establish security, compliance, and responsible AI controls (red-teaming, audit logging, guardrails)
  • Build observability across Cloud Watch, Azure Monitor, Databricks system tables, Grafana, Datadog
  • Partner with Data, MLOps, Security, and Application leadership; recruit and mentor a top-tier team
Required Skills
  • Bedrock: Knowledge Bases, Agents, Guardrails, Flows, PT;
    Claude, Nova, Llama, Mistral; RAG and vector stores (Open Search, pgvector, Pinecone, Kendra); agent frameworks (Bedrock Agents, Lang Graph, Strands)
  • Azure AI: Foundry hubs/projects, prompt flow, Agent Service;
    Azure OpenAI (GPT-4o/4.1, o-series, PTU); AI Search;
    Content Safety
  • Databricks: Mosaic AI, Vector Search, AI Gateway, MLflow, Unity Catalog, Asset Bundles, Delta Lake
  • IaC: CDK L2/L3 (TS/Python), Bicep, Terraform (multi-cloud), secrets management
  • CI/CD: Harness (YAML pipelines, delegates, templates, Git Ops), OPA/Rego, Git Hub Actions, Azure Dev Ops
  • Fin Ops: Token/PTU/DBU governance, tagging, chargeback, capacity planning, token/model optimization
  • Dev Tooling: Claude Desktop, MCP server authoring, Claude Code, Copilot, Cursor
  • Cloud: Deep AWS + Azure (networking, IAM/Entra , private endpoints);
    Docker/Kubernetes (EKS/AKS); serverless; API design; complementary GCP/Vertex AI
  • Data: Delta Lake, Unity Catalog, RAG/fine-tuning data pipelines, governance/lineage
  • Observability: Cloud Watch, Azure Monitor, App Insights, Grafana, Arize, Datadog
  • Languages: Python (primary), Type Script
  • Leadership: Scaling senior teams hands-on, executive communication, owning budgets/roadmaps
Education & Experience
  • Bachelor's or Master's in CS, Engineering, or IT
  • 10+ years in platform/cloud/SRE engineering
  • 5+ years hands-on AWS and Azure with production depth in Bedrock, Azure OpenAI/Foundry, and Databricks
  • 3+ years in technical leadership or people management
  • Financial services or…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary