More jobs:
AI Engineer/Senior Platform Support Assistant Vice President
Job in
Boston, Suffolk County, Massachusetts, 02298, USA
Listed on 2026-06-13
Listing for:
State Street
Full Time
position Listed on 2026-06-13
Job specializations:
-
IT/Tech
Azure, AI Engineer (Applied/Software), Cloud Computing
Job Description & How to Apply Below
Who We Are Looking For
We are seeking an L3 Support Engineer / Senior Platform Support Specialist to join the Generative AI Team. The role focuses on ensuring the reliability, performance, and operational excellence of enterprise‑grade Generative AI platforms across Azure and AWS ecosystems, including Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock.
What You Will Be Responsible For- Serve as the final escalation tier (L3) for complex production incidents related to Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock, driving resolution with urgency and precision.
- Perform advanced root cause analysis (RCA) on platform outages, performance degradation, model inference failures, token/rate‑limiting issues, API errors, and integration breakdowns across multi‑cloud Gen AI environments.
- Monitor, maintain, and optimize the health, performance, and cost‑efficiency of Gen AI workloads across Azure and AWS, including model deployments, endpoints, fine‑tuning pipelines, and orchestration workflows.
- Troubleshoot end‑to‑end architecture spanning API gateways, networking (VNets, VPCs, Private Endpoints, Private Link), IAM/RBAC policies, model serving infrastructure, vector databases, and data pipelines integrated with Gen AI services.
- Collaborate closely with L1/L2 support teams to develop runbooks, knowledge base articles, escalation procedures, and standard operating procedures (SOPs) to reduce mean time to resolution (MTTR) and enable shift‑left support.
- Partner with Development, MLOps, and Infrastructure teams to identify recurring issues, recommend platform improvements, and contribute to the reliability and resilience of Gen AI solutions through proactive measures.
- Support deployment and release activities for Gen AI models and applications, including validation of model endpoints, API versioning, configuration changes, and rollback procedures in production environments.
- Manage and respond to incidents following ITIL‑aligned incident and problem management processes, including SLA adherence, stakeholder communication, and post‑incident reviews.
- Drive automation of support workflows by developing scripts, monitoring dashboards, alerting mechanisms, and self‑healing capabilities to improve operational efficiency.
- Stay current with platform updates, deprecations, and new feature releases from Azure OpenAI, Azure AI Foundry, Databricks, and AWS Bedrock, assessing impact on existing deployments and advising teams accordingly.
- Work with Enterprise Architecture and Security teams to ensure Gen AI platform configurations conform to organizational standards, compliance requirements, and data governance policies.
- Provide technical guidance and mentorship to L1/L2 support engineers, fostering skill development and knowledge transfer across the support organization.
- Participate in on‑call rotations and provide after‑hours support for critical production issues as required.
- Deep hands‑on expertise with Azure AI services, including Azure OpenAI Service (GPT model deployments, fine‑tuning, content filtering, quota management), Azure AI Foundry (prompt flow, model catalog, evaluation tools), and Azure Cognitive Services.
- Deep hands‑on expertise with AWS AI/ML services, including AWS Bedrock (foundation model access, custom model import, agents, knowledge bases, guardrails), and associated AWS services (Lambda, S3, IAM, Cloud Watch, Sage Maker).
- Strong working knowledge of Databricks, including Unity Catalog, MLflow, model serving endpoints, Delta Lake, Spark clusters, workflows/jobs, and integration with Gen AI pipelines.
- Proficiency in Python and scripting (Bash/Power Shell) for troubleshooting, log analysis, API testing, and automation of support tasks.
- Strong understanding of cloud networking, security, and identity management — VNets/VPCs, NSGs/Security Groups, Private Endpoints/Private Link, Azure AD/Entra , AWS IAM, RBAC, managed identities, and service principals.
- Experience with API troubleshooting — REST APIs, authentication/authorization flows (OAuth 2.0, API keys, SAS tokens), rate limiting, retry logic, and HTTP status code analysis.
- Familiarity with…
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×