VP - Platform Engineer
Listed on 2026-10-11
-
Software Development
Azure, AI Engineer (Applied/Software), Cloud Engineer - Software, DevOps
Responsibilities
- AI Platform & Developer Infrastructure Design, build, and operate the firm’s AI platform, enabling developers to build and deploy Python-based AI applications;
- Implement and manage Azure AI Foundry environments: model deployments, AI hubs, project work spaces, and access controls;
- Integrate and operationalize third-party AI APIs (Anthropic Claude API, Azure OpenAI) with secure access patterns, API gateway controls, rate limiting, and cost monitoring;
- Build internal developer tooling and SDK scaffolding to accelerate AI application development across the firm.
- Data Infrastructure & Pipelines Build and maintain data pipelines using Azure Data Factory and Azure Databricks to serve AI application data needs;
Implement vector search and document retrieval infrastructure (Azure AI Search) to support RAG-based applications;
Manage structured and unstructured data stores including Azure Data Lake, Azure SQL, and Cosmos DB. - Cloud Infrastructure & Dev Ops Provision and maintain secure, scalable infrastructure on Azure (primary) and AWS using Infrastructure-as-Code (Terraform or Bicep);
Build and maintain CI/CD pipelines for AI application deployment via Azure Dev Ops or Git Hub Actions;
Manage containerized workloads using Docker and Kubernetes (AKS) for AI application hosting and API services;
Drive Secure Dev Ops practices including secrets management, dependency scanning, and policy enforcement. - Security, Governance & Compliance Implement data access controls, encryption, and audit logging aligned with SEC and FINRA requirements;
Design MNPI data segregation controls and enforce AI governance guardrails including content filtering and usage logging for all AI API integrations;
Manage identity and access for AI platforms using Azure Entra , RBAC, and managed identities;
Collaborate with Compliance and Legal to ensure AI usage policies are enforced at the infrastructure level. - Collaboration & Documentation Produce architecture designs, runbooks, and technical documentation for all platform components;
Support application developers building AI-powered applications with platform guidance and troubleshooting;
Partner with solution architects, data engineers, and business stakeholders to translate requirements into infrastructure.
Our client seeks to hire individuals who are highly motivated, intelligent and have demonstrated excellence in prior endeavors. In addition, qualified candidates will possess the following:
Bachelor’s degree in computer science, Computer Engineering, or related field (Master’s degree is a plus); 8+ years in infrastructure engineering, cloud platform engineering, or data engineering;
Demonstrated experience building shared platforms or developer services in an enterprise environment;
Azure expertise:
Azure AI Foundry, Azure Data Factory, Azure Databricks, AKS, Azure API Management, Azure Key Vault, Azure Entra ;
Strong Python skills: backend services, REST APIs (FastAPI or Flask), and automation scripting;
Power Shell for infrastructure tasks;
Infrastructure-as-Code:
Terraform and/or Bicep; container orchestration with Docker and Kubernetes;
Experience integrating LLM APIs (Anthropic Claude, Azure OpenAI) in production including token cost management and observability; RAG pipeline experience: vector search (Azure AI Search or pgvector), document processing, and retrieval patterns;
Familiarity with LLM application frameworks such as Lang Chain or Semantic Kernel;
Cloud security fundamentals: RBAC, managed identities, private endpoints, Key Vault, and network segmentation;
Dev Sec Ops practices: secrets management, SAST tooling, and secure CI/CD pipeline design;
Familiarity with AWS (Bedrock, S3, IAM) and agentic application frameworks (Auto Gen, Lang Graph);
Experience with Microsoft Fabric, Databricks Unity Catalog, or Azure Synapse;
Azure certifications: AI-102, DP-203, or AZ-305;
Prior experience in investment banking or regulated financial services environments.
Expected annualized base salary of $175,000 to $215,000.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).