×
Register Here to Apply for Jobs or Post Jobs. X

Vice President - AI Infrastructure Support Engineer

Job in New York, New York County, New York, 10261, USA
Listing for: TalentAlly
Per diem position
Listed on 2026-10-19
Job specializations:
  • IT/Tech
    SRE/Site Reliability, IT Infrastructure, Systems Administrator, Cloud Computing: Infrastructure & Operations
Salary/Wage Range or Industry Benchmark: 180000 - 260000 USD Yearly USD 180000.00 260000.00 YEAR
Job Description & How to Apply Below

Job#: 3056186

Job Description:

We’re seeking a future team member for the role of Vice President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team. This is a hand on role for any professional looking to take ownership and lead. In this role, you’ll make an impact in the following ways:

  • Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
  • Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
  • Apply hands‑on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
  • Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
  • Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and Service Now.
  • Partner with cross‑functional teams across engineering, platform, and operations to implement Dev Ops best practices, including CI/CD using Git Lab, containerized deployment models, and secure access management through Azure AD.
  • Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
  • Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high‑performance compute workloads.
  • Participate in a rotating on‑call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

To be successful in this role, we’re seeking the following:

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
  • Strong experience supporting AI infrastructure, GPU platforms, or high‑performance compute environments in enterprise or production settings.
  • Hands‑on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
  • Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
  • Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
  • Experience with Dev Ops practices and tools, including Git Lab CI/CD, infrastructure automation, and container‑based delivery models.
  • Familiarity with enterprise ticketing and service management platforms such as JIRA and Service Now.
  • Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
  • Understanding of identity and access management, including secure access controls such as Azure AD.
  • Strong problem‑solving skills, attention to detail, and the ability to manage multiple priorities in a fast‑paced environment.
  • Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non‑technical teams.
  • Willingness to participate in on‑call rotations and provide occasional weekend support as needed.
Required Technical Environment
  • Category Technologies
    • AI Infrastructure
    • AI/ML Platforms, High‑Performance Computing (HPC)
    • GPU Technologies – NVIDIA A100, H100, B200
    • Containers & Orchestration – Kubernetes, Docker
    • Automation & Scripting – Ansible, Python, Shell Scripting
    • Dev Ops – Git Lab CI/CD, Infrastructure Automation
    • Service Management – JIRA, Service Now
    • Operating Systems – Linux
    • Networking & Storage
    • Infrastructure Troubleshooting, Performance Optimization
    • Identity & Access Management – Azure AD
    • Infrastructure Operations, Monitoring, Incident Management,…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary