GPU Infrastructure Support Engineer

Job Title:

AI Infrastructure Support Engineer

Location:

New York, NY Type - Hybrid4 days Onsite Terms;
Full Time Salary- $140000/yr - $170000/yr

Our client provides a range of financial products and services in the United States and internationally. It operates through Securities Services, Market and Wealth Services, Investment and Wealth Management, and Other segments. The Securities Services segment offers custody, trust and depositary, accounting, exchange-traded funds, middle-office solutions, transfer agency, services for private equity and real estate funds, foreign exchange, securities lending, liquidity/lending services, and data analytics.

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
• Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
• Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and Service Now.
• Partner with cross-functional teams across engineering, platform, and operations to implement Dev Ops best practices, including CI/CD using Git Lab, containerized deployment models, and secure access management through Azure AD.
• Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
• Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
• Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
• Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
• Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
• Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
• Experience with Dev Ops practices and tools, including Git Lab CI/CD, infrastructure automation, and container-based delivery models.
• Familiarity with enterprise ticketing and service management platforms such as JIRA and Service Now.
• Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
• Understanding of identity and access management, including secure access controls such as Azure AD.
• Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
• Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
• Willingness to participate in on-call rotations and provide occasional weekend support as needed.

Estimated Min Rate
: $140000.00

Estimated Max Rate
: $170000.00

We welcome you to be a part of the largest and legendary global staffing…