AI Infrastructure Engineer

Akkodis is seeking a AI Infrastructure Engineer for a Direct Hire position with a client located in Lake Mary FL or Pittsburgh PA
. Ideally looking for applicants with a solid background in the financial services industry.

Pay Range: $125,000 to $130,000

AI Infrastructure Engineer job responsibilities include:

• Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
• Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:
  
  AI and NVIDIA BCM.
• Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
• Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
• Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To fulfill this role the AI Infrastructure Engineer will be required to:

• Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
• Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
• Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
• Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
• Experience with CI/CD workflows and infrastructure automation tools such as Git Lab CI, Jenkins, Terraform, Helm, or Ansible.
• Knowledge of networking fundamentals and persistent storage systems.
• Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
• Ability to read and support Python code focused on ML/AI pipeline integration.
• Strong analytical and troubleshooting skills with a collaborative mindset.
• Effective communication skills and proactive ownership of platform reliability and performance.

If you are interested in this AI Infrastructure Engineer job in New York, NY
, then please click APPLY NOW. For other opportunities available at Akkodis go to  If you have questions about the position, please contact Varun Mahajan at or v

Equal Opportunity Employer/Veterans/Disabled

(INCLUDE YOUR CLIENT’S BENEFITS HERE
)

Benefits include but are not limited to:

• 401(k) with match
• Comprehensive medical insurance (PPO, HSA)
• Dental insurance (PPO)
• Vision assistance
• Three weeks of Paid Time Off to Start;
  Accumulating Structure Afterwards
• Paid Holidays Off

Available paid leave may include Paid Sick Leave, where required by law; any other paid leave required by Federal, State, or local law; and Holiday pays upon meeting eligibility criteria.

To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit

The Company will consider qualified applicants with arrest and conviction records.