AI Operations Platform Consultant Sr

Position: AI Operations Platform Consultant Sr.
*
* Location:

Charlotte, NC or Jersey City, NJ - Hybrid; 3 days a week onsite. Resource will choose which site hybrid schedule*
* Job Description:

Must have skills: LLM and Kubernetes

Project Tasks:

AI Operations Platform Consultant

+  Experience deploying, managing, operating, and troubleshooting containerized services at scale on Kubernetes for mission-critical applications (Open Shift).

+  

Experience with deploying, configuring, and tuning LLMs using Tensor

RT-LLM and Triton Inference server.

+  Managing MLOps/LLMOps pipelines, using Tensor

RT-LLM and Triton Inference server to deploy inference services in production.

+  Setup and operation of AI inference service monitoring for performance and availability.

+  Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.

+  Operation and support of MLOps/LLMOps pipelines, using Tensor

RT-LLM and Triton Inference server to deploy inference services in production.

+  Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.

+  

Experience with standard processes for operation of a mission critical system - incident management, change management, event management, etc.

+  Managing scalable infrastructure for deploying and managing LLMs.

+  Deploying models in production environments, including containerization, microservices, and API design.

+  Triton Inference Server, including its architecture, configuration, and deployment.

+  Model Optimization techniques using Triton with TRTLLM.

+  Model optimization techniques, including pruning, quantization, and knowledge distillation.

** Position Details:*
* + Pay Rate / Range:____ $74.91-$84.91_____

_The above salary range represents the range expected for the position; however, final salary offers are based on a number of factors such as the position's responsibilities; the candidate's experience, education, and skills; location; travel required; and current market conditions._

+ Benefits (Regular, Full Time Employees):

1. Medical, Dental, and Vision offerings

2. Weekly Direct Deposit

3. Paid Holidays and Personal Time Off

4. 401(k) with match

5. Voluntary Life and AD&D, Short / Long Term Disability, plus other voluntary coverages

6. Pre-Paid Legal and Employee Assistance Programs

7. Northwest Federal Credit Union Membership

8. BB&T @ Work Program

This program requires US Citizenship or Green Card (Lawful Permanent Residents)

** _ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans_*
* tag#IND1