AI Model Serving Specialist

Employer Industry

Multicloud Solutions Provider

• Salary up to $140,580
• Opportunity for career advancement and growth within the organization
• Flexible work schedule, with the possibility of remote work
• Comprehensive benefits package including annual bonuses, equity awards, and an Employee Stock Purchase Plan (ESPP)
• Work with cutting‑edge AI technologies and model‑serving platforms
• Collaborative and inclusive work environment that values diverse perspectives

• Package and deploy ML/LLM models on Triton, vLLM, or KServe within Kubernetes clusters
• Tune performance for latency and throughput SLAs, including batching and Tensor
  
  RT optimizations
• Integrate models with the employer's Unified Inference API for multi‑tenant routing
• Assist solution architects in onboarding customers and creating reference patterns for various verticals
• Configure telemetry for GPU utilization and collaborate with Fin Ops for chargeback reporting

• Hands‑on experience with NVIDIA Triton, vLLM, or similar serving stacks
• Strong knowledge of Kubernetes, GPU scheduling, and CUDA/MIG
• Familiarity with VMware VCF9, NSX‑T networking, and vSAN storage classes
• Proficiency in Python and containerization (Docker)
• Excellent problem‑solving and customer‑facing communication skills

• NVIDIA Certified Professional (AI/ML)
• Kubernetes Administrator (CKA)
• VMware VCF Specialist
• Exposure to RAG architectures and secure multi‑tenant environments

We prioritize candidate privacy and champion equal‑opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately. We are not the EOR (Employer of Record) for this position.

Our role in this specific opportunity is to connect outstanding candidates with a top‑tier employer.