Senior AI Infra Engineer – Self-Hosted Inference & Models

Position: Senior AI Infra Engineer – Self-Hosted Inference & Open Models
Location: New York

Tech fellow Limited is seeking a Senior AI Infrastructure Engineer to own the model layer, enabling open-weight training, self-hosted inference, evaluation and intelligent routing. You’ll join a focused AI team defining platform architecture, standards and long-term strategy in a greenfield environment.

You will build production gateways, distillation pipelines and robust inference environments, working with vLLM, TGI, Triton and Kubernetes to optimize performance, reliability and cost for

We are currently recruiting a Senior AI Infra Engineer – Self-Hosted Inference & Open Models for our team in New York, NY, United States.

This opening is for the Senior AI Infra Engineer – Self-Hosted Inference & Open Models role at Tech fellow Limited.

We are seeking a motivated Senior AI Infra Engineer – Self-Hosted Inference & Open Models to join Tech fellow Limited in New York, NY, United States.