Senior ML Inference Systems Engineer; Remote-First

Runpod is hiring a seasoned systems engineer to optimize LLM inference performance in a remote-first environment. You will define measurement pipelines for throughput, latency, and cost per token, and build repeatable tooling for rigorous benchmarking.

You will profile the serving stack from scheduler and memory to GPU kernels, diagnose bottlenecks, and implement optimizations for large models on single and multi-node GPU deployments. Join a fast-moving AI infrastructure team.

Step into the Senior ML Inference Systems Engineer (Remote-First) role at Runpod in United States and grow with us.

We are currently recruiting a Senior ML Inference Systems Engineer (Remote-First) for our team in United States.

This is a genuine position to take on the Senior ML Inference Systems Engineer (Remote-First) role at Runpod.

As a Senior ML Inference Systems Engineer (Remote-First), you will play an important part at Runpod in United States.