Senior ML Systems Engineer Inference Optimization; Remote

CAST AI, a Miami-headquartered AI platform, seeks an experienced ML systems engineer to optimize the inference stack across multi-GPU clusters. You’ll tune loaders, schedulers, and KV caches to improve throughput, latency, and cost per token.

You’ll work with SGLang, vLLM, TensorRT-LLM, PyTorch, and CUDA tooling, handling large checkpoints and distributed setups. The role offers a remote-first global environment and equity options.

We are seeking a motivated Senior ML Systems Engineer Inference Optimization (Remote) to join CAST AI Group in Miami, FL, United States.

For the Senior ML Systems Engineer Inference Optimization (Remote) position at CAST AI Group, we are reviewing applications now.

Step into the Senior ML Systems Engineer Inference Optimization (Remote) role at CAST AI Group in Miami, FL, United States and grow with us.

Please review the full job details above before applying.