Senior ML Systems Engineer Inference Optimization; Remote
Jacksonville, Duval County, Florida, 32099, USA
Listed on 2026-10-26
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
CAST AI, a Miami-headquartered AI platform, seeks an experienced ML systems engineer to optimize the inference stack across multi-GPU clusters. You’ll tune loaders, schedulers, and KV caches to improve throughput, latency, and cost per token.
You’ll work with SGLang, vLLM, TensorRT-LLM, PyTorch, and CUDA tooling, handling large checkpoints and distributed setups. The role offers a remote-first global environment and equity options.
We invite applications for the Senior ML Systems Engineer Inference Optimization (Remote) position located in Miami, FL, United States.
The Senior ML Systems Engineer Inference Optimization (Remote) role at CAST AI Group is now open for applications in Miami, FL, United States.
Join us at CAST AI Group as our next Senior ML Systems Engineer Inference Optimization (Remote) in Miami, FL, United States.
We are currently recruiting a Senior ML Systems Engineer Inference Optimization (Remote) for our team in Miami, FL, United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).