Senior ML Engineer — Inference & Optimization; Remote

Cast AI is hiring for a remote-first role focused on optimizing inference stacks for large models. You will drive throughput, reduce latency, and tackle cold starts across multi-GPU, multi-node deployments using vLLM, SGLang, and TensorRT-LLM, with deep attention to quantization and system-level bottlenecks.

You will own the technical direction, benchmark-driven decisions, and scalable architecture, collaborating with a global team to push Cast AI's GPU-based inference platform forward.

We are looking to fill the Senior ML Engineer — Inference & Optimization (Remote) position at Cast AI in Miami, FL, United States.

Learn more about the Senior ML Engineer — Inference & Optimization (Remote) role in the description above.

We appreciate your interest in this position.

Join Cast AI and contribute to our ongoing work.

Take a moment to read everything above and see whether this role is right for you.