Senior ML Engineer — Inference & Optimization; Remote

Cast AI is hiring for a remote-first role focused on optimizing inference stacks for large models. You will drive throughput, reduce latency, and tackle cold starts across multi-GPU, multi-node deployments using vLLM, SGLang, and TensorRT-LLM, with deep attention to quantization and system-level bottlenecks.

You will own the technical direction, benchmark-driven decisions, and scalable architecture, collaborating with a global team to push Cast AI's GPU-based inference platform forward.

As a Senior ML Engineer — Inference & Optimization (Remote), you will play an important part at Cast AI in Miami, FL, United States.

Step into the Senior ML Engineer — Inference & Optimization (Remote) role at Cast AI in Miami, FL, United States and grow with us.

Please review the full job details above before applying.

If your experience matches this role, we encourage you to apply.