Inference Systems Engineer Scalable GPU ML; Remote
Phoenix, Maricopa County, Arizona, 85001, USA
Listed on 2026-10-27
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Prime Intellect in San Francisco is seeking a developer to build and optimize GPU inference systems powering RL research, scaling toward 1–3T parameter models on NVL
72 clusters. The role aims to improve rollout throughput and enable frequent model updates.
You will extend vLLM integration for new model architectures, optimize multi-node MoE inference and transfer, and reduce trainer-to-inference weight update overhead.
We would love to welcome a new Inference Systems Engineer for Scalable GPU ML (Remote) to our team in United States.
Learn more about the Inference Systems Engineer for Scalable GPU ML (Remote) role in the description above.
We appreciate your interest in this position.
Join Prime Intellect, Inc. and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).