Senior C++ ML Inference Engineer Scale, Low Latency

SpaceXSI is building a high-performance inference platform to serve Grok to millions of users. The Software Engineer, Training/Inference (C++) will own distributed infrastructure, including global KV cache, batching, and auto-scaling, and will optimize GPU kernels and low-level components.

The role emphasizes end-to-end design, benchmarking, CI/CD tooling, and research on scaling compute for next-generation systems, with impact on throughput, latency, and reliability.

Are you ready to take on the Senior C++ ML Inference Engineer — High-Scale, Low Latency role at X AI?

Our organisation is growing, and we are hiring a Senior C++ ML Inference Engineer — High-Scale, Low Latency in Palo Alto, CA, United States.

This role is for the Senior C++ ML Inference Engineer — High-Scale, Low Latency role at X AI.

We are seeking a motivated Senior C++ ML Inference Engineer — High-Scale, Low Latency to join X AI in Palo Alto, CA, United States.