GenAI Inference Engineer: Optimize LLM Serving Latency
Job in
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-10-11
Listing for:
Neon
Full Time
position Listed on 2026-10-11
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Job Description & How to Apply Below
A leading data and AI company is seeking a Staff Software Engineer for GenAI inference to lead the architecture and optimization of the inference engine. The role requires expertise in CUDA, GPU programming, and distributed systems design. Ideal candidates will have a strong software engineering background and a proven ability to collaborate with researchers and drive architectural decisions. Competitive compensation is offered, with a salary range of $190,900 to $232,800 USD.
Our organisation is growing, and we are hiring a Staff GenAI Inference Engineer:
Optimize LLM Serving Latency in San Francisco, CA, United States. We aim to respond to suitable candidates as soon as possible. Full responsibilities and requirements are described in the listing above. Learn more about the Staff GenAI Inference Engineer:
Optimize LLM Serving Latency role in the description above.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×