LLM Inference Engineer — Scalable Serving & Optimization
Job in
Palo Alto, Santa Clara County, California, 94306, USA
Listed on 2026-07-15
Listing for:
Hippocratic-Ai
Full Time
position Listed on 2026-07-15
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Job Description & How to Apply Below
Hippocratic AI in Palo Alto is seeking an experienced LLM Inference Engineer to optimize large language model serving infrastructure. You will design multi-node architectures, implement quantization, and push latency reductions in production environments.
The role requires hands-on experience with inference optimization, distributed serving for LLMs, Python/C++, and CUDA. You will work with a team delivering scalable AI healthcare solutions and contribute to open‑source projects when possible.
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×