Senior LLM Inference Architect; On-Site Menlo Park

Hippocratic AI Inc. is seeking an experienced LLM Inference Engineer to own and optimize its inference serving stack. You will drive sub-100ms responses, cost efficiency, and reliable availability for millions of patient conversations across healthcare systems.

You will design multi-node serving architectures and advance techniques like disaggregated serving and speculative decoding. You will collaborate with systems engineers, ML researchers, and infrastructure experts to push the boundaries of

We are currently recruiting a Senior LLM Inference Architect (On-Site Menlo Park) for our team in Menlo Park, CA, United States.

Consider building your career as a Senior LLM Inference Architect (On-Site Menlo Park) at Hippocratic AI Inc.

The Senior LLM Inference Architect (On-Site Menlo Park) position in the IT & Technology field is open for applications.

We have an opening for a Senior LLM Inference Architect (On-Site Menlo Park) in Menlo Park, CA, United States within IT & Technology.