Software Engineer- Foundation Model Inference
Job in
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-09-09
Listing for:
DevHub
Full Time
position Listed on 2026-09-09
Job specializations:
-
Software Development
Backend Developer, Cloud Engineer - Software, AI Engineer (Applied/Software), DevOps
Job Description & How to Apply Below
Build and optimize LLM infrastructure to power large-scale inference workloads for both partner and self-hosted models. Collaborate with cross-functional teams to improve the reliability, latency, and efficiency of distributed AI workloads.
Requirements:- Requires over 8 years of experience in backend or infrastructure engineering with expertise in distributed systems and scalable APIs.
- Experience with ML infrastructure, GPU orchestration, and service-oriented architecture is essential.
Skills:
- Backend Engineering
- Infrastructure Engineering
- Distributed Systems
- Scalable APIs
- Cloud-native Infrastructure
- Real-time Serving
- ML Infrastructure
- GPU Orchestration
- Service-oriented Architecture
- Deployment Pipelines
- System Observability
- LLM Infrastructure
- Model Inference
- Py Torch
- vLLM
- Annual performance bonus
- Equity
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×