Software Engineer, Inference Runtime
Job in
California, Moniteau County, Missouri, 65018, USA
Listed on 2026-07-20
Listing for:
Jobtailor
Full Time
position Listed on 2026-07-20
Job specializations:
-
Software Development
Software Architect, Software Engineer, AI Engineer (Applied/Software)
Job Description & How to Apply Below
Location: California
Responsibilities
- Set technical direction for the team, owning the architecture and roadmap for the shared runtime of the inference serving stack
- Own and evolve the accelerator-agnostic runtime
- Drive efficient accelerator usage across GPU, TPU, and Trainium
- Build the runtime's validation surface around partitioned builds
- Act as a technical counterpart to Anthropic's central Infrastructure org
- Mentor engineers on the team through design review and collaboration
- Deep background in systems engineering or ML infrastructure
- Real depth in at least one accelerator ecosystem (CUDA/GPU, TPU, or Trainium/AWS Neuron)
- Significant software engineering experience in high-performance, large-scale distributed systems
- A track record of defining and using engineering metrics
- Experience driving technical alignment across organizational boundaries
- Strong written and verbal communication skills
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×