Skip to content
×

Head of Infrastructure; Remote

Remote / Online - Candidates ideally in
Los Angeles, Los Angeles County, California, 94199, USA
Listing for: General Compute
Remote/Work from Home position Listed on 2026-11-17
Job specializations:
  • Software Development
Salary/Wage Range or Industry Benchmark: 180000 - 250000 USD Yearly USD 180000.00 250000.00 YEAR

Job Description & How to Apply Below

Position: Head of Infrastructure (Remote)
Job description

Inference is fragmenting: purpose-built silicon from Samba Nova, Cerebras, Positron, d-Matrix, and others already beats GPUs on decode, and we product ionize that hardware — we buy the racks, find the data center space, and run it for our customers. Our customers are frontier labs, fast-growing AI application companies, and asset-light clouds. We closed a $15M seed round in May 2026, and have since closed a $400M debt facility — $100M funded upfront by Upper
90, with the balance available for drawdown — collateralized by our inference chips. You’ll own the infrastructure layer of our inference cloud end-to-end. Today that means the control plane, the gateway in front of our ASIC fleet, and the observability stack that tells us where every millisecond goes. Over the next 6-8 months, it will grow into a heterogeneous fleet:
At the moment, it’s built on configuration provided by our ASIC partner;
Own the gateway and load balancer that fronts the fleet. Run capacity planning against a real, distributed traffic mix across the open-weight models we serve. Own the operational side of the ASIC partnership. Most weird production issues route through their engineering team until we build that expertise in-house, and you’ll be our technical face in those conversations. Bring up the pre-fill side of our disaggregated architecture on a second hardware platform as it comes online.

  • 7+ years in infrastructure, SRE, or platform engineering, with at least some of it at a serious inference, ML, or HPC shop.
  • Track record of building observability practices that actually catch problems, not just generate dashboards.
  • Background with model-serving stacks (vLLM, TGI, TensorRT-LLM, SGLang). Network fabric experience at data-center scale (RoCE, Infini Band).
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary