More jobs:
L Rust Engineer LiteLLM posted ago
Job in
San Francisco, San Francisco County, California, 94199, USA
Listed on 2026-10-16
Listing for:
Rustify
Contract
position Listed on 2026-10-16
Job specializations:
-
Software Development
Python
Job Description & How to Apply Below
# Rust EngineerLiteLLM
· San Francisco, CA
· Senior
· Hybrid View & Apply## About the Role You’ll own LiteLLM’s migration from Python to Rust, end to end.
This is a high-stakes, high-visibility role where you will:
* Plan the migration directly with the CTO
* Restructure the existing codebase so it is ready for an incremental move to Rust
* Lead a gradual, stability-first rollout
* Drive LiteLLM toward becoming the lowest-latency, highest-throughput AI gateway in the category
* Ensure performance improvements never compromise the reliability our enterprise customers depend onThis is a single-owner mandate. You will be the person responsible for leading the entire Python-to-Rust migration.## Responsibilities
* Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through production rollout
* Plan the migration alongside the CTO and sequence the work to minimize risk to live, high-volume traffic
* Design and execute a gradual rollout with stability as the top constraint
* Restructure the existing codebase to enable a clean, incremental migration
* Drive improvements across latency, throughput, and resource efficiency at more than 1 billion requests per month
* Collaborate across teams to align the migration with backend priorities across performance, reliability, and security
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×