Skip to content
×

Senior Engineer · SmartRouter & Inference Cost

Remote / Online - Candidates ideally in
Charlotte, Mecklenburg County, North Carolina, 28201, USA
Listing for: Deliverance AI
Full Time, Remote/Work from Home position Listed on 2026-11-15
Job specializations:
Salary/Wage Range or Industry Benchmark: 119000 - 172000 USD Yearly USD 119000.00 172000.00 YEAR

Job Description & How to Apply Below

Role overview

Build the routing and cost-management systems that decide which model should handle each request. The role sits at the intersection of backend engineering, machine-learning systems, inference economics, and evaluation: the goal is to meet quality and safety requirements while selecting the most efficient model and making the resulting trade-offs visible. The position is based in London or available remotely.

Responsibilities
  • Implement request classification and routing across smaller, mid-tier, and frontier model options.
  • Integrate multiple model providers and account for differences in capabilities, latency, pricing, and operational behavior.
  • Measure inference cost end to end and expose current usage and savings through real-time Fin Ops dashboards.
  • Optimise the cost-versus-quality frontier using evaluation datasets, guardrails, and production performance data.
  • Design routing decisions and supporting telemetry so outcomes can be explained, reviewed, and audited.
  • Own improvements against customer-facing efficiency measures, including demonstrable reductions in model spend where quality remains acceptable.
Requirements
  • Experience in backend engineering, ML systems, or platform engineering with a strong focus on cost and performance.
  • Practical knowledge of model serving, inference workflows, evaluation, and multi-provider integrations.
  • Demonstrated ability to use data to optimise complex systems and make measurable trade-offs.
  • Familiarity with telemetry, cost attribution, dashboards, or Fin Ops practices for compute-intensive services.
  • Comfort owning a system whose success is assessed directly through reliability, quality, and customer savings.
  • Clear thinking about explainability, controls, and auditability in automated routing decisions.
Benefits and work setup
  • Senior full-time role with London or remote working options.
  • Remote-friendly arrangements across the UK, EU, and selected global time zones.
  • Equity participation and cash compensation benchmarked to leading London and remote markets.

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary