Senior Software Engineer – Inference Platform Infrastructure

Employer Industry: Technology - AI and GPU Infrastructure

• Salary range up to $287,500 for Level 4 positions
• Eligible for equity and comprehensive benefits
• Opportunity to work with cutting‑edge technology in AI and distributed systems
• Chance to make significant contributions to platform reliability and performance
• Collaborative environment with forward‑thinking professionals

• Build automation for provisioning, configuration, upgrades, and routine maintenance of inference services
• Create and evolve deployment patterns for inference workloads on Kubernetes
• Own platform reliability outcomes, including defining and improving SLIs/SLOs and automated remediation
• Manage a large fleet of NVIDIA GPU and datacenter hardware from pre‑release to production
• Collaborate with cross‑functional teams to drive improvements and ensure operational excellence

• Strong software engineering skills with a focus on building reliable platforms and systems
• Minimum of 5 years of experience in building and operating production distributed systems
• Proven expertise in cloud‑native platforms, including Kubernetes and CI/CD
• Deep experience with infrastructure‑as‑code and automation‑first operations
• BS/MS in Computer Science, Computer Engineering, or related field, or equivalent experience

• Direct experience in operating inference serving at scale (e.g., Triton, Tensor
  
  RT‑LLM)
• Experience building scheduling or quota systems for Kubernetes
• Familiarity with fleet health systems and automation for failure triage

We prioritize candidate privacy and champion equal‑opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately.