Senior Software Engineer - Compute Infrastructure; Cloud Native

Location: Seattle

Team: Technology

Employment Type: Regular

The Compute Infrastructure - Orchestration & Scheduling team uses Kubernetes and Serverless technologies to build a large, reliable, and efficient compute infrastructure that powers hundreds of large‑scale clusters globally, with millions of online containers and offline jobs daily, including AI and LLM workloads. The team builds cutting‑edge, industry‑leading infrastructure that empowers AI innovation, ensuring high performance, scalability, and reliability to support the most demanding AI/LLM workloads.

It is also dedicated to open‑sourcing key infrastructure technologies, such as kubewharf, Serverless initiatives like Ray on K8s, and the LLM inference control plan project AiBrix. At Byte Dance, we expand and innovate, powering global platforms like Tik Tok and various AI/ML & LLM initiatives, and we face the challenge of enhancing resource cost efficiency on a massive scale within our rapidly growing compute infrastructure.

• Design and evolve the architecture of large‑scale Kubernetes‑based infrastructure platforms to ensure performance, scalability, and resilience for diverse workloads, including microservices, big data, and AI/LLM applications.
• Improve K8s system performance across the control and data planes, including optimizing pod lifecycle, resource orchestration, and system‑level throughput under high load.
• Build robust observability and performance analysis frameworks, define K8s system‑level SLOs, and lead data‑driven tuning and optimization initiatives in production.
• Develop intelligent, unified resource management and scheduling systems (at node & cluster‑level) to support a wide range of compute resources in large‑scale, cloud‑native environments.
• Drive the standardization and optimization of container runtime environments to enhance workload isolation, reliability, and resource efficiency across heterogeneous compute environments.

• B.S./M.S. degree in Computer Science, Computer Engineering or a related area with 3+ years of relevant industry experience;
  Ph.D. degree and strong publication records may be an exception.
• Solid understanding of at least one of the following fields:
  Unix/Linux environments, distributed and parallel systems, high‑performance networking systems, developing large‑scale software systems.
• Familiarity with container and orchestration technologies such as Docker and Kubernetes.
• Proficiency in at least one major programming language such as Python, Go, C++, Rust, and Java.

• Knowledge of big data or machine learning workflows in a Kubernetes environment.
• Experience in developing or contributing to cloud‑native open‑source projects.
• Hands‑on project experience with containerized applications through internships, coursework, or personal projects.
• Familiarity with observability tools and frameworks like Prometheus, Grafana, or distributed tracing systems.

The base salary range for this position in the selected city is $202,160 - $368,220 annually.

Employees have day‑one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short‑term and long‑term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

Byte Dance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at