Software Engineer in ML Systems Graduate; AML - Machine Learning Systems BS​/MS

Software Engineer in ML Systems Graduate (AML - Machine Learning Systems) - 2026 Start (BS/MS)

Location:

San Jose

Team:
Technology

Employment Type:

Regular

• Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems.
• Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability.
• Participating in the design and implementation of end-to‑end online pipeline systems with multiple models, plugins, and storage‑computation components, enabling agile, flexible, and observable continuous delivery.
• Collaborating closely with the MLE for optimization of algorithms and systems.
• Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills.

Candidates who pass resume screening will be invited to participate in Byte Dance's technical online assessment.

• Minimum Qualifications:
  • Bachelor's degree or above, major in computer/electronics/automation/software, etc.
  • Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc.
  • Rich experience in online architecture, with the ability to troubleshoot independently.
  • Strong sense of responsibility, good learning ability, communication skills, and self‑motivation.
• Preferred Qualifications:
  • Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis.
  • Knowledge of LLM models, experience in accelerating LLM model optimization is preferred.

By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

• Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
• Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;
• Exercising sound judgment.

The base salary range for this position in the selected city is $118,657 - $187,200 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

Founded in 2012, Byte Dance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including Tik Tok, Lemon8, Cap Cut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, Byte Dance has made it easier and more fun for people to connect with, consume, and create content.

Inspiring creativity is at the core of Byte Dance's mission.…