GPU​/AI Application System Software Engineer Intern (System Technologies and Engineering) - 2027

Responsibilities

About the Team:

The GPU/AI System Technology and Engineering Team is committed to developing highly optimized OS and system software to support deep learning and high-performance computing (HPC) workloads in large-scale data centers.

We focus on delivering core software components for the next generation of AI and HPC platforms, benchmarks, and fine-tuning performance. Our work spans the entire hardware/software stack, from GPU drivers to deep learning frameworks, to ensure peak performance across all layers.

By joining this team, you will work with the best engineers and talents in this industry and have a broad opportunity to get in touch with the latest AI application systems and newly emerged technology in computing, networking and storage. You will gain remarkable GPU architecture, system software development and GPU validation experience in the most advanced hardware infrastructure on a massive scale.

• Design and implement performance benchmarks and testing methodologies to evaluate system performance （especially for those factors impacted most closely to OS, OS kernel, Hardware System）
• Develop benchmark tools and performance optimization of AI workloads specifically tailored for large-scale LLM training and inference, as well as High-Performance Computing (HPC).
• Develop Python scripts to automate the testing of various benchmark tools.
• Collaborate with internal teams to identify system bottleneck, debug and improve performance issues.

Minimum Qualifications:

• Currently pursuing a Bachelor's or Master's degree within Computer Engineering in Electrical Engineering, Computer Engineering, Computer Science or related majors.
• Deep understanding of Operating System, Linux Kernel, Computer Architecture
• Background with GPU/CPU benchmarking
• Familiar with ML/DL techniques, algorithms and frameworks like Tensor Flow or PyTorch.
• Exposure to testing automation for various applications.
• Hands-on experience with Linux based systems

• Strong background in one of the following fields:
  High Performance Computing, ML Hardware Acceleration (e.g., GPU/TPU/RDMA) or ML for Systems, and Distributed Storage.
• Experience in AI model development, training, evaluation and deployment on Cloud, Cluster or on-premises.
• Experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)
• Linux kernel development experience, such as networking and device drivers etc.
• Exposure to testing automation for various applications.
• Experience with complex system-level debugging is invaluable.

【For Pay Transparency】Compensation Description (Hourly) - Campus Intern

The hourly rate range for this position in the selected city is $45- $45.

Benefits may vary depending on the nature of employment and the country work location. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

• Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
• Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
• Exercising sound judgment.

Founded in 2012, Byte Dance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including Tik Tok, Lemon8, Cap Cut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, Byte Dance has made it easier and more fun for people to connect with, consume, and create content.

Inspiring creativity is at the core of Byte Dance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams…