Software Engineer,ML System Scheduling Technology - Machine learning Seattle Regular Job Seattle area,Washington USA,IT/Tech

The Machine Learning (ML) System sub-team combines system engineering and the art of machine learning to develop and maintain massively distributed ML training and Inference system/services around the world, providing high-performance, highly reliable, scalable systems for LLM/AIGC/AGI. In our team, you'll have the opportunity to build the large-scale heterogeneous system integrating with GPU/NPU/RDMA/Storage and keep it running stable and reliable, enrich your expertise in coding, performance analysis and distributed system, and be involved in the decision-making process.

You'll also be part of a global team with members from the United States, China and Singapore working collaboratively towards unified project direction.

Responsibilities

Responsible for the design and development of resource scheduling, including model training, model evaluation and model inference in various scenarios (LLM/AIGC/NLP/CV/Speech, etc.)

Responsible for the optimal orchestration of various computing resources (GPU, CPU, other heterogeneous hardware), realizing the rational use of stable resources, tidal resources, mixed resources, and multi-cloud resources

Responsible for the optimal combination of computing resources, RDMA high-speed network resources, and storage resources, and giving full play to the power of large-scale distributed clusters

Responsible for offline and online workload scheduling in global data centers integrating multi-cloud scenarios to achieve rational distributions

Minimum Qualifications

Be proficient in 1 to 2 programming languages such as Go/Python/Shell in Linux environment

Be familiar with Kubernetes architecture and container technology such as Docker/Containerd/Kata/Podman, and have rich experience in Machine Learning system practice and development

Understand the principles of distributed systems and have experience in the design, development and maintenance of large-scale distributed systems

Have an excellent logical analysis ability, able to reasonably abstract and split business logic

Have a strong sense of responsibility, good learning ability, communication skills and self-drive, able to respond and act quickly

Preferred Qualifications

Familiar with at least one major Machine Learning framework (Tensor Flow/PyTorch)

Experience in one of the following fields: AI Infrastructure, HW/SW Co-Design, High Performance Computing, ML Hardware Architecture (GPU, Accelerators, Networking)

For Los Angeles County (unincorporated) Candidates

Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;

Exercising sound judgment.

Job Information

The base salary range for this position in the selected city is $177688 - $341734 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

About Doubao (Seed)

Founded in 2023, the Byte Dance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements.

With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision, Audio, AI Infra and AI Safety. Our team has labs and research positions across China, Singapore, and the US.

Why Join Byte Dance

Inspiring creativity is at the core of Byte Dance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As Byte Dancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the…


Increase/decrease your Search Radius (miles)



Job Posting Language

Software Engineer, ML System Scheduling Technology - Machine learning Seattle Regular