×
Register Here to Apply for Jobs or Post Jobs. X

Senior Research Scientist​/Engineer - AI Infrastructure

Job in San Jose, Santa Clara County, California, 95111, USA
Listing for: ByteDance
Full Time position
Listed on 2026-02-17
Job specializations:
  • IT/Tech
    AI Engineer, Machine Learning/ ML Engineer, Data Engineer, Systems Engineer
Job Description & How to Apply Below
We are seeking a highly skilled and motivated AI Infrastructure Engineer to join our dynamic team. In this role, you will be responsible for designing, building, deploying, and maintaining the robust and scalable infrastructure that powers our cutting-edge artificial intelligence (AI) and machine learning (ML) initiatives. You will work closely with our AI/ML researchers, data scientists, and software engineers to create an efficient, high-performance environment for training, inference, and data processing.

Your expertise will be critical in enabling the next generation of AI-driven products and services. Responsibilities The ideal candidate should be an expert in at least one of the following fields to define and design the next-gen AI

Infrastructure: Infrastructure Design & Architecture - Lead end-to-end design of scalable, reliable AI infrastructure (AI accelerators, compute clusters, storage, networking) for training and serving large ML workloads.

- Define and implement service-oriented, containerized architectures (Kubernetes, VM frameworks, unikernels) optimized for ML performance and security. Performance Optimization - Profile and optimize every layer of the ML stack-ML Compiler, GPU/TPU scheduling, NCCL/RDMA networking, data preprocessing, and training/inference frameworks.

- Develop low-overhead telemetry and benchmarking frameworks to identify and eliminate bottlenecks in distributed training and serving. Distributed Systems & Scalability - Build and operate large-scale deployment and orchestration systems that auto-scale across multiple data centers (on-premises and cloud).

- Champion fault-tolerance, high availability, and cost-efficiency through smart resource management and workload placement. Data Pipeline & Workflow Engineering - Architect and implement robust ETL and data ingestion pipelines (Spark/Beam/Dask/Flume) tailored for petabyte-scale ML datasets.

- Integrate experiment management and workflow orchestration tools (Airflow, Kubeflow, Metaflow) to streamline research-to-production. Collaboration & Mentorship - Partner with ML researchers to translate prototype requirements into production-grade systems.

- Mentor and coach engineers on best practices in performance tuning, systems design, and reliability engineering.

Required Qualifications - Master's degree (PhD's degree is preferred) in Computer Science, Engineering, or a related technical field.

- 5+ years in infrastructure or systems engineering focused roles, with at least 2 years focused on ML/AI infrastructure.

- Strong programming skills in Python, C++, Go, or Rust for systems development and automation.

- Ability to design end-to-end systems that balance performance, reliability, security, and cost.

- Excellent communicator able to bridge research and production teams.

- Strong problem-solving aptitude and a drive to push the state of the art in ML infrastructure.

Preferred Qualifications - Hands-on experience with ML training frameworks (PyTorch, Tensor Flow, JAX) at scale.

- Knowledge of hardware-level optimization: CUDA, ROCm, kernel bypass, FPGA/ASIC integration.

- Experience with Heterogeneous Computing for AI, Bigdata, HPC.

- Open-source contributions or patents in the ML systems space.

- Publications in ML or System Conferences such as MLSys, ICML, ICLR, KDD, NeurIPS
Position Requirements
10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary