More jobs:
Site Reliability Engineer, AI/ML Infrastructure
Job in
Santa Clara, Santa Clara County, California, 95053, USA
Listed on 2025-12-27
Listing for:
Boson AI
Full Time
position Listed on 2025-12-27
Job specializations:
-
IT/Tech
Cloud Computing, Systems Engineer, SRE/Site Reliability
Job Description & How to Apply Below
About The Role
We’re looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.
You’ll be hands‑on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You’ll also help us plan for future capacity and evaluate new technologies as we continue to scale.
Responsibilities- Manage and optimize HPC cluster operations
- Deploy and maintain infrastructure‑as‑code solutions
- Support ML/research teams with cluster usage optimization
- Operate, troubleshoot and optimize Ceph storage clusters.
- Develop automation and tooling
- 5 years of experience in SRE or HPC operations.
- Proficiency in Linux systems administration (Ubuntu/Debian).
- Experience with Kubernetes and container orchestration
- Experience with Ceph >1PB deployments and maintenance
- Knowledge of security best practices in multi‑tenant environments.
- Understanding of L2/L3 networking fundamentals
- Skilled in Python and Bash scripting.
- Experience with infrastructure‑as‑code tools (Ansible/Terraform).
- Experience with Git Ops (Helm, ArgoCD).
- Strong grasp of RDMA, Infini Band, and GPUDirect technologies
- Familiarity with deep learning frameworks such as PyTorch and Tensor Flow.
- Familiarity in at least one cloud platform: AWS, Azure or GCP.
If you’re a natural problem-solver with a passion for continuous learning, we’d love to hear from you.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×