GPU Systems Engineer
Listed on 2026-07-18
-
IT/Tech
Systems Engineer, Unix/Linux, SRE/Site Reliability, Cloud Computing: Infrastructure & Operations
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment.
Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating systems, and automation tools that enable our trading and research to run 24/7 across the globe. We design, grow, and operate infrastructure at a large scale, including triple‑digit petabyte‑scale storage and massive CPU and GPU clusters in globally distributed data centers. As such, this is a high‑impact role with broad scope, from HPC/AI cluster design and performance tuning, to troubleshooting and automation for thousands of nodes.
Responsibilities- Design, build, and optimize large-scale distributed GPU compute clusters
- Identify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layers
- Collaborate with research and development teams to profile, benchmark, and fine‑tune GPU‑based workloads
- Automate system deployment, monitoring, and troubleshooting across thousands of nodes
- Collaborate with research, and engineering teams to support evolving workloads
- Own critical infrastructure projects — from concept to implementation and support
- Test and deploy new hardware and software, and partner with vendors to resolve complex issues
- 5+ years of experience in large‑scale Linux systems engineering in HPC, AI or distributed infrastructure roles.
- Extensive experience in Linux system installation, performance tuning, and troubleshooting
- Expertise in troubleshooting distributed GPU workloads
- Deep knowledge around GPU optimization and performance
- Proficiency in Python scripting and automation frameworks
- CUDA or C/C++ experience is a plus
- Experience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect RDMA, and NVLink
- Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)
- Comfortable diagnosing complex system issues at the hardware, OS, and network levels
- Strong communication and organizational skills; able to collaborate across diverse technical teams
- Thrive in fast‑paced environments and excited by high‑impact work
The estimated base salary range for this position is $200,000 to $300,000 per year, based on job‑related skills and experience. This role will also be eligible for discretionary performance‑based bonuses and a competitive benefits package which includes medical, dental, vision, basic life insurance, and enrollment in our company’s 401k plan. Employees will also receive 20 vacation days and 10 paid holidays annually, as well as sick and parental leave.
HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).