Senior Network Engineer

ABOUT HUT 8

Imagine the ultimate destination for those who want to work at the cutting edge of technology, energy, and infrastructure. Hut 8 is on a mission to build and operate some of the world's largest data centers for next-generation computing workloads, including AI, Colocation, Cloud, and Bitcoin Mining. We are proud to offer interesting and challenging opportunities for individuals who want to build teams, solve problems, and make an impact from day one.

If you're an ambitious individual looking for a career that is as rewarding as it is challenging, you've come to the right place.

ABOUT THE ROLE

The Senior Network Engineer is responsible for the design, deployment, maintenance, optimization, and troubleshooting of high-performance AI infrastructure networks supporting GPU compute clusters, storage fabrics, and large-scale AI workloads. This role focuses on High-Speed Ethernet, Infini Band, EVPN/VXLAN fabrics, BGP routing, GPU cluster networking, storage integration, and secure multi-tenant AI environments.

The ideal candidate will possess deep experience with hyperscale or HPC networking, AI cluster deployments, data center operations, and advanced troubleshooting across compute, storage, and network fabrics.

Key Responsibilities

AI & HPC Network Architecture

• Design and maintain High-Speed Ethernet and Infini Band fabrics for GPU clusters.
• Deploy and manage EVPN/VXLAN spine-leaf architectures.
• Configure and maintain BGP routing, VRFs, VLANs, MLAG, and high-availability networking.
• Design resilient AI infrastructure supporting multi-tenant environments and large-scale GPU workloads.
• Optimize east-west traffic flows for AI training and inference workloads.

GPU Cluster Infrastructure

• Support NVIDIA GPU cluster networking including:
  • NCCL optimization
  • GPUDirect RDMA
  • RoCEv2
  • Infini Band subnet management
• Troubleshoot cluster communication issues including:
  • Link flapping
  • Congestion
  • Latency
  • Throughput bottlenecks
• Execute and validate NCCL performance testing.

Storage & Data Fabric

• Deploy and support high-performance storage platforms including WEKA and distributed AI storage systems.
• Configure storage VLANs, passthrough networking, and bonded interfaces.
• Optimize storage throughput and low-latency communication between compute and storage environments.

Firewall & Security

• Configure and maintain enterprise firewalls including:
• NAT
• VIPs
• VPN/IPSec
• Traffic shaping
• Security segmentation
• Implement secure multi-tenant access controls.
• Assist with AI governance and controlled AI integration environments.

Automation & Monitoring

• Develop infrastructure automation for:
• Network provisioning
• Firewall policy deployment
• VLAN assignments
• Server imaging
• Implement monitoring and alerting through Grafana and telemetry systems.
• Support API-driven infrastructure management and orchestration.

Data Center Operations

• Assist with deployment and operational planning for AI data center infrastructure.
• Support Tier III resiliency planning and redundancy validation.
• Coordinate with facilities, power, mechanical, and external ISP providers.

ABOUT YOU

• 5+ years of enterprise or data center networking experience.
• 2+ years supporting AI, HPC, or GPU cluster environments.
• Strong experience with:
• BGP
• EVPN/VXLAN
• VLANs
• MLAG
• High-Speed Ethernet (100G/200G/400G/800G)
• Infini Band
• Cumulus
• Experience with NVIDIA UFM and AI fabric management.
• Strong Linux administration skills.
• Experience troubleshooting GPU cluster communication issues.
• Experience with enterprise firewalls and network segmentation.
• Understanding of AI workload traffic patterns and storage networking.

Preferred Qualifications

• Experience with:
• WEKA
• RoCEv2
• NCCL
• Kubernetes
• Slurm
• CUDA environments
• Experience deploying Supermicro Datacenter Building Block Solutions (SMDCBBS).
• Familiarity with liquid-cooled GPU infrastructure.
• Experience with AI inference and training environments.
• Scripting or automation experience:
• Python
• Bash
• Ansible
• API integrations

Soft Skills

• Strong troubleshooting and analytical skills.
• Ability to operate in fast-paced production environments.
• Excellent communication and documentation abilities.
• Ability to coordinate across infrastructure, facilities, and engineering teams.
• Strong sense of ownership and operational accountability.

Pr…