Skip to content
×

Senior Infrastructure Operations Engineer; DCOps & DevOps

Listing for: Fish Audio
Full Time position Listed on 2026-11-17
Job specializations:
Salary/Wage Range or Industry Benchmark: 180000 - 220000 USD Yearly USD 180000.00 220000.00 YEAR

Job Description & How to Apply Below

Position: Senior Infrastructure Operations Engineer (DCOps & DevOps)

Fish Audio is hiring a Senior GPU Infrastructure Engineer to help operate the infrastructure behind our voice AI products, including NVIDIA B300 GPU clusters, CPU servers, storage systems, and data center networks. The role combines production infrastructure support with hands-on data center operations.

You will be a key operational point of contact during North American business hours, combining hands-on troubleshooting with coordination across our infrastructure team, remote-hands teams, colocation providers, and hardware vendors.

Our Head of Infrastructure leads architecture and key technical decisions. You will work alongside our engineers to monitor cluster health, investigate issues, carry out agreed changes, and keep incidents moving toward resolution. Complex diagnosis and remediation are shared with the team and relevant specialists; your ownership is clear communication, timely escalation, and reliable follow-through.

This is a full-time, hybrid role based in Palo Alto, with occasional data center visits in California and occasional travel to other U.S. locations.

What you'll do
  • Monitor and support production GPU and CPU clusters, Linux servers, storage systems, and network connectivity.
  • Triage alerts and incidents during North American business hours: assess impact, collect logs and diagnostics, perform initial troubleshooting, and coordinate with teammates and vendors through resolution.
  • Work with our Head of Infrastructure and network specialists to validate Ethernet and Infini Band connectivity, investigate fabric issues, and execute agreed configuration changes.
  • Coordinate and oversee remote hands and vendors for server installation, cabling, hardware replacement, and deployment acceptance checks. During site visits, inspect server health and physical connections, collect diagnostics, and work with remote teammates to validate repairs and restore service using agreed procedures.
  • Maintain monitoring, alerting, dashboards, and runbooks, and automate routine health checks and maintenance using Python, Bash, and existing infrastructure tools.
  • Carry out planned infrastructure changes with the team, including validation, documentation, and recovery procedures.
  • Track hardware diagnostics, vendor support cases, and RMAs; maintain asset inventories and clear handoffs across time zones.
  • Assist with routine software deployments and service troubleshooting as needed, in collaboration with infrastructure and application engineers.
What we're looking for
  • 5+ years of relevant experience in infrastructure engineering, Linux systems administration, HPC or cluster operations, production operations, or a related role.
  • Hands-on experience operating and troubleshooting production Linux servers or compute clusters, including physical servers in data center environments.
  • Practical networking fundamentals, including TCP/IP, switching, routing, and diagnosing connectivity problems.
  • Experience with monitoring, alerting, incident triage, and coordinating technical issues through resolution.
  • Working knowledge of server hardware, storage, and data center cabling; ability to perform basic hardware and connectivity checks and validate installation or repair work. Practical scripting skills in Python or Bash.
  • Strong judgment about when to investigate, elevate, or involve a specialist; ability to coordinate teammates, remote hands, and vendors with clear status updates and handoffs.
  • Clear technical communication in English.
  • Ability to work a hybrid schedule based in Palo Alto, provide coverage during North American business hours, visit data centers as needed, and travel occasionally within the U.S.
Nice to have
  • Experience operating production infrastructure at a hyperscale cloud provider, major technology company, GPU cloud provider, or large-scale data center is strongly preferred.
  • Experience with NVIDIA GPU clusters, GPU diagnostics, or HPC environments; familiarity with B300 is a plus.
  • Experience with Infini Band, RDMA, or high-performance cluster networking and fabric diagnostics.
  • Experience with storage clusters, hardware health monitoring, or operations across multiple data centers.
  • Familiarity with containers, configuration management, infrastructure-as-code tools, or routine deployment workflows.
Compensation

The base salary range for this position is US $180,000–$220,000 per year. Final compensation within this range will depend on job-related skills and experience.

We welcome qualified applicants of all backgrounds and evaluate candidates based on…

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary