Senior​/Staff AI Cloud Infra Engineer - GPU Compute

Cloud Infrastructure Engineer

We're looking for a Cloud Infrastructure Engineer who thrives on building and scaling large-scale GPU compute platforms fast. You'll be instrumental in developing and managing the foundational infrastructure that powers our AI workloads. Our core infrastructure relies heavily on Python, Kubernetes (K8s), Terraform, and Ansible, but we care more about your ability to learn, adapt, and ship robust solutions than whether you've used these exact tools before.

What you'll do:

• Develop and maintain our core Python platform for routing requests, orchestrating AI workloads, managing GPU server capacity, observability, and more.
• Develop and maintain our infrastructure layer using Terraform, Ansible, and cloud provider APIs to manage our fleet of GPU workers across cloud and potentially bare metal environments.
• Own and operate the technologies underpinning our platform, potentially including K8s, FluxCD, Nomad, Prometheus, Thanos, Grafana, Loki, distributed networking/storage, etc.
• Architect and implement solutions that directly impact the performance and availability of services for millions of ComfyUI users.
• Work closely with our core engineering team to design and build new infrastructure systems.
• Help create the vision and client the foundation for where our infrastructure should go in the next 1/2/5 years.
• Help shape our technical direction and infrastructure best practices as we grow.