-
IT/Tech
Job Description & How to Apply Below
Employment Type: Full-Time, Permanent
About the OpportunityWe are seeking a deeply technical, hands-on Private Cloud AI Architect to support a large-scale enterprise operating in a high-security, mission-critical sector.
In this role, you will own the architecture, bare-metal deployment, and day-to-day stability of a high-density, sovereign on-premises AI infrastructure environment.
You will bridge physical bare-metal systems engineering with open-source container orchestration building a high-throughput internal AI utility engineered to host, fine-tune, and serve massive open-weights models (such as Llama, Mistral, and Deep Seek) entirely within secure, physical data center facilities.
Key Responsibilities- Deploy Red Hat Open Shift via CLI using CoreOS Ignition. Configure multi-tenant RBAC, NMState (100G/400G bonding, VLANs), and Kubeflow/Tekton pipelines.
- Deploy and tune NVIDIA NIM, vLLM, Triton, and TensorRT-LLM on next-gen SXM GPUs. Configure MIG and fractional GPU slicing via CLI.
- Tune Linux kernels (sysctl, AMD EPYC NUMA balancing), patch NVIDIA drivers/NCCL, and validate GPUDirect RDMA on Quantum Infini Band fabrics.
- Write Ansible playbooks and Terraform for firmware updates and cluster scaling. Manage local S3 connectors and high-speed NVMe (xfs/ext4) scratch storage.
- Build Prometheus/Grafana dashboards with NVIDIA DCGM to monitor Infini Band links, memory, and rack-level power/thermal limits.
- 8–10+ years in enterprise infrastructure, with 3–5+ years hands-on building bare-metal Kubernetes/Open Shift or on-prem HPC/AI clusters.
- Practical experience deploying NVIDIA NIM/NGC and tuning vLLM, Triton, Deep Speed, or Ray.
- Deep CLI mastery (oc, kubectl) of bare-metal Open Shift and expert RHEL/Ubuntu administration.
- Hands-on experience with NVIDIA Quantum Infini Band (NDR/XDR), Subnet Managers, and NVMe Software-Defined Storage.
- Certifications (Preferred):
Red Hat Open Shift Specialist, CKA/CKS, or NVIDIA Certified Professional (Infini Band / AI Infrastructure).
(
Note:
This is an intensive, hardware-facing infrastructure, networking, and systems architecture role)
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction