Kubernetes System Architect

Solving complexity. Accelerating results.

At Penguin Solutions, we understand the boundless potential of technology and support our customers in turning cutting‑edge ideas into outcomes—faster, and at any scale.

With over two decades of experience as trusted advisors, Penguin Solutions is an end‑to‑end technology company solving the industry’s most complex challenges in computing, memory, and LED solutions. Penguin designs, builds, deploys, and manages high‑performance, high‑availability enterprise solutions, allowing customers to achieve their breakthrough innovations.

Requisition

Location:

US

Penguin's ICE Software products are used in the deployment, provisioning, management, and monitoring of some of the largest computational systems in the world. In this role as a Kubernetes System Architect, you will join our remote‑first Software Engineering organization as a specialist focused on Kubernetes and container orchestration technologies as part of our cluster management software, ICE Cluster Ware.

This role combines deep hands‑on experience administering Kubernetes clusters with the ability to architect and guide large‑scale, systems‑level integrations. The successful candidate will serve as the technical bridge between modern containerized infrastructure paradigms and our cluster management initiatives, bringing critical Kubernetes expertise to enhance our capabilities for AI and High‑Performance Computing (HPC) Linux‑based environments.

As a member of our ICE Software Engineering team, you will work closely with software engineers, QA engineers, and our scrum master to design, prototype, and implement robust Kubernetes‑based integrations. You will also partner with Product Managers, Solution Architects, and Product Architects to ensure Kubernetes‑related initiatives align with product strategy and system scalability goals. This position requires both strong technical depth and architectural vision to translate complex container management concepts into actionable, maintainable, and product‑ready solutions.

• Define and architect Kubernetes integration strategies within the ICE Cluster Ware platform to enable containerized workloads and hybrid cluster orchestration.
• Design scalable, secure, and resilient Kubernetes‑based infrastructure for HPC and AI compute environments.
• Develop architectural blueprints for cluster lifecycle management, service discovery, and workload scheduling across on‑premise and hybrid infrastructures.
• Evaluate emerging CNCF ecosystem technologies (e.g., operators, CRDs, service meshes, observability stacks) and guide adoption strategies.
• Provide technical leadership in Kubernetes administration, troubleshooting, and performance optimization.
• Define best practices for all aspects of Kubernetes cluster configuration, scaling, and upgrade strategies.

• Collaborate with software engineering teams to integrate Kubernetes APIs and services into ICE Cluster Ware’s management and monitoring subsystems.
• Enable seamless integration of Kubernetes with existing cluster management workflows, job schedulers, and monitoring frameworks.
• Administer and maintain Kubernetes clusters, including cluster creation, upgrades, node management, and scaling.
• Drive consistency in configuration, security, and policy enforcement across multi‑cluster deployments.
• Implement observability and reliability frameworks for monitoring, logging, and alerting using leveraging Kubernetes‑native tools such as Prometheus, Grafana, and Open Telemetry.
• Manage and optimize cluster networking, including CNI plugin configuration (e.g., Calico, Cilium), ingress controllers, and service meshes.
• Configure and maintain persistent storage solutions in Kubernetes using dynamic provisioning, CSI drivers, and storage classes.
• Manage authentication, authorization, and access control through RBAC, service accounts, and integration with external identity providers.

• Serve as the internal Kubernetes subject matter expert and mentor for engineering peers.
• Partner with automation teams to ensure system reliability through automation and Infrastructure‑as‑Code…