HPC Infrastructure Engineer

Requisition  Overview:  The High-Performance Computing Systems Section within the National Center for Computational Sciences (NCCS) is seeking an HPC Infrastructure Engineer to join the HPC Infrastructure group.  The preferred candidate will possess commensurate knowledge, skills and abilities in addition to relevant education, certifications, experience and demonstrated ability to work as a member of a team.

NCCS Provides state-of-the-art computational and data science infrastructure coupled with dedicated technical and scientific professionals tackling large-scale problems across a broad range of scientific domains for accelerating scientific discovery and engineering advances. NCCS hosts the Oak Ridge Leadership Computing Facility (OLCF), one of the Department of Energy’s (DOE) National User Facilities which operates Frontier, the nation’s first exascale supercomputer.  Major Duties/Responsibilities:

Linux Administration:

Deploy, configure and manage HPC-scale services in a Linux environment, primarily Red Hat and Rocky.

Perform regular patches, updates and backups.

Monitor systems using tools like Nagios and Grafana.

Respond to and assist in troubleshooting issues.

Virtualization and Automation:

Design, deploy and manage the Infrastructure platform using IaC tools such as Terraform, Ansible and Puppet.

Deploy and manage resources in the NCCS virtualization environment.

Identify potential automation targets and lead efforts to automate processes.

Define policies and procedures for automation and configuration management for the team and organization as a whole.

Kubernetes Administration:

Work with the NCCS Kubernetes Platform team to deploy and manage services for the HPC Infrastructure group.

Design standardized and automated workflow patterns, build and maintain CI/CD pipelines.

Develop, maintain and review high-quality code for internal tools using programming languages such as Python and Bash.

Project Management and Leadership:

Lead small Infrastructure projects through the project lifecycle.

Mentor and train junior staff, creating training documentation, holding knowledge sharing sessions, and fostering skill growth throughout the team.

Propose and implement improvements to existing Infrastructure systems as well as new systems, processes and procedures.

Basic Qualifications:

BS degree in computer science or closely related field and a minimum of 5 years of experience in Linux systems and Kubernetes platform administration, or a master’s degree and a minimum of 4 years of experience in Linux systems and Kubernetes platform administration.

An equivalent combination of education and experience will be considered.

Preferred Qualifications:

Excellent interpersonal/communication skills and the ability to work within a team.

Strong experience designing, building and maintaining Kubernetes platform tools.

Strong working knowledge of Linux system fundamentals and common network protocols.

Programming and scripting skills in common languages such as Python and Bash.

Understanding of versioning and code review tools like Git Hub and Git Lab.

Experience implementing and supporting highly-available systems and services.

Experience with configuration management tools such as Puppet or Ansible.

Experience deploying and maintaining virtual environments using VMWare.

Experience deploying, maintaining and troubleshooting a variety of infrastructure services such as OpenLDAP, DNS, DHCP, etc..Ability to plan, prioritize and complete assigned projects with minimal supervision.

Special Requirements :

This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse (WSAP) testing designated position. WSAP positions require passing a…