HPC Architecture

The Montana Tech HPC (oredigger cluster) contains 1 management node, 26 compute nodes, and a total of 91 TB NFS storage systems. There is an additional computing server (copper). Twenty-two compute nodes contain two 8-core Intel Xeon 2.2 GHz Processors (E5-2660) and either 64 or 128 GB of memory. Hyperthreading is enabled, so 704 threads can run simultaneously on just the XEON CPUs. The remaining four nodes feature the Intel 2nd Generation Xeon Scalable Processors (48 CPU Cores and 192 GB Ram per node). Internally, a 40 Gbps InfiniBand (IB) network interconnects the nodes and the storage system. The system has a theoretical peak performance of 14.2 TFLOPS.

The operating system is Rocky Linux 8.6 and Warewulf is used to maintain and provision the compute nodes (stateless).

Head Node
Component Specifications
CPU Dual E5-2660 (2.2 GHz, 2x 8-cores)
RAM 64 GB
Disk 1 TB SSD
Copper Server
CPU Dual E5-2643 v3 (3.4 GHz, 2x 6-cores)
RAM 128 GB
Disk 1 TB
Other Specs
NFS storage nfs0 - 25 TB
nfs1 - 66 TB
Network Ethernet
40 Gbps InfiniBand

4 Compute Nodes (New)
CPU Dual Xeon Platinum 8260 (2.40 GHz, 2x 24-cores)
RAM 192 GB
Disk 256 GB SSD
Nodes cn31-cn34
14 Compute Nodes
CPU Dual E5-2660 (2.2 GHz, 2x 8-cores)
RAM 64 GB
Disk 450 GB
Nodes cn0-cn11, cn13, cn14
8 Compute Nodes
CPU Dual E5-2660 (2.2 GHz, 2x 8-cores)
RAM 128 GB
Disk 450 GB
Nodes cn12, cn15-cn21