WAVE HPC Technical Specifications

Computational Resources

The main compute resources within the HPC are composed of 11 heterogenous physical nodes of four different types. Condo/Lab nodes are available for use by HPC users but the owners of the nodes have elevated access to resources and jobs running on them may be cancelled and rerun if resources are needed by the lab. HPC resources may only be accessed through the login nodes (via Slurm) or Open OnDemand, which are behind the SCU VPN and also available on the eduroam WiFi on campus.

WAVE HPC System Architecture Diagram

Computation and Access Nodes

These are the most common nodes an HPC user will interface with and their hardware specifications.

CPU Nodes

Node / Amount	CPU Node (4 Nodes)
Server	Dell PowerEdge R740
Processor	Intel Xeon Platinum 8168 2.7G
GPU	N/A
CPUs / Node	96
GPUs / Node	0
Memory / Node	512 GB
Storage / Node	1.92 TB

GPU Nodes

Node / Amount	GPU Node (4 Nodes)
Server	Dell PowerEdge R740
Processor	Intel Xeon Gold 6148 2.4G
GPU	NVIDIA Tesla V100 32G
CPUs / Node	80
GPUs / Node	2
Memory / Node	384 GB
Storage / Node	1.92 TB

Mem Nodes

Node / Amount	Mem Node (2 Nodes)
Server	Dell PowerEdge R740
Processor	Intel Xeon Platinum 8268 2.9G
GPU	N/A
CPUs / Node	96
GPUs / Node	0
Memory / Node	2 TB
Storage / Node	3.84 TB

AMD Node

Node / Amount	AMD Node (1 Node)
Server	ASUSTeK ESC8000A-E11
Processor	AMD EPYC 7713
GPU	AMD Instinct MI100
CPUs / Node	256
GPUs / Node	8
Memory / Node	256 GB
Storage / Node	960 GB

Hub Node

Node / Amount	Hub Node (1 Node)
Server	SuperMicro 5U GPU Server
Processor	AMD EPYC 9255
GPU	NVIDIA RTX PRO 6000
CPUs / Node	96
GPUs / Node	8
Memory / Node	2.3 TB
Storage / Node

Login Nodes

Node / Amount	Login Node (2 Nodes)
Server	SuperMicro 1U CloudDC Server
Processor	AMD EPYC 9334
GPU	NVIDIA A16
CPUs / Node	64
GPUs / Node	1
Memory / Node	128 GB
Storage / Node	60 GB

Condo Nodes

The Condo nodes belong to various SCU labs and faculty. While the owners have priority on these nodes, general HPC users are allowed to utilize the resources when available. Keep in mind that other users' jobs may be preempted if resources are needed by the node owner.

Bio Nodes

Node	bio01
Server	SuperMicro 1U GPU Server
Processor	Intel Xeon Gold 6338
GPU	Nvidia A16
CPUs	128
GPUs	8
Memory	128 GB
Storage	224 GB

Node	bio02
Server	SuperMicro 1U GPU Server
Processor	Intel Xeon Gold 6338
GPU	Nvidia A16
CPUs	128
GPUs	4
Memory	128 GB
Storage	224 GB

Node	bio03
Server	SuperMicro 1U GPU Server
Processor	Intel Xeon Gold 6338
GPU	Nvidia A16
CPUs	128
GPUs	8
Memory	128 GB
Storage	224 GB

Node	bio04
Server	SuperMicro SuperServer 1028GQ-TRT
Processor	Intel Xeon E5-2650 v4
GPU	NVIDIA GeForce GTX 1080 Ti
CPUs	48
GPUs	2
Memory	128 GB
Storage	894 GB

Node	bio05
Server	SuperMicro SuperServer 1028GQ-TRT
Processor	Intel Xeon E5-2650 v4
GPU	NVIDIA GeForce GTX 1080
CPUs	48
GPUs	2
Memory	128 GB
Storage	894 GB

Node	bio06
Server	SuperMicro SuperServer 1028GQ-TRT
Processor	Intel Xeon E5-2650 v4
GPU	NVIDIA GeForce GTX 1080
CPUs	48
GPUs	2
Memory	120 GB
Storage	894 GB

Dmlab Nodes

Node	dmlab01
Server	Dell PowerEdge R740
Processor	Intel Xeon Gold 6148
GPU	NVIDIA Tesla V100
CPUs	80
GPUs	2
Memory	768 GB
Storage	894 GB

Node	dmlab02
Server	SuperMicro 4U GPU Server
Processor	Intel Xeon Platinum 8352Y
GPU	NVIDIA A100
CPUs	128
GPUs	8
Memory	1024 GB
Storage	4.4 TB

Node	dmlab03
Server	SuperMicro 1U GPU Server
Processor	NVIDIA Grace
GPU	NVIDIA GH200
CPUs	72
GPUs	1
Memory	480GB + 96GB GPU Mem
Storage	7.0 TB

Node	dmlab04
Server	SuperMicro 1U GPU Server
Processor	NVIDIA Grace
GPU	NVIDIA GH200
CPUs	72
GPUs	1
Memory	480GB + 96GB GPU Mem
Storage	7.0 TB

Rgrotjahn Nodes

Node	rgrotjahn01
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	128
GPUs	0
Memory	768 GB
Storage	8 TB

Node	rgrotjahn02
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	128
GPUs	0
Memory	768 GB
Storage	8 TB

Node	rgrotjahn03
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Node	rgrotjahn04
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Ycho Nodes

Node	ycho201
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Node	ycho202
Server	SuperMicro 1U Hyper Server
Processor	AMD EPYC 9654
GPU	N/A
CPUs	384
GPUs	0
Memory	1536 GB
Storage	894 GB

Oignat Nodes

Node	oignat01
Server	SuperMicro 4U GPU Server
Processor	AMD EPYC 9654
GPU	Nvidia L40S
CPUs	384
GPUs	4
Memory	1536 GB
Storage	894 GB

Yfang Nodes

Node	yfang01
Server	SuperMicro SYS-1028GQ-TR
Processor	Intel Xeon E5-2630 v3
GPU	NVIDIA GeForce GTX Titan X
CPUs	32
GPUs	4
Memory	112 GB
Storage

NSF Storage and Networking

Storage and Networking hardware for the HPC.

Networking

Equipment	Media	Speed	Usage
Cisco Nexus N9K-C93180YC-EX	Optical	10-40G	Dual Fiber Network Controllers
Mellanox QM8700	IB	100G	Infiniband Switch
TP-LINK JetStream 48-Port Gigabit Smart Switch	RJ-45 Copper	1G	Management Switch

NSF Storage

Equipment	Total Space	Usable Space
Fujisu ETERNUS AF250 S2 All Flash SSD	92 TB	63TB
Dell EMC ME4084 Storage Array	456 TB HDD (7TB SSD cache)	408 TB HDD (7TB SSD cache)