WAVE HPC Technical Specifications - Santa Clara University

Computational Resources

The compute resources within the HPC are composed of 11 heterogenous physical nodes of four different types.

CPU Nodes

Hardware Specification
Node Type	CPU Node
Number of Nodes	4
Server	Dell PowerEdge R740 Rack Server
Processor	Intel Xeon Platinum 8168 2.7G
Total CPUs per Node [1]	96
Total Memory per Node	512 GB
Local Disk Storage per Node	1.92 TB
GPU Processor	None

[1] The system has dual processors (i.e. has 2 processors), each processor has 24 physical cores, and each core has two threads. Total CPUs = 2 x 24 x 2 = 96.

GPU Nodes

Hardware Specification
Node Type	GPU Node
Number of Nodes	4
Server	Dell PowerEdge R740 Rack Server
Processor	Intel Xeon Gold 6148 2.4G
Total CPUs per Node [3]	80
Total Memory per Node	384 GB
Local Disk Storage per Node	1.92 TB
GPU Processor	NVIDIA Tesla V100 32G
Number of GPUs per Node	2

[3] The system has dual processors (i.e. has 2 processors), each processor has 20 physical cores, and each core has two threads. Total CPUs = 2 x 20 x 2 = 80.

Mem Nodes

Hardware Specification
Node Type	Mem Node
Number of Nodes	2
Server	Dell PowerEdge R740 Rack Server
Processor	Intel Xeon Platinum 8268 2.9G
Total CPUs per Node [2]	96
Total Memory per Node	2 TB
Local Disk Storage per Node	3.84 TB
GPU Processor	None

[2] The system has dual processors (i.e. has 2 processors), each processor has 24 physical cores, and each core has two threads. Total CPUs = 2 x 24 x 2 = 96

GPU Nodes

Hardware Specification
Node Type	GPU Node
Number of Nodes	4
Server	Dell PowerEdge R740 Rack Server
Processor	Intel Xeon Gold 6148 2.4G
Total CPUs per Node [3]	80
Total Memory per Node	384 GB
Local Disk Storage per Node	1.92 TB
GPU Processor	NVIDIA Tesla V100 32G
Number of GPUs per Node	2

[3] The system has dual processors (i.e. has 2 processors), each processor has 20 physical cores, and each core has two threads. Total CPUs = 2 x 20 x 2 = 80.

AMD Nodes

Hardware Specification
Node Type	AMD Node
Number of Nodes	1
Server	AMAX 4U GPU HPC Server
Processor	AMD EPYC 7v13 64-Core Processor
Total CPUs per Node [4]	256
Total Memory per Node	256 GB
Local Disk Storage per Node	960 GB
GPU Processor	AMD Instinct MI100 GPU
Number of GPUs per Node	8

[4] The system has dual processors (i.e. has 2 processors), each processor has 64 physical cores, and each core has two threads. Total CPUs = 2 x 64 x 2 = 256.

BIO Nodes

bio0[1-3]

Hardware Specification
Node Type	BIO Node
Number of Nodes	3
Server	SuperMicro 1U GPU Server
Processor	Intel Xeon Gold 6338 2.0GHz
Total CPUs per Node [6]	128
Total Memory per Node	128 GB
Local Disk Storage per Node	224 GB
GPU Processor	Nvidia A16
Number of GPUs per Node [7]	8

[5] Note: The bio nodes belong to Dr. Michelle McCully in the Biology Department and are colocated in the WAVE HPC. Her research has priority on these nodes, though they are available for use by others.

[6] Each node has 2 processors (i.e. dual processors), each processor has 32 physical cores, and each core has two threads. Total CPUs = 2 x 32 x 2 = 128.

[7] The node contains 2 Nvidia A16 GPU boards, but an A16 is a packaging of 4 GPUs per board. Therefore the GPUs appear as if there are 8 GPUs on the server (4 per GPU board).

bio0[4-6]

Hardware Specification
Node Type	BIO Node
Number of Nodes	3
Server	SuperMicro SuperServer 1028GQ-TRT
Processor	Intel Xeon E5-2650 v4 @ 2.20 GHz
Total CPUs per Node	48
Total Memory per Node	128 GB
Local Disk Storage per Node	894 GB
GPU Processor	NVIDIA GTX 1080
Number of GPUs per Node	2

Conda Nodes

dmlab01

Hardware Specification
Node Type	dmlab
Number of Nodes	1
Server	Dell Poweredge R740
Processor	Intel Xeon Gold 6148 2.40 GHz
Total CPUs per Node	80
Total Memory per Node	768 GB
Local Disk Storage per Node	894 GB
GPU Processor	Tesla V100
Number of GPUs per Node	2

dmlab02

Hardware Specification
Node Type	dmlab
Number of Nodes	1
Server	SuperMicro SYS-420P-TNAR+
Processor	Intel Xeon Platinum 8352Y 2.20 GHz
Total CPUs per Node	128
Total Memory per Node	1024 GB
Local Disk Storage per Node	4.4 TB
GPU Processor	NVIDIA A100
Number of GPUs per Node	8

dmlab03

Hardware Specification
Node Type	dmlab
Number of Nodes	1
Server	SuperMicro ARS-111GL-NHR-A1
Total CPUs per Node	72
Total Memory per Node	480 GB
Total GPU Memory per Node	96 GB
Local Disk Storage per Node	7.0 TB
GPU Processor	NVIDIA GH200
Number of GPUs per Node	1

dmlab04

Hardware Specification
Node Type	dmlab
Number of Nodes	1
Server	SuperMicro ARS-111GL-NHR-A1
Total CPUs per Node	72
Total Memory per Node	480 GB
Total GPU Memory per Node	96 GB
Local Disk Storage per Node	7.0 TB
GPU Processor	NVIDIA GH200
Number of GPUs per Node	1

oignat01

Hardware Specification
Node Type	oignat_lab
Number of Nodes	1
Server	SuperMicro AS-4125Gs-TNRT
Processor	AMD EPYC 9654
Total CPUs per Node	384
Total Memory per Node	1536 GB
Local Disk Storage per Node	894 GB
GPU Processor	Nvidia L40S
Number of GPUs per Node	4

ycho201

Hardware Specification
Node Type	ycho_lab
Number of Nodes	1
Server	SuperMicro AS-1125HS-TNR
Processor	AMD EPYC 9654
Total CPUs per Node	384
Total Memory per Node	1536 GB
Local Disk Storage per Node	894 GB
GPU Processor	N/A
Number of GPUs per Node	0

ycho202

Hardware Specification
Node Type	ycho_lab
Number of Nodes	1
Server	SuperMicro AS-1125HS-TNR
Processor	AMD EPYC 9654
Total CPUs per Node	384
Total Memory per Node	1536 GB
Local Disk Storage per Node	894 GB
GPU Processor	N/A
Number of GPUs per Node	0

rgrotjahn0[1-2]

Hardware Specification
Node Type	rgrotjahn_lab
Number of Nodes	1
Server	SuperMicro AS-1125HS-TNR
Processor	AMD EPYC 9354
Total CPUs per Node	128
Total Memory per Node	768 GB
Local Disk Storage per Node	8 TB
GPU Processor	N/A
Number of GPUs per Node	0

rgrotjahn0[3-4]

Hardware Specification
Node Type	rgrotjahn_lab
Number of Nodes	1
Server	SuperMicro AS-1125HS-TNR
Processor	AMD EPYC 9654
Total CPUs per Node	384
Total Memory per Node	1536 GB
Local Disk Storage per Node	894 GB
GPU Processor	N/A
Number of GPUs per Node	0

Access Nodes

HUB Nodes

Hardware Specification
Node Type	Hub Node
Number of Nodes	10
Server	Dell Precision 5820 Tower Workstation
Processor	Intel(R) Xeon(R) W-2123 CPU @ 3.60GHz
Total CPUs per Node	1
Total Memory per Node	30 GB
Local Disk Storage per Node	800 GB
GPU Processor	NVIDIA GeForce GTX 1080
Number of GPUs per Node	1

Login Nodes

Hardware Specification
Node Type	Login Node
Number of Nodes	3
Server	SuperMicro AS-1015CS-TNR
Processor	AMD EPYC 9334
Total CPUs per Node	64
Total Memory per Node	128 GB
Local Disk Storage per Node	60 GB

NSF Storage

Equipment	Total Space	Usable Space
Fujisu ETERNUS AF250 S2 All Flash SSD	92 TB	63TB
Dell EMC ME4084 Storage Array	456 TB HDD (7TB SSD cache)	408 TB HDD (7TB SSD cache)

Networking

Equipment	Media	Speed	Usage
Cisco Nexus N9K-C93180YC-EX	Optical	10-40G	Dual Fiber Network Controllers
Mellanox QM8700	IB	100G	Infiniband Switch
TP-LINK JetStream 48-Port Gigabit Smart Switch	RJ-45 Copper	1G	Management Switch