Hardware
Overview
The mc2 cluster consists of:
- Head/Storage Node (this is the landing machine)
- Twin pair of Compute Nodes
The Head Node offers 32 CPU-cores for interactive and web compute services, including a JupyterHub server. Compute nodes offer up to 196 CPU-cores for interactive and non-interactive, serial or parallel compute services.
Each compute node counts with 256 GB of Registered RAM. The whole system has access to 72 TB of user/apps storage, seaminglessly accessible from all nodes via NFS over a 10GBASE-t LAN.
Figure: Architecture of mc2 emphasizing the CPUs, volatile and non-volatile storage, as well as connectivity.
Cluster Nodes
mc2 is equipped with AMD EPYC 9354P (Head Node) and dual socket AMD EPYC 9454 (Compute Nodes). Processing, memory and storage specifications (per node) are described in the table below:
| Specifications | Head Node | Compute Nodes 1, 2 |
|---|---|---|
| CPU | ||
| Manufacturer | AMD® | AMD® |
| Designation | EPYCTM 9354P | EPYCTM 9454 |
| Part No. | 100-100000805 | 100-000000478 |
| Code name | Genoa (Zen 4) | Genoa (Zen 4) |
| No. CPUs (sockets) | 1 | 2 |
| Cores per CPU | 32 | 48 |
| Max turbo Frequency | 3.80 MHz | 3.80 MHz |
| Base frequency | 3.25 Mhz | 2.75 Mhz |
| Level 3 Cache | 256 MB | 256 MB |
| Thermal Design Power (TDP) | 280 W | 290 W |
| Rated memory speed | 4800 MT/s | 4800 MT/s |
| PCI Express Revision | 5.0 | 5.0 |
| Instruction Set Extensions | SSE4.2, AVX, AVX2, AVX-512 | SSE4.2, AVX, AVX2, AVX-512 |
| Memory | ||
| Manufacturer | Micron® | Micron® |
| Designation | Registered DIMM 64 GB | Registered DIMM 64 GB |
| Part No. | MTC40F2046S1RC64BD2 | MTC40F2046S1RC64BD2 |
| Data rate | DDR5 | DDR5 |
| No. DIMMs | 2 | 4 |
| Density | 64 GB | 64 GB |
| Total capacity | 128 GB | 256 GB |
| Max memory speed | 6400 MHz | 6400 MHz |
| Rank organization | 2R × 4 | 2R × 4 |
| Storage | ||
| Manufacturer | Seagate® | Samsung® |
| Designation | IronWolf Pro 3.5" HDD | V-NAND 990 PRO NVMe 4TB |
| Part No. | ST24000NT002 | MZ-V9P4T0BW |
| Interface | SATA 6 GB/s | PCIe 4.0 x4, NVMe 2.0 |
| Sequential Read | Up to 254 MB/s | Up to 7450 MB/s |
| Sequential Write | Up to 230 MB/s | Up to 6900 MB/s |
| Cache memory | 2 TB NVMe® SSD | 4 GB LPDDR4 |
| Density | 24 TB | 4 TB |
| No. volumes | 6 (RAID10) | 4 (RAID-0) |
| Total capacity | 72 TB | 16 TB |
| Mounting point | /home, /opt/apps |
/scratch |
User and apps storage is provided
6×24 TB SATA disks assembled in a RAID10 geometry. The /home mount point on Compute Nodes
hooks to the Head/Storage Node via NFSv4 across a 10GBASE-t LAN.
Compute nodes possess local scratch spaces mounted on /scratch for fast I/O operations.
These comprise an array of four 4 TB SSDs in a striped geometry (RAID0), totaling 16 TB
each.
Users are provided with a limited storage quota, which can be monitored with:
user@hsn:~$ df --human-readable $HOME
Filesystem Size Used Avail Use% Mounted on
home/user 10G 888M 9.2G 9% /home/user