The Setonix supercomputer from the Pawsey SuperComputing firm is all set to include AMD's next-gen Instinct MI200 GPUs and EPYC Milan CPUs. The specifications for Setonix supercomputer were confirmed by CTO, Ugo Varetto, during ISC 2021.
Setnoix Supercomputer To Be Powered by AMD's Next-Gen Instinct MI200 128 GB GPUs & EPYC Milan CPUs
The specifications of AMD's Instinct MI200 HPC GPU accelerator were revealed last week. It looks like the Setnoix supercomputer is now all set to be one of the first products to feature the CDNA 2 GPUs with MCM technology. The Setnoix supercomputer will be featuring over 200,000 EPYC Milan cores and more than 750 of the brand new AMD MI-Next GPUs (Instinct MI200) based on the CDNA 2 architecture.
The AMD Instinct MI200 GPUs featuring the CDNA 2 architecture are codenamed Aldebaran and will be the first GPUs to feature an MCM design. You can find more details on that here. The GPU will feature 128 GB of HBM2e memory across an 8192-bit bus interface. Since there are at least 750 GPUs featured in the Setnoix GPU, there's a total of 96 Terabytes of graphics memory available on the system.
In terms of CPUs, the system will feature at least 200,000 EPYC Milan cores, and considering that these will most likely be 64 core parts, we can expect the total number of CPUs to be 3125. Other specifications include 548+ TB of system memory, Near-node NVMe storage, 15 PB of ClusterStor Lustre filesystem with 2.7 PB SSDs, 90 PB Ceph Storage (60 PB with 8+3 erasure coding) & a fully software configurable HPC environment based around the HPE Cray Sashta platform. When all is put together, the Setnoix supercomputer will deliver up to 50 PetaFlops of horsepower & will cost around 70 Million dollars.
“We recently received 70 million dollars in funding to invest in replacing our computing, network and storage infrastructure,” Varetto said. “With the recently received funding, we acquired a brand new HPE Cray supercomputer named after a small marsupial endemic to areas close to Perth” – the computer is named Setonix – “[and] in a separate procurement, we acquired 60 petabytes of object storage which will be soon be integrated with the HPE supercomputer in the future.”
The AMD powered Setnoix supercomputer will be used to discover new galaxies and also help develop improved diagnostic tests for COVID-19. Currently, the Pawsey Center in Australia is dependent on its Magnus and Galaxy systems which combined have a total processing power of just 1.83 PetaFlops.
AMD Radeon Instinct Accelerators
| Accelerator Name | AMD Instinct MI400 | AMD Instinct MI350X | AMD Instinct MI300X | AMD Instinct MI300A | AMD Instinct MI250X | AMD Instinct MI250 | AMD Instinct MI210 | AMD Instinct MI100 | AMD Radeon Instinct MI60 | AMD Radeon Instinct MI50 | AMD Radeon Instinct MI25 | AMD Radeon Instinct MI8 | AMD Radeon Instinct MI6 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CPU Architecture | Zen 5 (Exascale APU) | N/A | N/A | Zen 4 (Exascale APU) | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| GPU Architecture | CDNA 4 | CDNA 3+? | Aqua Vanjaram (CDNA 3) | Aqua Vanjaram (CDNA 3) | Aldebaran (CDNA 2) | Aldebaran (CDNA 2) | Aldebaran (CDNA 2) | Arcturus (CDNA 1) | Vega 20 | Vega 20 | Vega 10 | Fiji XT | Polaris 10 |
| GPU Process Node | 4nm | 4nm | 5nm+6nm | 5nm+6nm | 6nm | 6nm | 6nm | 7nm FinFET | 7nm FinFET | 7nm FinFET | 14nm FinFET | 28nm | 14nm FinFET |
| GPU Chiplets | TBD | TBD | 8 (MCM) | 8 (MCM) | 2 (MCM) 1 (Per Die) | 2 (MCM) 1 (Per Die) | 2 (MCM) 1 (Per Die) | 1 (Monolithic) | 1 (Monolithic) | 1 (Monolithic) | 1 (Monolithic) | 1 (Monolithic) | 1 (Monolithic) |
| GPU Cores | TBD | TBD | 19,456 | 14,592 | 14,080 | 13,312 | 6656 | 7680 | 4096 | 3840 | 4096 | 4096 | 2304 |
| GPU Clock Speed | TBD | TBD | 2100 MHz | 2100 MHz | 1700 MHz | 1700 MHz | 1700 MHz | 1500 MHz | 1800 MHz | 1725 MHz | 1500 MHz | 1000 MHz | 1237 MHz |
| INT8 Compute | TBD | TBD | 2614 TOPS | 1961 TOPS | 383 TOPs | 362 TOPS | 181 TOPS | 92.3 TOPS | N/A | N/A | N/A | N/A | N/A |
| FP16 Compute | TBD | TBD | 1.3 PFLOPs | 980.6 TFLOPs | 383 TFLOPs | 362 TFLOPs | 181 TFLOPs | 185 TFLOPs | 29.5 TFLOPs | 26.5 TFLOPs | 24.6 TFLOPs | 8.2 TFLOPs | 5.7 TFLOPs |
| FP32 Compute | TBD | TBD | 163.4 TFLOPs | 122.6 TFLOPs | 95.7 TFLOPs | 90.5 TFLOPs | 45.3 TFLOPs | 23.1 TFLOPs | 14.7 TFLOPs | 13.3 TFLOPs | 12.3 TFLOPs | 8.2 TFLOPs | 5.7 TFLOPs |
| FP64 Compute | TBD | TBD | 81.7 TFLOPs | 61.3 TFLOPs | 47.9 TFLOPs | 45.3 TFLOPs | 22.6 TFLOPs | 11.5 TFLOPs | 7.4 TFLOPs | 6.6 TFLOPs | 768 GFLOPs | 512 GFLOPs | 384 GFLOPs |
| VRAM | TBD | HBM3e | 192 GB HBM3 | 128 GB HBM3 | 128 GB HBM2e | 128 GB HBM2e | 64 GB HBM2e | 32 GB HBM2 | 32 GB HBM2 | 16 GB HBM2 | 16 GB HBM2 | 4 GB HBM1 | 16 GB GDDR5 |
| Infinity Cache | TBD | TBD | 256 MB | 256 MB | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| Memory Clock | TBD | TBD | 5.2 Gbps | 5.2 Gbps | 3.2 Gbps | 3.2 Gbps | 3.2 Gbps | 1200 MHz | 1000 MHz | 1000 MHz | 945 MHz | 500 MHz | 1750 MHz |
| Memory Bus | TBD | TBD | 8192-bit | 8192-bit | 8192-bit | 8192-bit | 4096-bit | 4096-bit bus | 4096-bit bus | 4096-bit bus | 2048-bit bus | 4096-bit bus | 256-bit bus |
| Memory Bandwidth | TBD | TBD | 5.3 TB/s | 5.3 TB/s | 3.2 TB/s | 3.2 TB/s | 1.6 TB/s | 1.23 TB/s | 1 TB/s | 1 TB/s | 484 GB/s | 512 GB/s | 224 GB/s |
| Form Factor | TBD | TBD | OAM | APU SH5 Socket | OAM | OAM | Dual Slot Card | Dual Slot, Full Length | Dual Slot, Full Length | Dual Slot, Full Length | Dual Slot, Full Length | Dual Slot, Half Length | Single Slot, Full Length |
| Cooling | TBD | TBD | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling | Passive Cooling |
| TDP (Max) | TBD | TBD | 750W | 760W | 560W | 500W | 300W | 300W | 300W | 300W | 300W | 175W | 150W |
News Source: Videocardz
