AMD Instinct MI210 MCM GPU Accelerator With 64 GB HBM2e Memory Is Priced A Staggering $16,500 US In Japan

Hassan Mujtaba Comments

Last month, AMD expanded its Instinct MI200 lineup with the latest Mi210 GPU accelerator, a PCIe variant with 64 GB of HBM2e memory. So far, AMD hasn't confirmed any price and stated March availability for the cards but it looks like Japanese HPC and server users will be getting the card this month for a price exceeding $15,000 US.

AMD Aldebaran GPU Accelerators Are Expensive! MI210 PCIe With 64 GB HBM2e Memory Costs over $16,000 US In Japan

Unlike the MI250 accelerators, the AMD Instinct MI210 features a single-chip design based on the same TSMC 6nm process node that its MCM siblings utilize. In terms of specifications, the Instinct MI210 features a single GCD. The single GCD is equipped with 104 CUs out of the 128 CUs featured on the Aldebaran chip. Even the higher-end MI250X features just 110 CUs enabled per die for a total of 7040 stream processors. The MI210 is housing 6656 stream processors.

Related Story AMD Confirms Next-Gen EPYC Venice “Zen 6” CPUs Are The First HPC Product Made Using TSMC’s 2nm “N2” Process, 5th Gen EPYC Validated At TSMC Arizona
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_2-very_compressed-scale-4_00x
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_3-very_compressed-scale-4_00x
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_4-very_compressed-scale-4_00x
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_5-very_compressed-scale-4_00x
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_1-very_compressed-scale-4_00x
amd-instinct-mi210-gpu-accelerator-64-gbamd-instinct-mi210-gpu-accelerator-_6-very_compressed-scale-4_00x

In addition to the core count, the AMD Instinct MI210 also rocks 64 GB of HBM2e memory running across a 4096-bit bus interface which is half the amount of the Instinct MI250X but twice the memory capacity of the Instinct MI100 and that was the flagship just a few months ago until it got replaced by the MI250 series.  The clock speeds are rated at 1700 MHz (Peak Engine Clock) while the memory operates at 1600 MHz. The memory bandwidth for the GPU is rated at 1638.4 GB/s.

As for the compute horsepower, the Instinct MI210 delivers 181 TFLOPs of peak FP16, 45.3 TFLOPs of peak FP32 Matrix, and the same amount for FP64 Matrix calculations. The bfloat16, INT8 & INT4 numbers are rated at 181 TOPs/TFLOPs. The standard non-Matrix FP64/FP32 is rated at 22.6 TFLOP which is obviously lower than the MI250X series. The GPU has a TBP rating of 300W and requires a single 8-pin connector to boot.

The AMD Instinct MI210 GPU accelerator is priced at a staggering $16,500 US in Japan. (Image Credits: Ask-corp)

According to the Japanese outlet, Ask-corp, the AMD Instinct MI210 is scheduled for market release this month and will be available at an expected market price of 2,087,800 Yen (Tax Included). This converts to $16,485.65 US which is just a staggering amount. The official MSRP has not been really disclosed yet but based on this, it can be expected above $10,000 US.

amd-instinct-mi210-gpu-accelerator-_5-custom
amd-instinct-mi210-gpu-accelerator-_4-custom
amd-instinct-mi210-gpu-accelerator-_6-custom
amd-instinct-mi210-gpu-accelerator-_3-custom
amd-instinct-mi210-gpu-accelerator-_2-2

Now we know that our audience will be comparing this number to consumer graphics cards such as the RTX 3090 Ti which can cost anywhere between $4500 to $5500 US but Instinct card is a whole different beast. It's designed for the HPC segment and offers much more compute horsepower and 24/7 stability that the gaming cards aren't designed to offer. The Instinct MI210 will come in the standard FHFL form factor and be enclosed in a dual-slot shroud without any active cooling solution since it is designed for servers with their own cooling hence the passive approach.

AMD Radeon Instinct Accelerators

Accelerator NameAMD Instinct MI400AMD Instinct MI350XAMD Instinct MI300XAMD Instinct MI300AAMD Instinct MI250XAMD Instinct MI250AMD Instinct MI210AMD Instinct MI100AMD Radeon Instinct MI60AMD Radeon Instinct MI50AMD Radeon Instinct MI25AMD Radeon Instinct MI8AMD Radeon Instinct MI6
CPU ArchitectureZen 5 (Exascale APU)N/AN/AZen 4 (Exascale APU)N/AN/AN/AN/AN/AN/AN/AN/AN/A
GPU ArchitectureCDNA 4CDNA 3+?Aqua Vanjaram (CDNA 3)Aqua Vanjaram (CDNA 3)Aldebaran (CDNA 2)Aldebaran (CDNA 2)Aldebaran (CDNA 2)Arcturus (CDNA 1)Vega 20Vega 20Vega 10Fiji XTPolaris 10
GPU Process Node4nm4nm5nm+6nm5nm+6nm6nm6nm6nm7nm FinFET7nm FinFET7nm FinFET14nm FinFET28nm14nm FinFET
GPU ChipletsTBDTBD8 (MCM)8 (MCM)2 (MCM)
1 (Per Die)
2 (MCM)
1 (Per Die)
2 (MCM)
1 (Per Die)
1 (Monolithic)1 (Monolithic)1 (Monolithic)1 (Monolithic)1 (Monolithic)1 (Monolithic)
GPU CoresTBDTBD19,45614,59214,08013,3126656768040963840409640962304
GPU Clock SpeedTBDTBD2100 MHz2100 MHz1700 MHz1700 MHz1700 MHz1500 MHz1800 MHz1725 MHz1500 MHz1000 MHz1237 MHz
INT8 ComputeTBDTBD2614 TOPS1961 TOPS383 TOPs362 TOPS181 TOPS92.3 TOPSN/AN/AN/AN/AN/A
FP16 ComputeTBDTBD1.3 PFLOPs980.6 TFLOPs383 TFLOPs362 TFLOPs181 TFLOPs185 TFLOPs29.5 TFLOPs26.5 TFLOPs24.6 TFLOPs8.2 TFLOPs5.7 TFLOPs
FP32 ComputeTBDTBD163.4 TFLOPs122.6 TFLOPs95.7 TFLOPs90.5 TFLOPs45.3 TFLOPs23.1 TFLOPs14.7 TFLOPs13.3 TFLOPs12.3 TFLOPs8.2 TFLOPs5.7 TFLOPs
FP64 ComputeTBDTBD81.7 TFLOPs61.3 TFLOPs47.9 TFLOPs45.3 TFLOPs22.6 TFLOPs11.5 TFLOPs7.4 TFLOPs6.6 TFLOPs768 GFLOPs512 GFLOPs384 GFLOPs
VRAMTBDHBM3e192 GB HBM3128 GB HBM3128 GB HBM2e128 GB HBM2e64 GB HBM2e32 GB HBM232 GB HBM216 GB HBM216 GB HBM24 GB HBM116 GB GDDR5
Infinity CacheTBDTBD256 MB256 MBN/AN/AN/AN/AN/AN/AN/AN/AN/A
Memory ClockTBDTBD5.2 Gbps5.2 Gbps3.2 Gbps3.2 Gbps3.2 Gbps1200 MHz1000 MHz1000 MHz945 MHz500 MHz1750 MHz
Memory BusTBDTBD8192-bit8192-bit8192-bit8192-bit4096-bit4096-bit bus4096-bit bus4096-bit bus2048-bit bus4096-bit bus256-bit bus
Memory BandwidthTBDTBD5.3 TB/s5.3 TB/s3.2 TB/s3.2 TB/s1.6 TB/s1.23 TB/s1 TB/s1 TB/s484 GB/s512 GB/s224 GB/s
Form FactorTBDTBDOAMAPU SH5 SocketOAMOAMDual Slot CardDual Slot, Full LengthDual Slot, Full LengthDual Slot, Full LengthDual Slot, Full LengthDual Slot, Half LengthSingle Slot, Full Length
CoolingTBDTBDPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive CoolingPassive Cooling
TDP (Max)TBDTBD750W760W560W500W300W300W300W300W300W175W150W

Deal of the Day