Data center GPUs
AMD Instinct MI300X
Memory
192 GB
Bandwidth
5,300 GB/s
FP16
1,300 TFLOPS
FP8
2,610 TFLOPS
- Maker
- AMD
- Model
- Instinct MI300X
- Type
- Data center GPUs
- Memory
- 192 GB
- Memory type
- HBM3
- Bandwidth
- 5,300 GB/s
- FP16
- 1,300 TFLOPS
- FP8
- 2,610 TFLOPS
- Power
- 750 W
- Form factor
- OAM
- Interface
- PCIe 5.0 x16, 8 Infinity Fabric links at 128 GB/s
- Released
- 2023
Notes on these figures
Dense; page lists FP16/BF16 1.3 PF and FP8 2.61 PF dense (2.61 / 5.22 PF with structured sparsity). No FP4. TBP 750W peak. Launch date 12/06/2023 per AMD page.
Source: the maker's published specifications at amd.com. A missing figure means the maker does not publish it. Confirm current specifications with the maker or a dealer before you buy.
Comparable data center gpus
| Model | Memory | Memory type | Bandwidth | FP16 |
|---|---|---|---|---|
| NVIDIA B200 (HGX, SXM) | 180 GB | HBM3e | 8,000 GB/s | 2,250 TFLOPS |
| NVIDIA H200 NVL | 141 GB | HBM3e | 4,800 GB/s | 835.5 TFLOPS |
| NVIDIA H200 SXM | 141 GB | HBM3e | 4,800 GB/s | 989.5 TFLOPS |
| Intel Gaudi 3 (HL-325L OAM) | 128 GB | HBM2E | 3,700 GB/s | 1,678 TFLOPS |
| Intel Gaudi 3 (HL-338 PCIe) | 128 GB | HBM2E | 3,700 GB/s | - |
| AMD Instinct MI325X | 256 GB | HBM3E | 6,000 GB/s | 1,300 TFLOPS |