Data center GPUs
Intel Gaudi 3 (HL-325L OAM)
Memory
128 GB
Bandwidth
3,700 GB/s
FP16
1,678 TFLOPS
FP8
1,678 TFLOPS
- Maker
- Intel
- Model
- Gaudi 3 (HL-325L OAM)
- Type
- Data center GPUs
- Memory
- 128 GB
- Memory type
- HBM2E
- Bandwidth
- 3,700 GB/s
- FP16
- 1,678 TFLOPS
- FP8
- 1,678 TFLOPS
- Power
- 900 W
- Form factor
- OAM (OCP OAM v2.0)
- Interface
- PCIe 5.0 x16, 24x 200GbE RoCE v2 integrated
- Released
- 2024
Notes on these figures
fp16 field is BF16 MME 1,678 TFLOPS; white paper lists FP16 MME at only 459 TFLOPS. FP8 MME 1,678. No sparsity figures given. TDP up to 900W. Product brief https://cdrdv2-public.intel.com/817487/gaudi-3-ai-accelerator-hl-325l-oam-mezzanine-card-product-brief.pdf. Unveiled Intel Vision April 9, 2024.
Source: the maker's published specifications at cdrdv2-public.intel.com. A missing figure means the maker does not publish it. Confirm current specifications with the maker or a dealer before you buy.
Comparable data center gpus
| Model | Memory | Memory type | Bandwidth | FP16 |
|---|---|---|---|---|
| Intel Gaudi 3 (HL-338 PCIe) | 128 GB | HBM2E | 3,700 GB/s | - |
| NVIDIA H200 NVL | 141 GB | HBM3e | 4,800 GB/s | 835.5 TFLOPS |
| NVIDIA H200 SXM | 141 GB | HBM3e | 4,800 GB/s | 989.5 TFLOPS |
| NVIDIA H100 NVL | 94 GB | HBM3 | 3,900 GB/s | 835.5 TFLOPS |
| NVIDIA H100 SXM | 80 GB | HBM3 | 3,350 GB/s | 989.5 TFLOPS |
| NVIDIA B200 (HGX, SXM) | 180 GB | HBM3e | 8,000 GB/s | 2,250 TFLOPS |