Data center GPUs
NVIDIA L4
Memory
24 GB
Bandwidth
300 GB/s
FP16
121 TFLOPS
FP8
242.5 TFLOPS
- Maker
- NVIDIA
- Model
- L4
- Type
- Data center GPUs
- Memory
- 24 GB
- Memory type
- GDDR6
- Bandwidth
- 300 GB/s
- FP16
- 121 TFLOPS
- FP8
- 242.5 TFLOPS
- Power
- 72 W
- Form factor
- PCIe single-slot low-profile
- Interface
- PCIe 4.0 x16 (64 GB/s)
- Released
- 2023
Notes on these figures
Dense; page lists FP16/BF16 242 and FP8 485 TFLOPS with sparsity (footnote: one-half lower without sparsity). GDDR6 from NVIDIA L4 product brief https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/l4/PB-11316-001_v01.pdf. Announced GTC March 2023.
Source: the maker's published specifications at nvidia.com. A missing figure means the maker does not publish it. Confirm current specifications with the maker or a dealer before you buy.
Comparable data center gpus
| Model | Memory | Memory type | Bandwidth | FP16 |
|---|---|---|---|---|
| NVIDIA L40S | 48 GB | GDDR6 | 864 GB/s | 362.1 TFLOPS |
| NVIDIA H100 SXM | 80 GB | HBM3 | 3,350 GB/s | 989.5 TFLOPS |
| NVIDIA H100 NVL | 94 GB | HBM3 | 3,900 GB/s | 835.5 TFLOPS |
| Intel Gaudi 3 (HL-325L OAM) | 128 GB | HBM2E | 3,700 GB/s | 1,678 TFLOPS |
| Intel Gaudi 3 (HL-338 PCIe) | 128 GB | HBM2E | 3,700 GB/s | - |
| NVIDIA H200 NVL | 141 GB | HBM3e | 4,800 GB/s | 835.5 TFLOPS |