NVIDIA L4 Enterprise PCI-E 24G

Architecture

NVIDIA Ada Lovelace

Use Case

Universal Deep Learning and Video AI Accelerator

GPU Clocks

795 MHz Base | 2040 MHz Boost

FP32

30.3 TFLOPS

TF32 Tensor Core

120 TFLOPS | Sparsity

FP16 Tensor Core

242 TFLOPS | Sparsity

BFLOAT16 Tensor Core

242 TFLOPS | Sparsity

FP8Tensor Core

485 TFLOPS | Sparsity

INT8 Tensor Core

485 TOPS | Sparsity

GPU Memory

24GB

ECC

On by Default

Memory Interface

192-bit

Memory Clock

6251 MHz

GPU Memory Bandwidth

300 GB/s

Display Connectors

None | vGPU Only

NVENC | NVDEC

2 | 4 | 4| JPEG Decoders | AV1 Encode and Decode

Thermal Solution

Passive

Ambient Operating Temperature

0 to 50 Degrees Centigrade

Operating Humidity

5% to 85% Relative Humidity

Maximum Power Consumption

72 W | 40 W Minimum

System Interface

PCIe Gen4 x16 | 64GB/s

Form Factor

6.61” L x 2.71” H | Single Slot | Low-Profile

Server Options

Partner and NVIDIA-Certified Systems with 1-8 GPUs

Hardware Root of Trust

Yes

NEBS Ready

Yes | Level 3