The NVIDIA H100 NVL GPU is a powerhouse, designed for high-performance computing and AI applications, featuring 94GB of HBM3 GPU memory and a bandwidth of 7.8TB/s.
✓ FP64: 68 teraFLOPs
✓ FP64 Tensor Core: 134 teraFLOPs
✓ FP32: 134 teraFLOPs
✓ TF32 Tensor Core: 1,979 teraFLOPs
✓ BFLOAT16 Tensor Core: 3,958 teraFLOPs
✓ FP16 Tensor Core: 3,958 teraFLOPs
✓ FP8 Tensor Core: 7,916 teraFLOPs
✓ INT8 Tensor Core: 7,916 TOPS
✓ GPU Memory: 94GB HBM3
✓ GPU Memory Bandwidth: 7.8TB/s
✓ Decoders: 14 NVDEC, 14 JPEG
✓ Max TDP: 2x 350-400W (configurable)
✓ Multi-Instance GPUs (MIGS): Up to 14 MIGS @ 12GB each
✓ Form Factor: Dual-slot air-cooled
✓ Interconnect: NVLink: 600GB/s, PCIe Gen5: 128GB/s
✓ Server Options: Partner and NVIDIA-Certified Systems with 2-4 pairs
✓ NVIDIA AI Enterprise: Add-on