H200 SXM5 HGX

NVIDIA HGX H200 combines H200 Tensor Core GPUs with high-speed interconnects to form the world’s most powerful accelerated scale-up server platform for AI and HPC. With up to eight H200 GPUs, HGX H200 offers 141 gigabytes (GB) of HBM3e memory per GPU at 4.8 terabytes per second (TB/s) for an aggregate total of 1,128 GB of GPU memory.

HGX H200 includes advanced networking options—at speeds up to 400 gigabits per second (Gb/s)—utilizing NVIDIA Quantum-2 InfiniBand and Spectrum™-X Ethernet for the highest AI performance.

Our optimized HGX configuration

  • CPU: Dual Intel 8480+ Processors

  • GPU: 8x H200 141GB (1,128GB) SXM5

  • Memory: 32x 64GB DDR5 4800Mhz ECC (2048GB total)

  • Boot Drive: 960GB M.2 NVMe

  • SSD Storage: 30TB NVMe (4x 7.68TB or 8x 3.84TB)

  • RDMA Network Card: 8x ConnectX-7 400G InfiniBand SP

  • Storage Network Card: Dual Port 100G

  • TPM: TPM-SPI 2.0