Grace Hopper superchip

The NVIDIA Grace Hopper™ architecture brings together the groundbreaking performance of the NVIDIA Hopper™ GPU with the versatility of the NVIDIA Grace™ CPU in a single superchip, connected with the high-bandwidth, memory-coherent NVIDIA® NVLink® Chip-2-Chip (C2C) interconnect. GH200 can also be combined with the NVIDIA NVLink Switch System, with all GPU threads running on up to 256 NVLink-connected GPUs and able to access up to 144 terabytes (TB) of memory at high bandwidth.

Key features

  • 72-core NVIDIA Grace CPU

  • NVIDIA H100 Tensor Core GPU

  • Up to 480GB of LPDDR5X
    memory with error-correction
    code (ECC)

  • Supports 96GB of HBM3 or
    144GB of HBM3e

  • Up to 624GB of fast-access
    memory

  • NVLink-C2C: 900GB/s of
    coherent memory