Grace Hopper superchip
The NVIDIA Grace Hopper™ architecture brings together the groundbreaking performance of the NVIDIA Hopper™ GPU with the versatility of the NVIDIA Grace™ CPU in a single superchip, connected with the high-bandwidth, memory-coherent NVIDIA® NVLink® Chip-2-Chip (C2C) interconnect. GH200 can also be combined with the NVIDIA NVLink Switch System, with all GPU threads running on up to 256 NVLink-connected GPUs and able to access up to 144 terabytes (TB) of memory at high bandwidth.
Key features
72-core NVIDIA Grace CPU
NVIDIA H100 Tensor Core GPU
Up to 480GB of LPDDR5X
memory with error-correction
code (ECC)Supports 96GB of HBM3 or
144GB of HBM3eUp to 624GB of fast-access
memoryNVLink-C2C: 900GB/s of
coherent memory