NVIDIA H100 Hopper GPU With 80GB HBM3 Gets Pictured And It's A Beast

At GTC in March, NVIDIA announced its baddest GPU to date: Hopper H100. Named after US Navy Rear Admiral Grace Hopper, it was announced alongside an upcoming CPU product called Grace. Hopper isn't quite the biggest GPU NVIDIA has ever created—by a scant few square millimeters—but it's certainly the fastest.

Until today, we had only seen renders of the new part. A few folks had been allowed to lay eyes on the hallowed silicon, but it wasn't until now that NVIDIA allowed anyone outside of its halls to share a few snapshots of H100. The pictures in question come from the boys over at ServeTheHome, a site focused on server and enterprise-class hardware.

ServeTheHome got to visit NVIDIA about a month ago, and apparently weren't supposed to take the photos that they did of the H100 module. After finally getting the OK from Team Green though, they've posted up a couple pictures of the "SXM5" module upon which the GPU rests.

SXM5 is the latest form factor from NVIDIA for these kinds of parts. It uses a proprietary mezzanine-style connector on the bottom to interface with its host system. Apparently, SXM5 uses a new style of mezzanine connector, too. The overwhelming majority of the SXM5's module is taken up not by the H100 package itself—even as large as it is—but indeed by the monstrous power delivery mechanism for the chip, which NVIDIA says can draw up to 700 watts.
Locuza, a Twitter user who seems to enjoy making diagrams and infographics examining board and die layouts, did his usual magic on one of the photos. He came up with a physical die size of 822.88 mm² for H100, which lines up pretty neatly with the 814 mm² number given by NVIDIA considering that that number doesn't include scribe lines, the space on a wafer between dice.