The H100 boards are removed from being players’ boards. They are designed to be used in servers and different environments requiring excessive computing energy, and can be found in a number of codecs, together with PCIe and SXM5 variations.
What’s extra, there’s even an NVL model for LLM (Large Language Model) functions, within the type of two boards working as a duo.
Towards 64GB and 94GB H100s?
Now, by way of the PCI ID repository, we study that NVIDIA is engaged on new variations of the H100… In reality, we’re speaking about variations with various quantities of reminiscence. The web site’s entries point out reminiscence configurations in 64 GB and 94 GB!
As ever, the 94 GB configuration all the time raises a number of eyebrows, since 94 GB of reminiscence (HBM) implies the usage of six 16 GB stacks. However, which means 2 GB of capability is deactivated. Once once more, the query is why? Obviously, efficiency remains to be the explanation given. As for the 64 GB configuration, that is straightforward to attain, since NVIDIA merely wants to use 4 stacks of 16 RAM.
Furthermore, there have been rumours of an H100 outfitted with 120 GB VRAM. However, this was based mostly on a photograph of the cardboard taken from a tool supervisor. However, no critical proof was discovered to assist this..
