The subsequent era of NVIDIA playing cards, Blackwell, guarantees to be significantly highly effective, not less than within the server sector. The model is teasing the efficiency of its Blackwell B100, which appears to be like set to double that of the H200, due in 2024.
Blackwell B100: an AI monster?
Currently, essentially the most highly effective card within the area of synthetic intelligence is the H100. It gives colossal efficiency and has been banned from China for this very cause. What’s extra, it’s a card whose supply occasions appear interminable– a sufferer of its personal success, let’s consider.
However, it’s a mannequin that must make means for the H200, because of arrive subsequent yr, clearly within the second quarter. Compared with the A100 (used as a base index), its efficiency can be 18x superior, whereas the H100 was x11 on GPT-3 175B Inference.
Faced with these outcomes, we’ve got the B100, which appears to have doubled its efficiency in opposition to the H200 on the identical benchmark. With this card, NVIDIA can be utilizing a chiplet design for the primary time, i.e. an MCM-type GPU. As for engraving, rumors point out that it is going to be produced in 3 nm by TSMC.
Finally, a number of merchandise can be provided below this era, such because the GB200, successor to the H200. On the opposite hand, we’ve got the B40, successor to the L40S. The attention-grabbing factor right here is the timeframe, since Blackwell may arrive pretty rapidly, with the primary deliveries scheduled for late 2024.
