Home » Micron’s 1.2TB/s HBM3E Manufacturing Kicks Into High Gear As AI Demand Skyrockets

Micron’s 1.2TB/s HBM3E Manufacturing Kicks Into High Gear As AI Demand Skyrockets

by Anjali Anjali
0 comment
Front and back renders of Micron's HBM3e memory chips on a dark blue gradient background.
In case you have not observed, the period of synthetic intelligence (AI) is being ushered in at a blistering tempo, thanks in massive components to NVIDIA’s high-end GPU and accelerator options—its information heart enterprise outpaced its gaming division by 4X final quarter (when it comes to income). Of course, it takes a village, in addition to quick reminiscence options. Enter Micron, which introduced at this time that it has commenced quantity manufacturing of its High Bandwidth Memory 3E (HBM3E) answer “to speed up the expansion of AI.”
Part of the rationale that is notable is as a result of Micron’s 24GB 8H HBM3E can be a part of NVIDIA’s H200 Tensor Core GPUs which might be slated to ship within the second quarter of this yr. Additionally, the extra gamers there are, the merrier—rival SK hynix just lately introduced that it is already offered out of its HBM allocation for the whole thing of 2024.

“Micron is delivering a trifecta with this HBM3E milestone: time-to-market management, best-in-class {industry} efficiency, and a differentiated energy effectivity profile,” mentioned Sumit Sadana, government vice chairman and chief enterprise officer at Micron Technology. “AI workloads are closely reliant on reminiscence bandwidth and capability, and Micron may be very well-positioned to assist the numerous AI progress forward via our industry-leading HBM3E and HBM4 roadmap, in addition to our full portfolio of DRAM and NAND options for AI functions.”

The efficiency that Sadana alludes to is blistering pin pace of 9.2 gigabits per second (GB/s), leading to reminiscence bandwidth of greater than 1.2 terabytes per second (TB/s). It’s additionally energy environment friendly—Micron claims its HBM3E reminiscence consumes 30% much less energy than its rivals.

This does not imply an entire lot for customers, not less than in a roundabout way, AMD flirted with HBM on its gaming GPUs (bear in mind Vega?), however the price to efficiency ratio simply is not aggressive with GDDR. While uncooked bandwidth is not unimportant, amount takes precedence within the shopper realm. We additionally do not need to think about how way more gaming graphics card would price of AMD, Intel, and NVIDIA determined to make a wholesale swap to HBM as an alternative of GDDR.

Micron says its HBM3E presents 24GB of capability presently, however is sampling 36GB 12-High HBM3E for accomplice options that can debut in March.

You may also like

Leave a Comment