High-bandwidth memory (HBM) is an advanced memory interface that vertically stacks DRAM dies on top of each other, connected by through-silicon vias (TSVs). This stack sits on a silicon interposer directly adjacent to the GPU or CPU. The extremely wide data bus allows for massive memory bandwidth at lower clock speeds and lower power consumption compared to traditional planar memory like GDDR.
The new AI accelerator relies on four stacks of HBM to feed the matrix multipliers without bottlenecking the memory interface.
Also heard as
- high-bandwidth memory
Related terms
Graphics processing unit
A specialized processor designed to rapidly manipulate memory to accelerate image creation.
Memory chip
An integrated circuit dedicated solely to storing digital data.
DDR
Double data rate is a clocking technique that transfers data on both the rising and falling edges of a clock signal.
Chiplet
A smaller, modular integrated circuit die designed to be combined with others in a single package.