Hardware
HBM
High Bandwidth Memory: stacked memory placed next to the GPU chip so data can move to and from it very quickly.
Why it matters
AI workloads are often limited by how fast memory can feed the chip, so HBM capacity and speed are key parts of a GPU’s value.
Related terms
Want a deeper answer?
Ask Kova to explain HBM in the context of your workload. Meet Kova →