SK Hynix Flexes 24GB HBM3 DRAM With 819GB/s Of Bandwidth To Boost ML Workloads | HotHardware For those who don't know what it is, HBM is "High Bandwidth Memory", or DRAM that can be used on any chip or added as memory sticks. Today, you might want 64gb of DDR4 for crunching big numbers, such as rendering video or whatever, but partly we use so much memory because the memory we have is too slow. Its lagged way behind the speed of processors, but memory is often cheaper to produce, and HBM3 could possibly make it to consumer markets within a few years. This particular memory is a whopping 70% faster bandwidth capacity, which puts it up there with Intel's "3dXpoint". Very likely, the first consumer applications for this kind of memory would be on chips with integrated graphics. In general, the integrated graphics on chips tends to approach the power of the latest consoles, while this kind of HBM3 could definitely put a Star Trek holodeck on a single chip. Most people don't realize just how slow our current computers are, and how easy it would be to make them way faster, except the entire market might as well be run by the Mafia.
