AMD reveals the MI325X, a 288GB AI accelerator built to battle Nvidia's H200 (msn.com) The newest generation of chips contain 190+ cores and 190+ gigabytes of ram, and AMD is going whole hog now on adding as much fast ram as they possibly can. Now its up to 288gb simply because memory is cheaper than transistors, and cramming more in is the only way to compete with Nvidia. So far, AMD has done very well offering significantly cheaper server chips, but Nvidia's Blackwell is a monster, the likes of which nobody has seen. So far, the only benefit from using discrete NPU chips has been for running lightweight background AI, but we're definitely approaching a completely new computer architecture, and AMD is going for broke on memory bandwidth. Normally, laptops are watered down versions of last generation server chips, but they're going for broke on efficiency, and there's only so much they can squeeze out of current transistors. Sadly, we should have had better memory in all our computers long ago, but this industry is responsible for destroying the world ecology, economy, and political stability.
Are these processors intended for use in stand alone devices, or purely in client servers.? Is the ram also client usable, or just used produce processor interface. Finally, how much does the processor and motherboard cost?
The ram is probably layered, with maybe 120gb HBM3e, and then two other types of cheaper ram, all fanning out from the cores, and some of the memory is stacked on top in 2d and 3d. This one is meant for servers, but its a hint at what's coming to their Epic lineup for desktops. The more memory they can pile on top, the more bandwidth they can exploit, and the more cost effective it becomes. Intel is doing something similar with their new chips, stripping out all the unnecessary crap, and adding more cores. Other companies have been working on giant chips with just more cores, but Intel has refined their 7nm process, so they can crank out the most efficient cheap cores. Sadly, the whole electronic revolution has devolved into byzantine insanity, inside Dr Frankenstein's lab. The simple truth is, a single core cpu with 1,400 transistors, working about 300x faster, would be more power than most small businesses need, enough to run the Star Trek holodeck. Everyone is making money by staying just a step ahead of the technology, in how fast they can crank out silicon, and their days are numbered.
