I was thinking "Oh that's cool, they solved something". I get why the LLC works, you store your current frame buffers in there, that's the most commonly accessed data for graphics in a GPU. You need to read and write to that a ton. But you also need to read out a lot of your main memory data every frame. Developers don't fill those multiple gigs of memory up with nothing, and this is especially true of deferred rendering (which is most engines today). They need to read then copy out uncompressed g-buffers every frame, and while developers are solving this GPU makers can't assume they have.
LLC and cache structure was, and is, a known commodity. The bottleneck between memory and processor is well understood and has been an optimization target for everything for quite a while now. But there's not much left to do there, everything is compressed, everything is cached up to the eyeballs, standard pre-fetch has been around for decades now on the GPU. Unlike LLC, which was similar to something first shown off elsewhere, or delta compression, another topic that had papers out before anyone implemented it, there's no publicly known solution to how AMD could squeeze yet more out of their bus that I'm aware of. And all I can come up with is the assumption, possibly a dangerous one, that there's bubbles of bandwidth availability in those buses on all titles. Not just some, not just most, all titles, that could be used to prefetch assets such that the bubbles are smoothed out. That is literally the only physical way this could work, and it's a very overarching assumption.
The cost doesn't go down almost at all either. Your assumptions are wrong, the rumor directly points to this card being nigh as big as a 6900xt. The only real savings are less ram, and that doesn't matter. What matters is the point that it would cost less if this card were on N5 and a chiplet based card. There is no "well it's good enough" here, if AMD can just make more money in a really obvious way like putting the card on a better node for it then they are nigh guaranteed to do that.