AMD and Hynix announce joint development of HBM memory stacks

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

SlowSpyder

Lifer
Jan 12, 2005
17,305
1,001
126
The stacked chips are bonded together, so they are like one thick chip, so heat goes through that chip just like it does any other chip. To get the power map of a stacked chip, you just sum up the power maps of all the individual layers-the thickness of each layer is so small that even when they're stacked on top of each other it's like they're one layer from a conventional chip. Bryan said in his talk that thermals are absolutely not a concern for 3D stacking.

It is not stacked DDRx. DDRx refers to the data rate of the *IO pins,* so what goes on inside the DRAM chip doesn't matter as long as it can keep up with the IO rate. HBM will have a layout and organization that will allow it to achieve 1TB/s of throughput (as per the slide above 1024 IOs x 1GHz each), compared to the 1-2 GB/s that a DDR3 chip provides.

HBM is a 2.5D technology, where there is a stack of memory *next to* the chip, connected by a silicon interposer. But in general, the various layers of a 3D stack do not need to be the same size. Smaller layers can go on top of larger layers.


Excellent info, thanks...! I guess AMD, Intel, and Nvidia are going to have to build some better memory controllers.
 

VirtualLarry

No Lifer
Aug 25, 2001
56,452
10,120
126
Will APUs get this technology before discrete cards? If so, it could cause quite an upheaval in the GPU market.
 

Homeles

Platinum Member
Dec 9, 2011
2,580
0
0
Will APUs get this technology before discrete cards? If so, it could cause quite an upheaval in the GPU market.
I would almost guarantee a "no." APUs don't have the margins to absorb that cost.
Will APUs get this technology before discrete cards? If so, it could cause quite an upheaval in the GPU market.
I would almost guarantee a "no." APUs don't have the margins to absorb that cost.
In theory yes. In reality unlikely . It would make Carizzo's iGPU probably the fastest on the market and would erase all the lower end discrete GPUs from competition. Add a year or two on anything they claim and you will get approx. time frame for products.
(Bad) Automobile analogy incoming:

Any car is faster than its competition if you strap a rocket to it. But rockets are expensive.

Same here. You could technically take off-package system RAM out of the equation, but for the time being, it's going to be quite expensive. APUs getting stacked memory is a matter of time, but I really don't think AMD will have it on their APU lineup until the generation after Carrizo at the earliest.

I'm fairly confident they'll have stacked memory before Nvidia though, and possibly before Intel's 14nm Xeon Phi.
 
Last edited:

sefsefsefsef

Senior member
Jun 21, 2007
218
1
71
Bryan Black started his talk by saying that Intel (where he used to work) shot down 3D stacking 10 years ago because it could add "10-15 cents per chip," but that AMD was excited enough about it that they would do it even if it added "200 dollars" per chip. He said it looks like when it finally arrives that it will add 2 or 3 dollars per chip.

Now, if this 2-3 dollars is including the price of the HBM, or just an additional integration cost on top of the price of the DRAM dice, I'm not sure. But my guess is that integrating HBM with an APU would cost AMD anywhere from $2 to a maximum of $20 per chip, which is totally reasonable for an APU.
 

Homeles

Platinum Member
Dec 9, 2011
2,580
0
0
Bryan Black started his talk by saying that Intel (where he used to work) shot down 3D stacking 10 years ago because it could add "10-15 cents per chip," but that AMD was excited enough about it that they would do it even if it added "200 dollars" per chip. He said it looks like when it finally arrives that it will add 2 or 3 dollars per chip.

Now, if this 2-3 dollars is including the price of the HBM, or just an additional integration cost on top of the price of the DRAM dice, I'm not sure. But my guess is that integrating HBM with an APU would cost AMD anywhere from $2 to a maximum of $20 per chip, which is totally reasonable for an APU.
And exactly how much would they be putting on there? There's no way they'd be able to do 4 or 8GB for $20. 2GB, maybe. But $2-3? We're talking about tiny amounts of RAM... I'd imagine performance would be rather limited in such a configuration.
 

sefsefsefsef

Senior member
Jun 21, 2007
218
1
71
And exactly how much would they be putting on there? There's no way they'd be able to do 4 or 8GB for $20. 2GB, maybe. But $2-3? We're talking about tiny amounts of RAM... I'd imagine performance would be rather limited in such a configuration.

That's a good point. Right now, a 4Gb chip of DDR3 is about $4, so getting 4GB worth of DDR3 chips would cost at least $32. This doesn't translate directly to costs in 3D packaged memories, though, and as soon as 3D memories are common I'm sure we'll be at least one DRAM node into the future by then, so prices will be lower. I wouldn't be surprised if APUs with 8GB of HBM cost $20-$30 more than their non-HBM counterparts when they debut. Eh, maybe $50 more, but 8GB is enough capacity to be the entire main memory, so you're saving cost elsewhere in the system.

One thing is for sure, though, that having 1TB/s of DRAM bandwidth will be excellent for the future of APUs.
 

unon

Junior Member
Jan 2, 2013
21
0
61
I can't recall the source but HBM will cost $20 for 1 GB initially. Even that much would be really good for an APU.
 

Headfoot

Diamond Member
Feb 28, 2008
4,444
641
126
Given that AMD also makes discrete graphics cards with high margins I'm sure we can expect stacked tech to show up there very early on into its lifecycle. Probably much sooner than APUs. It's a perfect match, since they already have to include memory on the graphics board itself and graphics applications need literally as much bandwidth as possible
 

ShintaiDK

Lifer
Apr 22, 2012
20,378
145
106
I wouldnt expect any discrete GPUs with it before 2016/2017. CPUs and APUs around 2019-2020 maybe.
 

seitur

Senior member
Jul 12, 2013
383
1
81
Bryan Black started his talk by saying that Intel (where he used to work) shot down 3D stacking 10 years ago because it could add "10-15 cents per chip," but that AMD was excited enough about it that they would do it even if it added "200 dollars" per chip. He said it looks like when it finally arrives that it will add 2 or 3 dollars per chip.

Now, if this 2-3 dollars is including the price of the HBM, or just an additional integration cost on top of the price of the DRAM dice, I'm not sure. But my guess is that integrating HBM with an APU would cost AMD anywhere from $2 to a maximum of $20 per chip, which is totally reasonable for an APU.
That 2-3 dollars is propably diffrent / better / bigger memory controler and connectors between chip and stacked memory on board and all other changes that will allow CPU/APU to use such high bandwidth and take advantage of it.

Still it cannot come soon enough. This is kind of tech that can really make a diffrence. Of course it's price for end-user will be absolutely crucial in how fast it'll be adopted. I just hope production costs and volume in comparision with 'normal' DRAM will be reasonable, so that adoption can be fast once it hit the market.
 
Last edited:

Arkadrel

Diamond Member
Oct 19, 2010
3,681
2
0
200W TDP. I don't see how to escape water cooling for that.

Knights landing is a 72 core CPU.... I think 200w TPD is resonable.

anyways thats off topic, this is a thread about HBM memory stacks, not Intel CPUs.
 

Homeles

Platinum Member
Dec 9, 2011
2,580
0
0
200W TDP. I don't see how to escape water cooling for that.
Keep in mind, graphics cards have even higher TDPs. Since this is a PCI-E card, there's no issue with air cooling here.
That's a good point. Right now, a 4Gb chip of DDR3 is about $4, so getting 4GB worth of DDR3 chips would cost at least $32. This doesn't translate directly to costs in 3D packaged memories, though, and as soon as 3D memories are common I'm sure we'll be at least one DRAM node into the future by then, so prices will be lower. I wouldn't be surprised if APUs with 8GB of HBM cost $20-$30 more than their non-HBM counterparts when they debut. Eh, maybe $50 more, but 8GB is enough capacity to be the entire main memory, so you're saving cost elsewhere in the system.

One thing is for sure, though, that having 1TB/s of DRAM bandwidth will be excellent for the future of APUs.
Yeah, it'll be a quite disruptive technology. The sooner, the better.
 

SlowSpyder

Lifer
Jan 12, 2005
17,305
1,001
126
200W TDP. I don't see how to escape water cooling for that.


I'm confident I could of used an air cooler with my FX9370 if I left the clocks and voltage alone. With that being said, I went right to water, but people do occasionally use high end air coolers with these CPU's. They are 220 watt TDP.
 

NTMBK

Lifer
Nov 14, 2011
10,269
5,134
136
Keep in mind, graphics cards have even higher TDPs. Since this is a PCI-E card, there's no issue with air cooling here.

Knight's Landing is available in a standard CPU socket, as well as on a PCIe card.
 

sm625

Diamond Member
May 6, 2011
8,172
137
106
If they make a 20nm gpu with 8 billion transistors and 8GB of 1 TB/s RAM, they better add 4 x86 cores to it. Then all they need to do is add a few usb ports and a couple sata ports and the video card becomes a complete system.
 

NTMBK

Lifer
Nov 14, 2011
10,269
5,134
136
Oh really? That's interesting.

Yeah, a rack full of nothing but Phis is going to be pretty awesome from a compute/m^3 point of view. And there is a version with the network fabric integrated onto the package. It's going to be a HPC beast.

 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |