Question AMD Laying off 4% of worldwide workforce to "focus more on AI"

Page 3 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

DrMrLordX

Lifer
Apr 27, 2000
22,184
11,889
136
It is a somewhat harder sell to OEMs due to lack of supply flexibility.
Clasically, OEMs like to use whatever crap they have in the warehouse, especially when it comes to SODIMMs etc. They always seem to have something they ordered too much of stashed in the back that they're just dying to throw into their next build for a small markup.
 

branch_suggestion

Senior member
Aug 4, 2023
414
907
96
The advantage that a big APU can be more power efficiency doesn't work in the real world, because Nvidia has a much superior architecture with significantly better perf/watt.
RDNA3.5 is alright, maybe not so much vs Blackwell but Strix Halo SoC die is N3E, that is a superior node and will help a lot, especially if they take proper advantage of FINFLEX.
 

DavidC1

Golden Member
Dec 29, 2023
1,211
1,932
96
APU BoM is lower due to unified memory.
32GB of LPDDR5X is cheaper than 24GB LPDDR5X + 8GB of GDDR6.
It is a somewhat harder sell to OEMs due to lack of supply flexibility.
Silicon cost is a wash, NV charges a lot for their mobile GPUs, good room to undercut with a big APU.
There's no way BoM is lower.
-Better thermal design because it's all one one package.
-No design re-use because you need a dedicated board. That means increased engineering costs. You have to spend time and money on engineers and resources.
-Ultra high volume versus ultra low volume. Low volume = High proportion is spent on fixed costs, meaning lower margin.
-Single large die versus two smaller ones.
-Dedicated specialized memory or multi-channel memory requiring complex layout and more copper layers versus a board and memory setup that is mass produced.

A regular iGPU avoids all the above pitfalls.
RDNA3.5 is alright, maybe not so much vs Blackwell but Strix Halo SoC die is N3E, that is a superior node and will help a lot, especially if they take proper advantage of FINFLEX.
Integrating two complex chips aren't like copy and paste on Paint. What you are saying is in theory, but reality often turns out to be much different.

@DrMrLordX
I don't know where Strix Halo could lead, but I can promise you that if they can somehow get 90-100% of a 7900XTX (for example, and I'm probably stretching things a bit here) performance out of a single APU that they can sell soldered onto a board with a lot of fast memory for a reasonable price,
What would a "reasonable price" be? Especially in desktops it makes no sense because you can't resell it.

The price will reflect the ultra-low volume. Low margin is accepted, as long as the volume is super high. Strix Halo or any other Halo iGPUs have super, super low volume.

AMD isn't going Strix Halo for no reason. They are looking to profit. Intel with Iris parts were optional upgrades that added $150-200 on top of the most pricey i7 price. So you have big APU thinking it's creme de la creme versus a dGPU competitor which is a mid range at best.
 
Last edited:

NostaSeronx

Diamond Member
Sep 18, 2011
3,743
1,250
136
Wasn't HSA part of the reason why they did the shared floating point with Bulldozer? From what I remember they hoped that most floating point operations would be moved to the GPU. Interesting to see that turned on it's head. AMD's CPUs have the biggest baddest floating point performance, and their support for GPU compute (in client GPUs at least) is bad.
HSA is not the reason why they did the shared floating point. It was quite literally an area-thing.

"Therefore, because of the significant cost considerations associated with each additional resource, it is highly desirable to add only those additional resources where the performance benefit achieved more than compensates for the increased cost. Conversely, it is desirable to share resources where the performance penalty resulting from the shared resource is more than offset by the reduction in size and cost."
It is a carry over from POWER4 -> POWER5 split; https://patents.google.com/patent/US6725354B1/
Charles R. Moore (Chief Architect of "Bulldozer && K10" in-between Andy Glew and Mike Butler)

Overall, the Bulldozer issue is primarily because the team kept getting switched.
- K10 (Low-power) 1998-2002 (chief architect left, no names were officially dropped)
- K10 (High-performance) 2002-2004 (chief architect left, Andy Glew)
- Bulldozer (Low-power) 2005-2007 (chief architect was promoted to irrelevant position, Charles R. Moore)
- Bulldozer (High-performance) 2007-2010 (chief architect was removed, Mike Butler)

Where feature overlap basically wrecked the design. Since, as far as I can tell it traded at least six different chief architects.
#1 - 1998
#2 - 2001
#3 - 2002
#4 - 2004
#5 - 2005
#6 - 2007
 

LightningZ71

Golden Member
Mar 10, 2017
1,910
2,260
136
I don't understand why anyone is talking about DESKTOP and profit in the same sentence in this thread. Desktop is dwarfed by laptops and other mobile devices right now. Narrowing down to desktops, a supermajority of those are black box OEM generic business machines with a midrange CPU with an iGPU that can barely paint a screen. The DIY section is barely a blip on anyone's radar, and precious few of those boxes ever get opened up and have a part resold.

Again, the bulk of the laptop market, where there is ANY focus of GPU performance, is in the $600-$800 range cheapest dGPU I can get in a laptop AND the $~1000 range 4060 with a high end CPU with decent screen range. You venture above that and unit sales plummet.

AMD aiming above that price point with Strix Halo would be suicide. They may have an SKU that's fully specced that's pushing $2000 with 128GB RAM and 4070 performance, but there is going to be a chunk of the market that's in the 8-12 core range that performs like a 4060 with 32GB RAM and sells for $1200 or so. The thing about Strix Halo is that it isn't anything outlandish for the OEMs. They've been selling laptops with LPDDRX modules embedded on the board for years. They've been selling boards with DGPUs with 4, 6, and 8 DDR chips embedded around them forever. This just simplifies and combined what they've been doing all along. They can still control cost by speccing cheaper dram chips or not populating channels or even limiting thermals and power.

And it'll largely be mobile or uSFF micro desktops where nothing is upgradeable already! It's a sound idea, so long as they can keep costs reasonable and drivers don't grenade the whole thing.
 

branch_suggestion

Senior member
Aug 4, 2023
414
907
96
There's no way BoM is lower.
-Better thermal design because it's all one one package.
Cooling a single package is easier than two, especially when it could be 120W vs ~150W combined. Just take a traditional SoC only cooling solution and scale it to the required wattage.
-No design re-use because you need a dedicated board. That means increased engineering costs. You have to spend time and money on engineers and resources.
Starting to talk about R&D, that is not raw BoM but overall costs, I'm talking raw BoM, and most PCB's are pretty cheap.
-Ultra high volume versus ultra low volume. Low volume = High proportion is spent on fixed costs, meaning lower margin.
Yes, and there you need MDF from the IHV for such laptop designs, that is standard practice.
-Single large die versus two smaller ones.
2 sets of memory, GDDR being more expensive than LPDDR per GB. Memory costs more than offset die yield cost deficits.
-Dedicated specialized memory or multi-channel memory requiring complex layout and more copper layers versus a board and memory setup that is mass produced.
Yes it does add a bit to fixed costs, but GDDR tracing is also expensive.
A regular iGPU avoids all the above pitfalls.
Without you know, the performance.
Integrating two complex chips aren't like copy and paste on Paint. What you are saying is in theory, but reality often turns out to be much different.
It is a SoC die and 1-2 Z5 dies with an enhanced interconnect, on an InFO substrate.
That is simpler than N31/32.
What would a "reasonable price" be? Especially in desktops it makes no sense because you can't resell it.
Mini PC guys might go for some, it is something I guess.
The price will reflect the ultra-low volume. Low margin is accepted, as long as the volume is super high. Strix Halo or any other Halo iGPUs have super, super low volume.
At the expected volumes, Strix Halo will never make ROI, no matter the price, it is a loss leader and effective prototype for a lot of Zen6 parts.
A proof of concept that will need to set a compelling narrative, to do that you need to crush the equiv Intel+NV machine by ~30% iso price or ~30% cheaper for iso perf.
Or just charge Apple prices and use semantics around edge cases, this is AMD unfortunately.
AMD isn't going Strix Halo for no reason. They are looking to profit.
In the future, will take a while for it to be amortised.
Intel with Iris parts were optional upgrades that added $150-200 on top of the most pricey i7 price.
Tech wasn't there, they were largely MDF queens in niche T&Ls.
So you have big APU thinking it's creme de la creme versus a dGPU competitor which is a mid range at best.
So? At 120W TDP and ~440mm^2 total Si you cannot challenge high end mobile dGPU parts which are nearly 400mm^2 by themselves.
The long term BoM is similar to i7+xx60/70m, that is fine, it beats both as a concept.
 

branch_suggestion

Senior member
Aug 4, 2023
414
907
96
$2000 for 128GB, yeah nah.

It WILL be higher for the 128GB SKU
Yeah, I'm hoping for $2k USD for 32GB full config.
That is with a quality screen and ample storage, would be a crushing CPU for a laptop at any price, and there is a colossal price gap between 4070m and 4080m laptops where Strix Halo fits nicely.
 

poke01

Platinum Member
Mar 8, 2022
2,581
3,409
106
Huang made an article on big iGPUs mainly about M4 pro but the same will apply to M4 Max/Strix halo

He says users can just multiple dGPUs to bypass the low VRAM. It will be more cost effective and a lot faster for LLMs.

Big iGPUs are way to save money for AMD/Apple. Simple as that. For laptops they make sense but desktops is a BIG no.

Most gamers will look for the green sticker, this will be true until AMD beats Nvidia in all areas for gaming like the current X3D cpus.
The only part of Strix halo I'm interested is the CPU part, GPU not so much. Apple already has a bigger IGPU for those LLM users with higher BW.

Gaming is a wash as its still RDNA 3.5.
 
Reactions: Tlh97

DrMrLordX

Lifer
Apr 27, 2000
22,184
11,889
136
What would a "reasonable price" be? Especially in desktops it makes no sense because you can't resell it.

Why can't you resell it? And the "reasonable" price is whatever the market will bear for the product.

How much can you get retail for a prebuilt 9800X3D with a 7900XTX in it (or a top end RDNA4 once they're out)? Extrapolate from there.

The price will reflect the ultra-low volume.

Why is the volume ultra-low? You're talking about something that could potentially wipe out tons of gamer desktop sales all on its own. OEM, DiY, etc.

AMD isn't going Strix Halo for no reason. They are looking to profit.

Yes, they are . . .

Intel with Iris parts were optional upgrades that added $150-200 on top of the most pricey i7 price.

Iris parts were a joke compared to even the best mobile dGPUs of the day.

So you have big APU thinking it's creme de la creme versus a dGPU competitor which is a mid range at best.

See above, Iris never even competed with midrange dGPUs of its day.

Reality states that we'll probably never see such a product. As @poke01 has alluded, AMD is going after AI, and Strix Halo may be more aimed at LLM users than gamers (sadly).
 
Reactions: Tlh97

Meteor Late

Member
Dec 15, 2023
116
98
61
I don't understand why anyone is talking about DESKTOP and profit in the same sentence in this thread. Desktop is dwarfed by laptops and other mobile devices right now. Narrowing down to desktops, a supermajority of those are black box OEM generic business machines with a midrange CPU with an iGPU that can barely paint a screen. The DIY section is barely a blip on anyone's radar, and precious few of those boxes ever get opened up and have a part resold.

Again, the bulk of the laptop market, where there is ANY focus of GPU performance, is in the $600-$800 range cheapest dGPU I can get in a laptop AND the $~1000 range 4060 with a high end CPU with decent screen range. You venture above that and unit sales plummet.

AMD aiming above that price point with Strix Halo would be suicide. They may have an SKU that's fully specced that's pushing $2000 with 128GB RAM and 4070 performance, but there is going to be a chunk of the market that's in the 8-12 core range that performs like a 4060 with 32GB RAM and sells for $1200 or so. The thing about Strix Halo is that it isn't anything outlandish for the OEMs. They've been selling laptops with LPDDRX modules embedded on the board for years. They've been selling boards with DGPUs with 4, 6, and 8 DDR chips embedded around them forever. This just simplifies and combined what they've been doing all along. They can still control cost by speccing cheaper dram chips or not populating channels or even limiting thermals and power.

And it'll largely be mobile or uSFF micro desktops where nothing is upgradeable already! It's a sound idea, so long as they can keep costs reasonable and drivers don't grenade the whole thing.

Heck, the laptops with Strix Point (HX 370 at least) are selling for more than that 1000$ range you mention, how the heck could they suddenly sell Strix Halo for the same or less than that?
 

Meteor Late

Member
Dec 15, 2023
116
98
61
We still don't know if AMD has tackled the chiplet and I/O die idle power consumption issue with Strix Halo btw, because if they haven't improved enough on that, it will be a poor product IMO.
 

moinmoin

Diamond Member
Jun 1, 2017
5,145
8,226
136
Apple gets away with it, somehow.
The challenge is quite tricky here. Apple is seen as a vertically integrated provider where the claim that they choose only the best possible ingredients is believable. That approach is boosted by not even allowing any alternatives.

Same is not true with most other manufacturers that are not vertically integrated and as such supply chain dictates much more of the final composition than the quality of individual components. So in such an environment specialized optimized parts like Strix Halo have a harder time getting into products.

That said Strix Halo may well see some X3D style hype on the back of its improved memory layout that unlocks more of Zen 5's performance. The question with that is how AMD would follow up such a product since it exploits a weakness of the base Zen 5 client configuration. Once that's fixed with a better cIOD in Zen 6 a straight Strix Halo successor will no longer be a standout.
 

turtile

Senior member
Aug 19, 2014
626
302
136
I highly doubt AMD will sell all of these chips at a loss. When you consider the space the NPU takes up in the design, the extra space from the extra CUs isn't much. OEMs want cheap and there is no way this costs more for OEMs to stick in their systems than a dGPU.

Why does it need a dedicated board? Doesn't this have a new FP11 socket?
 

GTracing

Member
Aug 6, 2021
168
396
106
HSA is not the reason why they did the shared floating point. It was quite literally an area-thing.

I didn't say it was the main reason, just part of the reason. And going back, AMD definitely advertised HSA as a way to boost performance in compute heavy tasks.

AMD went for the heterogeneous system architecture early on to exploit the fact that many compute intensive tasks can be offloaded to parts of the CPU that are designed to run them faster or at low power. By combining CPU and GPU on a single die, the system should be able to shift work around to complete the process quicker.
One such example that AMD are willing to share today is stock calculation using LibreOffice's Calc application – calculating the BETA (return) of 21 fake stocks and plotting 100 points on a graph of each stock. With HSA acceleration on, the system performed the task in 0.12 seconds, compared to 0.99 seconds when turned off.
 

LightningZ71

Golden Member
Mar 10, 2017
1,910
2,260
136
Heck, the laptops with Strix Point (HX 370 at least) are selling for more than that 1000$ range you mention, how the heck could they suddenly sell Strix Halo for the same or less than that?
The laptops with Strix Point that are selling for notably more than that all have dGPUs. Strix Halo parts won't.
 

LightningZ71

Golden Member
Mar 10, 2017
1,910
2,260
136
I highly doubt AMD will sell all of these chips at a loss. When you consider the space the NPU takes up in the design, the extra space from the extra CUs isn't much. OEMs want cheap and there is no way this costs more for OEMs to stick in their systems than a dGPU.

Why does it need a dedicated board? Doesn't this have a new FP11 socket?
It has dedicated boards because no current boards are designed for 256 bits of DRAM connecting to the CPU. This is a new layout.
 

Meteor Late

Member
Dec 15, 2023
116
98
61
The laptops with Strix Point that are selling for notably more than that all have dGPUs. Strix Halo parts won't.

Well it's AMDs fault then, I checked on Amazon and Newegg and there are zero laptops with HX 370 below 1500$. Most of them have dGPU but even ones with a measly 4050 were going for more than 1700$.
I mean, what's the point in creating an APU with the most CU (890M) but still worse than an entry level 4050 if all the laptops using them are going to be so expensive? makes zero sense to me.
 

jpiniero

Lifer
Oct 1, 2010
15,365
5,884
136
Well it's AMDs fault then, I checked on Amazon and Newegg and there are zero laptops with HX 370 below 1500$. Most of them have dGPU but even ones with a measly 4050 were going for more than 1700$.
I mean, what's the point in creating an APU with the most CU (890M) but still worse than an entry level 4050 if all the laptops using them are going to be so expensive? makes zero sense to me.

AI AI AI
 

ryanjagtap

Member
Sep 25, 2021
134
158
96
Well it's AMDs fault then, I checked on Amazon and Newegg and there are zero laptops with HX 370 below 1500$. Most of them have dGPU but even ones with a measly 4050 were going for more than 1700$.
I mean, what's the point in creating an APU with the most CU (890M) but still worse than an entry level 4050 if all the laptops using them are going to be so expensive? makes zero sense to me.
AMD makes the SoC, it can't dictate what design the OEMs put it in... Seems that blaming the OEMs for stupid design choices would be a better option. Still, would have loved to see some SKUs without dGPUs like the Asus Zenbook S16/S14. (But with sane pricing)
 

NostaSeronx

Diamond Member
Sep 18, 2011
3,743
1,250
136
I didn't say it was the main reason, just part of the reason. And going back, AMD definitely advertised HSA as a way to boost performance in compute heavy tasks.
HSA is not part of the reasons for the shared FPU. The architectural choice for the shared FPU was done before Fusion/HSA was born.
 

DrMrLordX

Lifer
Apr 27, 2000
22,184
11,889
136
The challenge is quite tricky here. Apple is seen as a vertically integrated provider where the claim that they choose only the best possible ingredients is believable. That approach is boosted by not even allowing any alternatives.

True, which I did (somewhat) address above. The issue is that M4 seems to have a pretty beefy iGPU that would (theoretically) beat a lot of mdGPU competition if Apple allowed it. Or to put it another way, if Apple opened up the M4 and let Linux run on it, how many existing dGPU/mdGPU solutions could beat it on a level playing field?

Keeping all that in mind, how strong will the iGPU on Strix Halo be?

Same is not true with most other manufacturers that are not vertically integrated and as such supply chain dictates much more of the final composition than the quality of individual components. So in such an environment specialized optimized parts like Strix Halo have a harder time getting into products.

If Steam Deck has taught us anything, it's that a sufficiently-good hardware config that meets a lot of people's needs will sell well-enough to justify its existence. And Valve didn't need to offer up a board/kit to be manufactured by a number of different OEMs. They went with a single OEM in what is basically one configuration (with different storage options) and made bank on it.

Now imagine what AMD could do with a next-gen Strix Halo (Medusa Halo?). Next imagine AMD firing the people that could have worked on that project . . .

That said Strix Halo may well see some X3D style hype on the back of its improved memory layout that unlocks more of Zen 5's performance. The question with that is how AMD would follow up such a product since it exploits a weakness of the base Zen 5 client configuration. Once that's fixed with a better cIOD in Zen 6 a straight Strix Halo successor will no longer be a standout.
Zen6 client will abandon CCDs + IODs if what we're being told is true. It'll be APUs for client desktop and mobile. Not sure what will happen to the Range product line though.
 

Meteor Late

Member
Dec 15, 2023
116
98
61
AMD makes the SoC, it can't dictate what design the OEMs put it in... Seems that blaming the OEMs for stupid design choices would be a better option. Still, would have loved to see some SKUs without dGPUs like the Asus Zenbook S16/S14. (But with sane pricing)

Meh, when it's absolutely all of them, and the cheapest Mini PC with this chip costs 1000$, then it's evident AMD is pricing this thing way too high.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |