Discussion Zen 5 Speculation (EPYC Turin and Strix Point/Granite Ridge - Ryzen 9000)

Page 467 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,736
14,767
136
there are many Intel specific optimisations that is slowly eroding. Cinebnch r23 was highly optimised for Intel CPUs and even for AMD it wasn’t fair. Let alone other CPU architectures.

With more companies wanting a fairer benchmark is I guess why Cinebench 2024 was created. It probably had input from AMD, Qualcomm and Apple.

Long gone are the days of total Intel domination in client.
NO, this has to do with the "factory overclocking causing instability" that caused Intel to release a new bios setup that is stable, but also slightly slower.
 
Reactions: spursindonesia

poke01

Golden Member
Mar 8, 2022
1,347
1,530
106
NO, this has to do with the "factory overclocking causing instability" that caused Intel to release a new bios setup that is stable, but also slightly slower.
Mm. Then I misunderstood.

This also makes it easier for Intel as well. When Arrow Lake launches they will compare with the stable clock bios.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,736
14,767
136
Mm. Then I misunderstood.

This also makes it easier for Intel as well. When Arrow Lake launches they will compare with the stable clock bios.
Well, from what I have read, its still not totally stable, but better. In that thread its agreed that Intel "factory overclocked" the CPUs to win benchmarks and claim at least some 1st places. I disagree with that policy and what it caused , and I hope Intel has learned its lesson. Zen 5 should shut the door on them for a few months at least. I think its is not agreed what the next generations will do, but it seems that Zen 5 will be king in ALL areas for a while.

Enough about Intel, I was only clarifying that benchmarks between the two should be using what is NOW stock, not the old version.
 

blackangus

Member
Aug 5, 2022
115
161
76
NO, this has to do with the "factory overclocking causing instability" that caused Intel to release a new bios setup that is stable, but also slightly slower.
I think this has been happening for a long time. My buddy has an 11700k and it was unstable even with the big ass Dark Rock. The default settings in the Asus bios were essentially letting it take as much power as needed. Once I figured that out and set it to intels specs it worked as it should w/o issue.

Anyway, this wait is killing me. I haven't built a new computer in years and Zen5 will be it for me, so here is hoping for the best because if its a blunder and it sucks Ill be an unhappy camper!
I only wish there was a high end RDNA 4 this year, my 3070 TI isn't really cutting it with a 4k monitor, so I need to figure out what I am going to do 700$ for a 7900XT so late in its life seems like a bad deal and I really didnt want another Nvidia as the 3070ti has been kind of quirky with 3 monitors hooked up.

Anyone know if Zen 5 will be benefiting much from faster memory but not running 1:1? I have only read a little but it seems like there are diminishing returns when not running 1:1.
 

Gideon

Golden Member
Nov 27, 2007
1,709
3,920
136
Anyone know if Zen 5 will be benefiting much from faster memory but not running 1:1? I have only read a little but it seems like there are diminishing returns when not running 1:1.
The rumors are that the IO die is unchanged from Zen 4. If That's the case running above 1:1 is essentially useless, as bandwidth will be limited by fabric clock and latency will be worse.
 
Jul 27, 2020
17,746
11,536
106

Vattila

Senior member
Oct 22, 2004
805
1,394
136
First EPYC "Turin" ("Zen 5") supercomputer win:

"The procurement competition to secure Norway's next supercomputer has now been conducted. Hewlett-Packard Norge AS (HPE) won the competition and has consequently been awarded the contract, which has a value of 225 million NOK [USD ~20M]. This will be Norway's most powerful supercomputer ever and will give a significant boost to national AI research and innovation."

"HPE will deliver an HPE Cray Supercomputing EX system equipped with 252 nodes, each with two AMD EPYC Turin CPUs. Each of these consists of 128 cores. In total, the system will consist of 64,512 CPU cores. In addition, the system will be delivered with 76 GPU nodes, each comprising of 4 NVIDIA GraceHopper Superchips (NVIDIA GH200 96 GB) in total, 304 GPUs."


sigma2.no

I have been awaiting this announcement with bated breath to see whether Norway's experience with the part-owned AMD-based LUMI supercomputer in Finland would lead them to select a configuration based on AMD GPUs and in particular the Instinct MI300A APU with unified memory (for simpler programmability). Alas, they instead went for a traditional CPU configuration for the majority of the nodes, while selecting Nvidia for the accelerated nodes, presumably due to reported software porting friction sited in their annual report:

"The two major providers of GPUs are AMD and NVIDIA, with NVIDIA being the largest and offering a more comprehensive development environment and software suite. By the end of 2023, supercomputer Betzy had 16 NVIDIA A100/40GB, and Saga had 32 NVIDIA A100/80GB and 32 NVIDIA P100. The largest proportion of our GPUs are on LUMI (10240 AMD MI250X). However, some users encounter difficulties using LUMI's AMD GPUs. This is primarily because code written for NVIDIA doesn't always run automatically or, in some cases, not at all without modifications."

sigma2.no

While perhaps inconsequential, I find this disappointing. It indicates that the programmability benefits of having unified memory in AMD's Instinct MI300A APU solution are not (yet) persuasive for supercomputing. Instead, Sigma2 has selected separate partitions for traditional and accelerated workloads, respectively, while going with Nvidia for the accelerated partition, seemingly due to software ecosystem preference. I hoped they would see the proprietary ecosystem as a problem, with a positive and promising porting experience from working with LUMI. Sadly not.

Notably, the Nvidia GH200 GPUs with 96 GB HBM also have much less memory than AMD's MI300X's 192 GB HBM. But this didn't sway them either.

PS. To bring this back on topic: Will AMD continue the server APU concept with "Zen 5" in the Instinct product line? Or will it be de-emphasised going forward, in favour of AI-optimised products (such as MI300X)?
 
Last edited:

Saylick

Diamond Member
Sep 10, 2012
3,372
7,107
136
First EPYC "Turin" ("Zen 5") supercomputer win:

"The procurement competition to secure Norway's next supercomputer has now been conducted. Hewlett-Packard Norge AS (HPE) won the competition and has consequently been awarded the contract, which has a value of 225 million NOK [USD ~20M]. This will be Norway's most powerful supercomputer ever and will give a significant boost to national AI research and innovation."

"HPE will deliver an HPE Cray Supercomputing EX system equipped with 252 nodes, each with two AMD EPYC Turin CPUs. Each of these consists of 128 cores. In total, the system will consist of 64,512 CPU cores. In addition, the system will be delivered with 76 GPU nodes, each comprising of 4 NVIDIA GraceHopper Superchips (NVIDIA GH200 96 GB) in total, 304 GPUs."


sigma2.no

I have been awaiting this announcement with bated breath to see whether Norway's experience with the part-owned AMD-based LUMI supercomputer in Finland would lead them to select a configuration based on AMD GPUs and in particular the Instinct MI300A APU with unified memory (for simpler programmability). Alas, they instead went for a traditional CPU configuration for the majority of the nodes, while selecting Nvidia for the accelerated nodes, presumably due to reported software porting friction sited in their annual report:

"The two major providers of GPUs are AMD and NVIDIA, with NVIDIA being the largest and offering a more comprehensive development environment and software suite. By the end of 2023, supercomputer Betzy had 16 NVIDIA A100/40GB, and Saga had 32 NVIDIA A100/80GB and 32 NVIDIA P100). The largest proportion of our GPUs are on LUMI (240 AMD MX250X). However, some users encounter difficulties using LUMI's AMD GPUs. This is primarily because code written for NVIDIA doesn't always run automatically or, in some cases, not at all without modifications."

sigma2.no.

While perhaps inconsequential, I find this disappointing. It indicates that the programmability benefits of having unified memory in AMD's Instinct MI300A APU solution are not (yet) persuasive for supercomputing. Instead, Sigma2 has selected separate partitions for traditional and accelerated workloads, respectively, while going with Nvidia for the accelerated partition, seemingly due to software ecosystem preference. I hoped they would see the proprietary ecosystem as a problem, with a positive and promising porting experience from working with LUMI. Sadly not. Notably, the Nvidia GH200 GPUs with 96 GB HBM also have much less memory than AMD's MI300X's 192 GB HBM. But this didn't sway them either.
I interpreted that as researchers primarily writing GPU code in CUDA to begin with, which has its challenges when porting to AMD GPUs (duh). Rather than learning to write non-CUDA code and porting it to AMD GPUs a la MI300A, they chose Nvidia GPUs this round to avoid that hassle. It speaks more about ROCm being not good enough outweighing the benefits of unified memory in MI300A. FWIW, Grace Hopper has Unified Memory too so it sort of nullifies MI300A's advantage.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,736
14,767
136
First EPYC "Turin" ("Zen 5") supercomputer win:

"The procurement competition to secure Norway's next supercomputer has now been conducted. Hewlett-Packard Norge AS (HPE) won the competition and has consequently been awarded the contract, which has a value of 225 million NOK [USD ~20M]. This will be Norway's most powerful supercomputer ever and will give a significant boost to national AI research and innovation."

"HPE will deliver an HPE Cray Supercomputing EX system equipped with 252 nodes, each with two AMD EPYC Turin CPUs. Each of these consists of 128 cores. In total, the system will consist of 64,512 CPU cores. In addition, the system will be delivered with 76 GPU nodes, each comprising of 4 NVIDIA GraceHopper Superchips (NVIDIA GH200 96 GB) in total, 304 GPUs."


sigma2.no

I have been awaiting this announcement with bated breath to see whether Norway's experience with the part-owned AMD-based LUMI supercomputer in Finland would lead them to select a configuration based on AMD GPUs and in particular the Instinct MI300A APU with unified memory (for simpler programmability). Alas, they instead went for a traditional CPU configuration for the majority of the nodes, while selecting Nvidia for the accelerated nodes, presumably due to reported software porting friction sited in their annual report:

"The two major providers of GPUs are AMD and NVIDIA, with NVIDIA being the largest and offering a more comprehensive development environment and software suite. By the end of 2023, supercomputer Betzy had 16 NVIDIA A100/40GB, and Saga had 32 NVIDIA A100/80GB and 32 NVIDIA P100). The largest proportion of our GPUs are on LUMI (240 AMD MX250X). However, some users encounter difficulties using LUMI's AMD GPUs. This is primarily because code written for NVIDIA doesn't always run automatically or, in some cases, not at all without modifications."

sigma2.no.

While perhaps inconsequential, I find this disappointing. It indicates that the programmability benefits of having unified memory in AMD's Instinct MI300A APU solution are not (yet) persuasive for supercomputing. Instead, Sigma2 has selected separate partitions for traditional and accelerated workloads, respectively, while going with Nvidia for the accelerated partition, seemingly due to software ecosystem preference. I hoped they would see the proprietary ecosystem as a problem, with a positive and promising porting experience from working with LUMI. Sadly not. Notably, the Nvidia GH200 GPUs with 96 GB HBM also have much less memory than AMD's MI300X's 192 GB HBM. But this didn't sway them either.
I am going to guess that they want full CPU speed, so these 128 core Turin may be the equivalent of todays 9554 Genoa. What do you think ???
 
Reactions: Vattila

Thunder 57

Platinum Member
Aug 19, 2007
2,794
4,075
136
First EPYC "Turin" ("Zen 5") supercomputer win:

"The procurement competition to secure Norway's next supercomputer has now been conducted. Hewlett-Packard Norge AS (HPE) won the competition and has consequently been awarded the contract, which has a value of 225 million NOK [USD ~20M]. This will be Norway's most powerful supercomputer ever and will give a significant boost to national AI research and innovation."

"HPE will deliver an HPE Cray Supercomputing EX system equipped with 252 nodes, each with two AMD EPYC Turin CPUs. Each of these consists of 128 cores. In total, the system will consist of 64,512 CPU cores. In addition, the system will be delivered with 76 GPU nodes, each comprising of 4 NVIDIA GraceHopper Superchips (NVIDIA GH200 96 GB) in total, 304 GPUs."


sigma2.no

I have been awaiting this announcement with bated breath to see whether Norway's experience with the part-owned AMD-based LUMI supercomputer in Finland would lead them to select a configuration based on AMD GPUs and in particular the Instinct MI300A APU with unified memory (for simpler programmability). Alas, they instead went for a traditional CPU configuration for the majority of the nodes, while selecting Nvidia for the accelerated nodes, presumably due to reported software porting friction sited in their annual report:

"The two major providers of GPUs are AMD and NVIDIA, with NVIDIA being the largest and offering a more comprehensive development environment and software suite. By the end of 2023, supercomputer Betzy had 16 NVIDIA A100/40GB, and Saga had 32 NVIDIA A100/80GB and 32 NVIDIA P100). The largest proportion of our GPUs are on LUMI (240 AMD MX250X). However, some users encounter difficulties using LUMI's AMD GPUs. This is primarily because code written for NVIDIA doesn't always run automatically or, in some cases, not at all without modifications."

sigma2.no.

While perhaps inconsequential, I find this disappointing. It indicates that the programmability benefits of having unified memory in AMD's Instinct MI300A APU solution are not (yet) persuasive for supercomputing. Instead, Sigma2 has selected separate partitions for traditional and accelerated workloads, respectively, while going with Nvidia for the accelerated partition, seemingly due to software ecosystem preference. I hoped they would see the proprietary ecosystem as a problem, with a positive and promising porting experience from working with LUMI. Sadly not. Notably, the Nvidia GH200 GPUs with 96 GB HBM also have much less memory than AMD's MI300X's 192 GB HBM. But this didn't sway them either.

Imagine the heat the could've used if they went with Intel, enough to heat a small town perhaps? Of course than said town might also expirence brownouts, so, there's that.
 

adroc_thurston

Diamond Member
Jul 2, 2023
3,299
4,732
96
Maybe AMD should start working with kids aged 8+ to make ROCm much easier to work with. Then they can just tell the scientists, look if these kids can do it, there's no reason you can't!
The rule of thumb is that small deployments will stick with NV to avoid s/w porting costs while larger ones will be AMD just fine.
It's no a ROCm issue, just market inertia one.
 

FlameTail

Diamond Member
Dec 15, 2021
3,125
1,788
106
No, Jedi vs Sith is better.

In all honesty, there is a serious need for high quality CPU memes. There's a lot to cover, because now it's not just AMD and Intel, but also Apple and Qualcomm in the game. And more (Nvidia, Mediatek, Samsung, etc..) are set to join the game soon.

I can imagine such a channel having millions of subscribers, adored by both the PCMR crowd and the ARM crowd.

I'd do it if I could, but I have neither the time nor the skill.
 
Reactions: lightmanek

Mahboi

Senior member
Apr 4, 2024
741
1,316
96
The rule of thumb is that small deployments will stick with NV to avoid s/w porting costs while larger ones will be AMD just fine.
It's no a ROCm issue, just market inertia one.
Lol, how charitable again.
It obviously IS a ROCm issue.
But yeah midsize clients just don't have the resources to port years of CUDA code to ROCm. HIPify apparently not being enough (unsurprisingly). It'll be hyperscalers for now.
 

adroc_thurston

Diamond Member
Jul 2, 2023
3,299
4,732
96
It obviously IS a ROCm issue.
no.
But yeah midsize clients just don't have the resources to port years of CUDA code to ROCm
It's not really years, most HPC installations don't have accelerator code to begin with.
The guys in question just commited to CUDA with A100 and have no reason to switch at their size.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |