Discussion Zen 5 Speculation (EPYC Turin and Strix Point/Granite Ridge - Ryzen 9000)

Page 93 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,758
14,785
136
Funny you say that, I have an intern this summer who will be doing some benchmarking for me on these servers just to understand where we currently stand. One of the parameters we wanted to study was, as you mentioned, the impact of storage speed on the analysis runtime. The IT Department doesn't believe that the VMs introduce a slow-down so this is one way to verify that...
One more thing. Is this a memory intensive app ? We just had an app in the DC community that was very memory intensive. While I can't prove that the Genoa's 12 channel ddr5 4800 was the reason, it absolutely kicked butt in this app. Without benchmarks on this app, I can't say what difference it will make, but just saying 12 channels of DDR5 4800 is a LOT of bandwidth.
 

Saylick

Diamond Member
Sep 10, 2012
3,391
7,156
136
One more thing. Is this a memory intensive app ? We just had an app in the DC community that was very memory intensive. While I can't prove that the Genoa's 12 channel ddr5 4800 was the reason, it absolutely kicked butt in this app. Without benchmarks on this app, I can't say what difference it will make, but just saying 12 channels of DDR5 4800 is a LOT of bandwidth.
I don't suspect it is. The software itself doesn't use a lot of RAM. If I were to spec out a Genoa SKU, I'd probably do a pair of sticks for every CCD on the SKU, e.g. if it's 8 CCDs then I'd have them install 16 sticks. The goal would be a full dual channels per 8 cores, like how it would be on desktop. RAM sticks are also ungodly expensive, especially when I know I don't need the capacity. I'd like to avoid paying for more RAM than I need but at the same time not skimp on the number of memory channels.
 
Jul 27, 2020
18,021
11,750
116
The IT Department doesn't believe that the VMs introduce a slow-down so this is one way to verify that...
Coz they don't know what a context switch is. Writing to physical storage requires a system call which involves moving from user mode into the privileged kernel mode. This can only happen with a context switch which is expensive. I measured a performance hit of more than 40% in 4K random writing on the 980 Pro inside a VM. The more your application depends on writing, the more it will suffer. If it buffers the writes into faster RAM and writes at once, it might fare better. But if it is continuously doing 4K writes as it runs, it will fare miserably.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,758
14,785
136
I don't suspect it is. The software itself doesn't use a lot of RAM. If I were to spec out a Genoa SKU, I'd probably do a pair of sticks for every CCD on the SKU, e.g. if it's 8 CCDs then I'd have them install 16 sticks. The goal would be a full dual channels per 8 cores, like how it would be on desktop. RAM sticks are also ungodly expensive, especially when I know I don't need the capacity. I'd like to avoid paying for more RAM than I need but at the same time not skimp on the number of memory channels.
I pay between $72 and $76 per 16 gig dim. I pay about $924 for 192 gig DDR5 4800 registered. Not bad if you ask me. And this is supermicro certified for Genoa, micron usually.

Edit: after reading about VMs and switching, ram could be the problem. Just something to think about.
 

Saylick

Diamond Member
Sep 10, 2012
3,391
7,156
136
I pay between $72 and $76 per 16 gig dim. I pay about $924 for 192 gig DDR5 4800 registered. Not bad if you ask me. And this is supermicro certified for Genoa, micron usually.
Gah dang. Dell is overcharging us out the wazoo then. I could've sworn I saw something like a few hundred for a 32 GB stick on their system configurator.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,758
14,785
136
Gah dang. Dell is overcharging us out the wazoo then. I could've sworn I saw something like a few hundred for a 32 GB stick on their system configurator.
Proof:

And this is DDR5, NOT DDR4 and that makes a big difference

32 gig dimms $122


If an IT manager had a brain, he would buy from smaller companies. Supermicro sells blades fully configured, and they charge way less than Dell.
 
Last edited:

Saylick

Diamond Member
Sep 10, 2012
3,391
7,156
136
Proof:

And this is DDR5, NOT DDR4 and that makes a big difference

32 gig dimms $122


If an IT manager had a brain, he would buy from smaller companies. Supermicro sells blades fully configured, and they charge way less than Dell.
This is what I see on Dell's website... Gotta love those prices...
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,758
14,785
136
My point exactly. Now rant..... I have like 10 servers (all EPYC) with server grade hardware, all purchased from newegg, supermicro, Amazon, or ebay (cpus on ebay). I have like 1/10th the money invested in them that Dell and the like charge. I have like 100% uptime with a 24/7/365 load. My only downtimes are the local power company, and that is not very often. The only place I really save than companies would not do is SOME of my CPUs are not retails, but QS, and a couple of ES. That added price would only be a couple thousand more per CPU. It does not justify the prices that Dell and the like are charging.

An IT manager with a brain could get supermicro blades fully configured with all the goodies for far less than Dell. And since (at least I know) that the hardware is almost foolproof, the extra money is insane. You could buy insurance for less than they charge.
 

A///

Diamond Member
Feb 24, 2017
4,352
3,155
136
My point exactly. Now rant..... I have like 10 servers (all EPYC) with server grade hardware, all purchased from newegg, supermicro, Amazon, or ebay (cpus on ebay). I have like 1/10th the money invested in them that Dell and the like charge. I have like 100% uptime with a 24/7/365 load. My only downtimes are the local power company, and that is not very often. The only place I really save than companies would not do is SOME of my CPUs are not retails, but QS, and a couple of ES. That added price would only be a couple thousand more per CPU. It does not justify the prices that Dell and the like are charging.
Dell charges for their enclosure design, gotta recoup that bs r n d money, but also their multi tier support you get in touch with when sh** hits the fan. Ya got your email and phone tiers 1 and 2 depending on how they classify em now and then the highest tier when they'll have some weasel drive out to replace a part or if you're some big shot company they'll fly out the parts same day. I don't think at any company I've ever been with has our it director or head known who the personal managers were assigned to our accounts. Current place of work has a contracts total of about 90m split between dell and hpe and we're treated like loiterers at a walmart coffee shop in toledo.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,758
14,785
136
Dell charges for their enclosure design, gotta recoup that bs r n d money, but also their multi tier support you get in touch with when sh** hits the fan. Ya got your email and phone tiers 1 and 2 depending on how they classify em now and then the highest tier when they'll have some weasel drive out to replace a part or if you're some big shot company they'll fly out the parts same day. I don't think at any company I've ever been with has our it director or head known who the personal managers were assigned to our accounts. Current place of work has a contracts total of about 90m split between dell and hpe and we're treated like loiterers at a walmart coffee shop in toledo.
My last point..... INSURANCE, I bet you can buy that way cheaper than Dell support. How else is it that they make so much money >???? And my point on reliability.... When the hardware is server grade, and like never fails, You don't need much money to recover, as it VIRTUALLY NEVER happens ! And I am speaking about enterprise uptime !
 
Reactions: A///

A///

Diamond Member
Feb 24, 2017
4,352
3,155
136
My last point..... INSURANCE, I bet you can buy that way cheaper than Dell support. How else is it that they make so much money >???? And my point on reliability.... When the hardware is server grade, and like never fails, You don't need much money to recover, as it VIRTUALLY NEVER happens ! And I am speaking about enterprise uptime !
yep, not my company and isn't my responsibility. as you said and I've said to saylick or someone else here, epyc is going to be tested more thoroughly by amd than threadripper or ryzen would be, even their pro lines. server grade stuff is way different than consumer or prosumer or "low end" business sumer. it's expensive for a reason. odm pricing is their pricing on top of oem part pricing which is heavily discounted for the odms by amd or intel. dc's that need to qualify hardware do it for their own reasoning whatever that reasoning may be. that's all I'll say on the matter for now.
 
Reactions: Tlh97
Jul 27, 2020
18,021
11,750
116
A lot of these IT people are wannabes. They think they know about IT but what they really excel at is spouting a bunch of bull in the most convincing manner to someone who has no clue, which is what most higher-ups are like. I had this cloud "consultant" warn me that changing the VM CPU type from Cascade Lake to Ice Lake in Azure isn't recommended coz we hadn't tested it. In what world does a simple CPU change lead to issues? I went against his advice and pushed for the change and of course, nothing happened. That's the whole point of being in the cloud. Flexibility. I don't know if being abundantly cautious is an act of his or not but it sure makes non-techies dealing with him think that servers are very complicated things where any misstep can lead to a disaster and of course, he's there to help get them through anything.
 

soresu

Platinum Member
Dec 19, 2014
2,970
2,201
136
I would say earthquake monitoring and analysis is of greater importance in the immediate time frame over things millions of light years away.
I'd warrant that celestial mechanics of possible Earth impact objects is plenty important 😅

NASA's remit covers plenty of material that is of immediate and long term interest to the rest of us, including EV aircraft among other things.
 

A///

Diamond Member
Feb 24, 2017
4,352
3,155
136
I'd warrant that celestial mechanics of possible Earth impact objects is plenty important 😅

NASA's remit covers plenty of material that is of immediate and long term interest to the rest of us, including EV aircraft among other things.
one moment you're here and the next you're nothing or a few hours or days later depending on the impact. live each day as if it were you last, especially once you hit 50.
 

JustViewing

Member
Aug 17, 2022
163
276
96
A lot of these IT people are wannabes. They think they know about IT but what they really excel at is spouting a bunch of bull in the most convincing manner to someone who has no clue, which is what most higher-ups are like. I had this cloud "consultant" warn me that changing the VM CPU type from Cascade Lake to Ice Lake in Azure isn't recommended coz we hadn't tested it. In what world does a simple CPU change lead to issues? I went against his advice and pushed for the change and of course, nothing happened. That's the whole point of being in the cloud. Flexibility. I don't know if being abundantly cautious is an act of his or not but it sure makes non-techies dealing with him think that servers are very complicated things where any misstep can lead to a disaster and of course, he's there to help get them through anything.
I think the main problem with IT Managers is Liability if custom build hardware fails. Most of them can suggest and build custom servers easily. But in the event of a failure (the reasons really doesn't matter whether it is due to the custom build or not), they would get the blame for custom build. Therefore, why should they risk that type of scenarios when the money spent on the hardware is not their own? Same reasons for not switching Intel Systems to AMD Systems.
 

A///

Diamond Member
Feb 24, 2017
4,352
3,155
136
tbh igor makes a point but even I'd recommend any company to qualify a system before making a cpu change. Usually you do it in the run up to deciding to change not change it out of the blue. ice lake did have problems on some linux distros from what i remember. cascade lake had some dubious microcode at one time pushed by intall that caused some problems for some people. any down time is lost revenue.even microsoft admitted most instances under azure is linux. makes sense tbh.

why do any of us do testing after a simple in place cpu swap in the same pinout and family or a new build before we start mucking with the bios settings? no need to answer this rhetorical. dangle a bunch or two of bananas and he'll be a happy man. altho i wish igor would upgrade his personal taste to banana walnut bread like civilised people. nothing beats a warm load of banana walnut bread. was making 2-3 loaves a week during covid. thank the heavens for stretchy trousers.
 

BorisTheBlade82

Senior member
May 1, 2020
667
1,022
136
I think the main problem with IT Managers is Liability if custom build hardware fails. Most of them can suggest and build custom servers easily. But in the event of a failure (the reasons really doesn't matter whether it is due to the custom build or not), they would get the blame for custom build. Therefore, why should they risk that type of scenarios when the money spent on the hardware is not their own? Same reasons for not switching Intel Systems to AMD Systems.
Exactly!
"No one ever got fired for buying IBM" they used to say 😄
 
Jul 27, 2020
18,021
11,750
116
tbh igor makes a point but even I'd recommend any company to qualify a system before making a cpu change. Usually you do it in the run up to deciding to change not change it out of the blue. ice lake did have problems on some linux distros from what i remember.
We use Windows Server. I don't know anyone in my circle who uses Linux. Pity, I know. You need to be highly proficient in debugging stuff if you intend to use Linux for production. I'm not even going to ever try using it coz I'm not paid enough to let my company enjoy saving the cost of Windows licenses
 
Jul 27, 2020
18,021
11,750
116
dangle a bunch or two of bananas and he'll be a happy man. altho i wish igor would upgrade his personal taste to banana walnut bread like civilised people. nothing beats a warm load of banana walnut bread. was making 2-3 loaves a week during covid. thank the heavens for stretchy trousers.
I'm not obsessed with bananas though I AM drinking banana flavored milk on some days. I'm scared of eating a banana thanks to the organ damage I sustained from my bout with diabetes. Anything that will raise my blood sugar quickly is a complete no no for me. I usually get obsessed with stuff for a while and it usually ends badly. In my twenties, there was one week where I ate only homemade fries and drank banana milkshake (liters of it!) and tea. It stopped when I felt a really sharp pain in my back like someone stabbed me with an electric bolt. Ultrasound revealed my kidneys were full of gravel. Drank 3 liters of water every day for almost a month to flush them out. No more banana milkshake for me!
 
Reactions: Tlh97 and Saylick

yuri69

Senior member
Jul 16, 2013
440
723
136
We use Windows Server. I don't know anyone in my circle who uses Linux. Pity, I know. You need to be highly proficient in debugging stuff if you intend to use Linux for production.
Interesting. I can't imagine running anything on Windows. Automation/server orchestation (odd configs, odd installation packages, ), almost no support for service management (systemd-like dependencies), horrible scripting experience, network management, antivirus, updates applied randomly, etc. Besides the container solutions are far from smooth last time I checked.

Btw the whole cloud runs on Linux *in production*.
 
sale-70-410-exam    | Exam-200-125-pdf    | we-sale-70-410-exam    | hot-sale-70-410-exam    | Latest-exam-700-603-Dumps    | Dumps-98-363-exams-date    | Certs-200-125-date    | Dumps-300-075-exams-date    | hot-sale-book-C8010-726-book    | Hot-Sale-200-310-Exam    | Exam-Description-200-310-dumps?    | hot-sale-book-200-125-book    | Latest-Updated-300-209-Exam    | Dumps-210-260-exams-date    | Download-200-125-Exam-PDF    | Exam-Description-300-101-dumps    | Certs-300-101-date    | Hot-Sale-300-075-Exam    | Latest-exam-200-125-Dumps    | Exam-Description-200-125-dumps    | Latest-Updated-300-075-Exam    | hot-sale-book-210-260-book    | Dumps-200-901-exams-date    | Certs-200-901-date    | Latest-exam-1Z0-062-Dumps    | Hot-Sale-1Z0-062-Exam    | Certs-CSSLP-date    | 100%-Pass-70-383-Exams    | Latest-JN0-360-real-exam-questions    | 100%-Pass-4A0-100-Real-Exam-Questions    | Dumps-300-135-exams-date    | Passed-200-105-Tech-Exams    | Latest-Updated-200-310-Exam    | Download-300-070-Exam-PDF    | Hot-Sale-JN0-360-Exam    | 100%-Pass-JN0-360-Exams    | 100%-Pass-JN0-360-Real-Exam-Questions    | Dumps-JN0-360-exams-date    | Exam-Description-1Z0-876-dumps    | Latest-exam-1Z0-876-Dumps    | Dumps-HPE0-Y53-exams-date    | 2017-Latest-HPE0-Y53-Exam    | 100%-Pass-HPE0-Y53-Real-Exam-Questions    | Pass-4A0-100-Exam    | Latest-4A0-100-Questions    | Dumps-98-365-exams-date    | 2017-Latest-98-365-Exam    | 100%-Pass-VCS-254-Exams    | 2017-Latest-VCS-273-Exam    | Dumps-200-355-exams-date    | 2017-Latest-300-320-Exam    | Pass-300-101-Exam    | 100%-Pass-300-115-Exams    |
http://www.portvapes.co.uk/    | http://www.portvapes.co.uk/    |