Weekly DC Stats - 18JUL2021

[voodoo5_6k]

Voodoo5
Keep us posted on how you get on with the Pi

Sure, will do! It is bound to arrive today. If I have some spare time on the weekend, I'll set up the OS & BOINC. If there's still some time left, I'll look into implementing the relevant power optimizations mentioned in Endgame's thread here & in the hardforum. If not, then I'll do it early next week.

@Endgame124: Is that information (the power optimizations I mentioned above) still the latest & greatest or is there something else I should look at? Thanks already

 

[Endgame124]

Sure, will do! It is bound to arrive today. If I have some spare time on the weekend, I'll set up the OS & BOINC. If there's still some time left, I'll look into implementing the relevant power optimizations mentioned in Endgame's thread here & in the hardforum. If not, then I'll do it early next week.

@Endgame124: Is that information (the power optimizations I mentioned above) still the latest & greatest or is there something else I should look at? Thanks already

I have much better info. You can read this post / thread ( https://hardforum.com/threads/distributed-computing-on-raspberry-pi.1997998/page-4#post-1045024630 ) but I’ll also update the thread here with the newest info.

 

[Rudy Toody]

Thanks for the stats, Stefan

 

[voodoo5_6k]

I have much better info. You can read this post / thread ( https://hardforum.com/threads/distributed-computing-on-raspberry-pi.1997998/page-4#post-1045024630 ) but I’ll also update the thread here with the newest info.

Thanks for the info! I'll go through this, once I've set up the OS. No package on Friday, no package today... I'm hoping for Monday now...

 

[Endgame124]

Thanks for the info! I'll go through this, once I've set up the OS. No package on Friday, no package today... I'm hoping for Monday now...

I updated the thread here, so that basically covers it, but if you haven’t read the hard forum thread, it’s an interesting read anyway

 

[voodoo5_6k]

I updated the thread here, so that basically covers it, but if you haven’t read the hard forum thread, it’s an interesting read anyway

Thanks! Yes, I had read the hardforum thread, I think it's also linked in your Raspberry Pi thread (that's how I "found" it). I've also read through the other thread on raspberrypi.org. I would've loved to start right away after that, but now I have to exercise patience... The estimated delivery date slipped from Friday to Saturday (but it didn't get delivered today...), and I'm not so sure about Monday either... Well, we'll see in a few days

 

[voodoo5_6k]

The estimated delivery date slipped from Friday to Saturday (but it didn't get delivered today...), and I'm not so sure about Monday either... Well, we'll see in a few days

...and now it's been postponed to Tuesday Just great...

 

[voodoo5_6k]

...and now it's been postponed to Tuesday Just great...

And it got even better... I still don't have it... It's now due tomorrow... For whatever reason they have been sending it around between two distribution centers for days, and then, nothing in the tracking since Monday 02:00am... Just now the tracking has been updated again with what looks like the usual last step before delivery... Well, let's see... Haven't had something like this in a long time

 

[Endgame124]

And it got even better... I still don't have it... It's now due tomorrow... For whatever reason they have been sending it around between two distribution centers for days, and then, nothing in the tracking since Monday 02:00am... Just now the tracking has been updated again with what looks like the usual last step before delivery... Well, let's see... Haven't had something like this in a long time

It’s only because you want it. If it were a bill, it would be there already

 

[voodoo5_6k]

Yeah, this has Murphy's law written all over it

 

[AshlayW]

Sorry for the drop in output. Had a huge switch up in hardware, had to sell a bunch of processors to pay some hardware changes. My monthly budget for power remains the same though, so I've increased the clock speeds on existing CPUs to attempt to offset the reduction in cores. D:

48x Zen2 + 16 Zen+ cores have been replaced by 32 Zen3 + 12x Zen2 (though some of these aren't full time anymore, server stuff, "gaming" etc)

Science has to be done.

Interesting tidbits: looking at AMD's Zen core performance counters (via a custom software tool a friend made) current WCG WUs (MCM, formerly MIP and OPN appear to be very high-IPC throughput workloads that reside almost entirely in the L3 cache on Zen2 and 3. I can get some numbers later, but from what I was seeing; 5950X is reporting a 90%+ L3 cache hitrate with an 80%+ uOp Cache Hitrate, and the backend is tracking up to 4 instructions retired per clock at ~4.3 GHz, per core, with SMT. That's 2 / thread, which is extremely high for a CPU workload. The high uOp$ Hit rate is why that's possible, since the front end is dispatching from the wider op cache rather than decode, it's also more efficient and apparently these workloads scale really well to Zen2/3 with the big internal caches. The "disappointing news" is that V-cache equipped processors of the next-gen Zen3 refresh might not yield large gains for workloads already mostly in L3 cache, though a full load of ARPs would probably see a lot of benefit from that.

My final note is, I have laid my filthy, tech-obsessed paws on an RTX 3090 which I want to put to work in Folding At Home. So if I could join the Anandtech FAH team, I can see what it can do, if you'd have me? (I also have a TITAN Xp available). Meow.

 

[crashtech]

@AshlayW, if you are waiting for an invite to the F@H team, let me be the first to extend it! I must add though that while good manners are always appreciated, it's fine to join any of the Anandtech DC teams without an explicit invitation!

The performance monitoring software you mention sounds very interesting, is there any chance it will become available to the public, or more specifically, Team Anandtech members?

 

[biodoc]

My final note is, I have laid my filthy, tech-obsessed paws on an RTX 3090 which I want to put to work in Folding At Home. So if I could join the Anandtech FAH team, I can see what it can do, if you'd have me? (I also have a TITAN Xp available). Meow.

Yep! FYI we are team 198.

 

[Markfw]

Well, I am now missing a 2970wx 24 core. It was down for some reason, then I unplugged the power and powering it up, and smoke, then orange sparks/flame came from the motherboard in the area of the CPU VRMs, so I pulled the plug. I hope its just the motherboard.

 

[Markfw]

BTW, my PSU tester (Thermaltake Dr Power II) says the PSU is good ! Lets hope the CPU and memory and NVME drive make it.

 

[AshlayW]

@AshlayW, if you are waiting for an invite to the F@H team, let me be the first to extend it! I must add though that while good manners are always appreciated, it's fine to join any of the Anandtech DC teams without an explicit invitation!

The performance monitoring software you mention sounds very interesting, is there any chance it will become available to the public, or more specifically, Team Anandtech members?

thanks! I Joined

Also, yes I think he would be okay with it being available, I will ask him and get back to you!

 

[Endgame124]

thanks! I Joined

Also, yes I think he would be okay with it being available, I will ask him and get back to you!

I look forward to seeing your F@H output. Just the 3090 will put you around number 3 on the TeAm. If you bump me out of the top 10, I may need to change up my hardware to get back in.

 

[AshlayW]

I look forward to seeing your F@H output. Just the 3090 will put you around number 3 on the TeAm. If you bump me out of the top 10, I may need to change up my hardware to get back in.

Seeing over 8M PPD on some WUs, lows of around 3-4M and some in between. Here is one of the best WUs for the 3090 in terms of output


Interesting as memory controller utilisation (afaik this is a metric of how many memory requests the IMC is tracking in flight, not specifically bandwidth use, but it does correlate closely) is higher on these ones; memory is tuned to about 20 Gbps, measured at 830 GB/s in AIDA64 GPGPU (from ~960GB/s theoretical assuming no latency). Lots of bandwidth and lots of FP32 compute that might not necessarily be used in games, gives the GA102 something near a doubling of throughput in this vs my RTX 2080 Ti with TU102 GPU, which I distinctly remember capping at around 4.5 to 5M PPD in the best cases, at about the same power usage (slightly less, actually, 310W).

GDDR6X seems to be pointless on the gaming cards (G6 variant of the GA102 in A6000 vs 3090 comes to mind) but compute could be where this power hog card shines really well, it is more than 3X the GP102 in the TITAN Xp at only ~40% more power usage.. For reference the TITAN Xp is on about 2.5-3M PPD in the best cases at 250W.

I will not be increasing the core clock as this card is a blower model, rated for 350W board power caps, with no ability to increase the limit. Given how 3090s seem to have a habit of exploding, I'm not annoyed by that at all, it also exhausts its heat from my case like a gentleman and doesn't warm up the R9 5950X doing WCG, either.

Right now I seem to be hitting just over 10M PPD with the TITAN Xp and 3090 together. I'm just having crazy ideas about getting a TR Pro 3955WX system with 4x RTX 3090 blowers (or A6000s) and running that full tilt for SCIENCE! Then realising how much it would cost and deciding that 2 years rent is probably a better investment. One will have to do.

 

[AshlayW]

View attachment 48065BTW, my PSU tester (Thermaltake Dr Power II) says the PSU is good ! Lets hope the CPU and memory and NVME drive make it.

Those are tantalum capacitors I think, they are very heat sensitive, how much power was the 2970WX using? This could be a component failure causing incredibly high resistance and thermal runaway.

 

[voodoo5_6k]

Yeah, this has Murphy's law written all over it

...and the story continues

I still haven't received the package. It's been sitting in the (correct) distribution hub, and it's getting scanned every other day, but it never gets anywhere. I have complained to the sender, so they can file a request for an official inquiry with the carrier (I as the designated recipient am not allowed to do that). This is really getting ridiculous. But something seems to be amiss there lately anyhow. They have another package I'm waiting for. They threw a card in my mailbox that they couldn't hand it over to me (although I was there the entire day...) and that I could pick it up at their local office the next afternoon. That was almost two weeks ago. I was there a few days later, and they said that they didn't have it. I checked the tracking, and yes, it never reached their office... and it still doesn't have, to this very day. But here, at least, I have a little advantage. They advanced the customs charges

 

[Assimilator1]

Man! Sounds like similar troubles I'm having trying to get a fan hub bearing for my dad's old Passat! (none available here, nearest county with stock is Poland!).

Markfw
Bad luck with the m/brd , I hope the CPU and the rest has survived!

AshlayW
Welcome to TA F@H
That's a large number of zen cores you have!

 

[voodoo5_6k]

Man! Sounds like similar troubles I'm having trying to get a fan hub bearing for my dad's old Passat! (none available here, nearest county with stock is Poland!).

If you'd like, I can check with the local dealership here. They have access to the entire spare part inventory in Germany, incl. classic parts. Maybe they can get it. Just give me the VW part number, and I'll ask for it (I have to make a service appointment there anyhow).

 

[voodoo5_6k]

...and the story continues

I still haven't received the package. It's been sitting in the (correct) distribution hub, and it's getting scanned every other day, but it never gets anywhere. I have complained to the sender, so they can file a request for an official inquiry with the carrier (I as the designated recipient am not allowed to do that). This is really getting ridiculous. But something seems to be amiss there lately anyhow. They have another package I'm waiting for. They threw a card in my mailbox that they couldn't hand it over to me (although I was there the entire day...) and that I could pick it up at their local office the next afternoon. That was almost two weeks ago. I was there a few days later, and they said that they didn't have it. I checked the tracking, and yes, it never reached their office... and it still doesn't have, to this very day. But here, at least, I have a little advantage. They advanced the customs charges

I can't believe it, but it's finally out for delivery today! Wow... That's 16 days in transit... If it really gets delivered later today of course I'm just hoping it'll arrive undamaged

 

[voodoo5_6k]

I can't believe it, but it's finally out for delivery today! Wow... That's 16 days in transit... If it really gets delivered later today of course I'm just hoping it'll arrive undamaged

Yay, it's here, finally Already online... but... Rosetta is out of tasks... of course...

 

[Endgame124]

Yay, it's here, finally Already online... but... Rosetta is out of tasks... of course...

You didn’t want this to be easy, did you?

i setup my pis to pull from WCG OP if Rosetta is out of tasks. I think it’s all done though the WCG website profiles, but I don’t remember for sure.