Question PCIe lanes

[Moggy]

Hi!
I have a Asus Sage 10G (motherboard has 4x PCIe 16x slots + 3x PCIe 8x slots).
I want to use the build as file server and a little gaming sometimes.

On there I want to use 1x video card AMD Vega 64 (16 PCIe lanes) and
4x Adaptec 72405 RAID cards (8 PCIe lanes each) connected to 96 x 128GB sata SSD (=a total of 12TB in RAID 0)

--> so that is a lot of SSD data traffic over these lanes to the 2x 10Gb network...
______
Question is which Intel CPU to get; 7820X (28 lanes) or 7900X (44 lanes)
Does the lane count matter when populating with 4x 8 lane hungry & fast RAID cards?
_____
Thanks!

 

[sdifox]

raid 0 = 1 drive fail = entire raid fail?

Oui oui. But don't worry it's only 96 drives, across 4-5 Adaptec controllers... I am assuming used.

 

[sdifox]

Lol dark territory double post.

 

[Fanatical Meat]

raid 0 = 1 drive fail = entire raid fail?

Yup zero backups

 

[VirtualLarry]

raid 0 = 1 drive fail = entire raid fail?

Yes. And statistically (only speaking of the drives, here, not the controllers, PSU, host system/DRAM, etc), he will have 96x the failure rate of a single drive.

 

[Fanatical Meat]

Yes. And statistically (only speaking of the drives, here, not the controllers, PSU, host system/DRAM, etc), he will have 96x the failure rate of a single drive.

Wow I never thought about that. 2 or 3 or 96 drives treated as one drive means 2 or 3 or 96 times the failure rate.

 

[LOUISSSSS]

Yes. And statistically (only speaking of the drives, here, not the controllers, PSU, host system/DRAM, etc), he will have 96x the failure rate of a single drive.

I've love to see the OP come back in response to this and see whats his plan. YouTube stardom...

 

[Moggy]

raid 0 = 1 drive fail = entire raid fail?

yes LOUISSSSS
And it even is the same for 2 or 96 drives, imagine that!
Now go and look up the meaning of MTBF and the probability statistics for 1 drive and for RAID systems.
(I'll give you a hint my system = (₃₅C₄)/(₉₀C₄) = 476/23229 ≈ 0.020)

 

[Moggy]

OP, have you considered the stripe size necessary for utilizing 96 SATA channels, and making effective use of that? I'm guessing that you haven't, and that you've just heard that "RAID-0 makes drives faster".

Well, not unless properly set up, and tuned. I ran chipset RAID-0 of a pair of 30GB SATA SSDs on a Core2-era P35 / ICH9R rig in Win7 64-bit when they were a new thing. Well, due to lack of proper TRIM support, the RAID-0's performance had dropped BELOW that of a single identical drive, within a week.

wrong guess
And we're a "bit" past core 2 era where TRIM was an issue

 

[Moggy]

That is what happens on desktop platforms on the intel side.

That is why I mentioned TR3. You get 64 pcie lanes.

???
O.P.; "Don't know how my car functions"
Support line; "It's because it has 4 wheels. Buy another car."

TR3 is just as much desktop my friend!! ----"Threadripper, which is geared for high end desktops (HEDT), wasn't developed as part of a business plan or a specific roadmap; instead a small enthusiast team inside AMD saw an opportunity that something could be developed between the Ryzen and Epyc cpu roadmaps... "

I think 99% of users on this forum know by now in 2020 that AMD is beating Intel around the ears. What is not mentioned in all these parrot talks is that TR has some other serious problems compared to Intel X299.
Anyway, please stop bleating about AMD and give a proper answer to my Intel problem....

 

[sdifox]

???
O.P.; "Don't know how my car functions"
Support line; "It's because it has 4 wheels. Buy another car."

TR3 is just as much desktop my friend!! ----"Threadripper, which is geared for high end desktops (HEDT), wasn't developed as part of a business plan or a specific roadmap; instead a small enthusiast team inside AMD saw an opportunity that something could be developed between the Ryzen and Epyc cpu roadmaps... "

I think 99% of users on this forum know by now in 2020 that AMD is beating Intel around the ears. What is not mentioned in all these parrot talks is that TR has some other serious problems compared to Intel X299.
Anyway, please stop bleating about AMD and give a proper answer to my Intel problem....

I already did, puget says you can have 4 cards working at 16x. Or 1x16+5x8

Parts

Puget Systems provides part information, advice, and tech specs for all of the computer hardware we use to configure our workstation PCs

www.pugetsystems.com

 

[Moggy]

That is for a Asus WS C422 system, with Xeon CPU, not X299 with Skylake-X CPU's.
And does not explain to me if a CPU with 28 vs 44 lanes will have an impact on performance.

 

[sdifox]

That is for a Asus WS C422 system, with Xeon CPU, not X299 with Skylake-X CPU's.
And does not explain to me if a CPU with 28 vs 44 lanes will have an impact on performance.

It's the same setup. No impact it looks like.

ASUS WS X299 Sage Work Station Motherboard Review - OC3D

Introduction It’s a bit of a change of scenery here at OC3D Towers today. Once upon a time, not so long ago, there was a little girl called Emily. Hang on, that’s Bagpuss. Let’s try again. Once upon a time, not so long ago, the majority of motherboards you purchased were enterprise based models...

www.overclock3d.net

 

[Moggy]

Well then it seems only 1 way to find out; test it myself

 

[sdifox]

Each of those raid cards top out at 6.44GB/s. So one controller with 22 SSD will saturate your 2GB/s pipe.

I hope your psu is up to snuff.

 

[Moggy]

I know
I need the IOPS in between the cards not on the outside pipe

In the picture you can see my PSU; 1600 Watt

 

[Moggy]

Dear all boys and girls,

I'm not used to forums but am surprised the way this works.
Thanks to all for all your answers, even if it sometimes was only criticism.
(I'm surprised I did not read anyone giving an opinion about pizza).

Don't use Intel, take AMD TR (no thanks I have this intel mobo)
Do not use RAID 0 (I want IOPS, do not care about safety)
I can built a cheaper machine (no you can't)
This will fail (nope)
You want youtube fame (nope)
Use a blade server (yeah sure; 100.000$ for single use application)
You only have 2GB/s I/O (20Gb/s is actually 2.5GB/s and that is enough to the outside world,
but internal computation throughput needs to be faster, hence for the RAID cards)
I'm using 4x Adaptec 72405 that is 6 ports x 4 SSD in RAID 0 (x 4 cards= 96SSD)

Adaptec - Adaptec RAID 72405

 

[sdifox]

I know
I need the IOPS in between the cards not on the outside pipe

In the picture you can see my PSU; 1600 Watt

Had to zoom in to read it, you good xd

 

[sdifox]

Dear all boys and girls,

I'm not used to forums but am surprised the way this works.
Thanks to all for all your answers, even if it sometimes was only criticism.
(I'm surprised I did not read anyone giving an opinion about pizza).

Don't use Intel, take AMD TR (no thanks I have this intel mobo)
Do not use RAID 0 (I want IOPS, do not care about safety)
I can built a cheaper machine (no you can't)
This will fail (nope)
You want youtube fame (nope)
Use a blade server (yeah sure; 100.000$ for single use application)
You only have 2GB/s I/O (20Gb/s is actually 2.5GB/s and that is enough to the outside world,
but internal computation throughput needs to be faster, hence for the RAID cards)
I'm using 4x Adaptec 72405 that is 6 ports x 4 SSD in RAID 0 (x 4 cards= 96SSD)

Adaptec - Adaptec RAID 72405

There are overheads, that is why I rounded the 20gbps to 2GBps. You never mentioned you only cared about in system io until now...

But do put it on youtube, I guarantee there will be a lot of viewers, myself included.

 

[LOUISSSSS]

Gl. Still lol @ 96 sata drives

 

[Fanatical Meat]

@Moggy , I think this is a wonderful project. My earlier comments were regarding what we typically see.
I want to run COD at 1,000 frames per second so I'll set up this crazy complicated RAID array....
or
I have a small business and I need to store a bunch of customer data that is critical to my business, I want to set up an enormous RAID 0 cluster on a bunch of cheap ssd drives...

As a side project with minimal money invested and having the time and skill to do so, I am all for this project.

 

[Moggy]

@Moggy , I think this is a wonderful project. My earlier comments were regarding what we typically see.
I want to run COD at 1,000 frames per second so I'll set up this crazy complicated RAID array....
or
I have a small business and I need to store a bunch of customer data that is critical to my business, I want to set up an enormous RAID 0 cluster on a bunch of cheap ssd drives...

As a side project with minimal money invested and having the time and skill to do so, I am all for this project.

Thank you!
To me it seems this is the first positive reply I get...
I certainly do not pretend to be the inventor or first one to have this idea but let's all be open to new or uncommon idea's from others.
If not, the airoplane would never have been invented
Have a nice day, all!

 

[VirtualLarry]

Are you a human?

www.newegg.com

HP 1.4TB MLC Mainstream Endurance (ME) PCIe NAND SSD Workload Accelerator Gen8 - PCI Express 2.0 x8 - Solid State Drive - 3.30 GBps Maximum Read Transfer Rate - 729307-B21 | 729390-001

Limited time offer, ends 02/29 by inStock901

REFURBISHED

• PCI Express 2.0 x8 SSD
• Storage Capacity - 1.40 TB
• Max Read Transfer Rate - 3.30 GBps
• Maxi Write Transfer Rate - 615 MBps
• Random 4KB Read - 120000IOPS
• Random 4KB Write - 99000IOPS
• MTTF: 2.0mil hr

Think that you can do better than that, for $649.49?

 

[Moggy]

Are you a human?

www.newegg.com

HP 1.4TB MLC Mainstream Endurance (ME) PCIe NAND SSD Workload Accelerator Gen8 - PCI Express 2.0 x8 - Solid State Drive - 3.30 GBps Maximum Read Transfer Rate - 729307-B21 | 729390-001

Limited time offer, ends 02/29 by inStock901

REFURBISHED

• PCI Express 2.0 x8 SSD
• Storage Capacity - 1.40 TB
• Max Read Transfer Rate - 3.30 GBps
• Maxi Write Transfer Rate - 615 MBps
• Random 4KB Read - 120000IOPS
• Random 4KB Write - 99000IOPS
• MTTF: 2.0mil hr

Think that you can do better than that, for $649.49?

I think I already did (better than that)...
Second hand controller 7245 = $65us (new +/-$400)
24 SSD in RAID 0 = 3 TB ; Read speed 6,400 MB/s and write speed 5229 MB/s & +/- 370.000 IOPS
per RAID card (there are 4 in the system = 12 TB)


And thanks for the link you sent, it is nice ; $3350us price reduction?! not bad
But only 1.4TB & 615 MB/s write speed

 

[LOUISSSSS]

This is cute, whats the point again?

 

[Fanatical Meat]

This is cute, whats the point again?

Nerd project.


I sort of want to try @VirtualLarry ’s idea of RAID 0 floppy disc drives.