Hi,
I should probably explain my current configuration before asking for advice.
Current, racked:
Dual Xeon E5-2690s, 256gb RAM, ZFS 4TB SSD storage/ZFS 32TB spinning rust.
Runs Proxmox for 2x virtualized gaming machines (6 cores allocated), ZFS raid arrays, etc. ZFS is allocated 92GB of RAM for speed for the gaming VMs, and the gaming VMs have 32gb apiece.
I also have quite a few more machines on that rack serving various duties with everything being on a 10gbe switch and hitting the main server for storage (Please note I'm on 1gbit and run some hosts for personal use.)
The problem is the 10gbe switch is loud. Actually, the whole rack is loud, and it sucks quite a bit of power and generates a good bit of heat. Also, my environments aren't exactly small, moving to anything less than 128GB on my main server is not possible. I've been given wifely approval of a solution that is less offensive to the ears. I've sorted out two things to replace the current setup. Additionally, the 2690s are lacking raw clock speed plus modern IPC improvements -- I can't run pcsx2 at 4k/full settings on them for some of the stuff I want to stream to TV when I could with the other options, as one example.
My research has me down to one of the two following:
2x 6700ks, 32gb of RAM (16gb maybe with nvme?), etc.
Xeon D-1567 or maybe a D-1541, 128GB of RAM to replace the current dual E5-2690 server and other servers. Reduce the amount of RAM ZFS is allotted, moving the virtualized gaming machines to the above new machines should be sufficient to fit it in this server. I'd probably have to move some of my stuff to AWS and Azure for this as well.
However, something I'm tempted to do with this option is go with dual Denvertons instead of the Xeon D due to the latest news. Toying with the idea of Avoton as well, considering two C2750 setups are the same price as a single D-1541 setup. Plex leaves me worried about the C2750 though.
Or
I7-6950x@4ghz, 128GB of Ram, dual M.2s, etc. as a drop-in replacement for the dual E5-2690s, reconfiguring ZFS to move down to 32GB of RAM (since the nvme M.2's would be passed through to the gaming VMs, I think I can also reduce the RAM down to 16gb apiece)
Move some stuff to AWS or Azure. Downside, however, is gaming VMs would move from 6 cores to 4 cores, and this would leave 2 6950x @ 4ghz cores to replace 4 2690 cores for ZFS and assorted VMs...but it's probably close in raw performance.
This would be watercooled with a Kelvin S36
Currently leaning towards the latter option because of hardware lust and being able to move to Xeons when the latest gen becomes cheap, but I am interested to hear thoughts as well as other options? Also leaning towards it because Proxmox makes the gaming VMs ridiculously stable and reliable.
I should probably explain my current configuration before asking for advice.
Current, racked:
Dual Xeon E5-2690s, 256gb RAM, ZFS 4TB SSD storage/ZFS 32TB spinning rust.
Runs Proxmox for 2x virtualized gaming machines (6 cores allocated), ZFS raid arrays, etc. ZFS is allocated 92GB of RAM for speed for the gaming VMs, and the gaming VMs have 32gb apiece.
I also have quite a few more machines on that rack serving various duties with everything being on a 10gbe switch and hitting the main server for storage (Please note I'm on 1gbit and run some hosts for personal use.)
The problem is the 10gbe switch is loud. Actually, the whole rack is loud, and it sucks quite a bit of power and generates a good bit of heat. Also, my environments aren't exactly small, moving to anything less than 128GB on my main server is not possible. I've been given wifely approval of a solution that is less offensive to the ears. I've sorted out two things to replace the current setup. Additionally, the 2690s are lacking raw clock speed plus modern IPC improvements -- I can't run pcsx2 at 4k/full settings on them for some of the stuff I want to stream to TV when I could with the other options, as one example.
My research has me down to one of the two following:
2x 6700ks, 32gb of RAM (16gb maybe with nvme?), etc.
Xeon D-1567 or maybe a D-1541, 128GB of RAM to replace the current dual E5-2690 server and other servers. Reduce the amount of RAM ZFS is allotted, moving the virtualized gaming machines to the above new machines should be sufficient to fit it in this server. I'd probably have to move some of my stuff to AWS and Azure for this as well.
However, something I'm tempted to do with this option is go with dual Denvertons instead of the Xeon D due to the latest news. Toying with the idea of Avoton as well, considering two C2750 setups are the same price as a single D-1541 setup. Plex leaves me worried about the C2750 though.
Or
I7-6950x@4ghz, 128GB of Ram, dual M.2s, etc. as a drop-in replacement for the dual E5-2690s, reconfiguring ZFS to move down to 32GB of RAM (since the nvme M.2's would be passed through to the gaming VMs, I think I can also reduce the RAM down to 16gb apiece)
Move some stuff to AWS or Azure. Downside, however, is gaming VMs would move from 6 cores to 4 cores, and this would leave 2 6950x @ 4ghz cores to replace 4 2690 cores for ZFS and assorted VMs...but it's probably close in raw performance.
This would be watercooled with a Kelvin S36
Currently leaning towards the latter option because of hardware lust and being able to move to Xeons when the latest gen becomes cheap, but I am interested to hear thoughts as well as other options? Also leaning towards it because Proxmox makes the gaming VMs ridiculously stable and reliable.
Last edited: