Hi all due to my problems in this thread (http://lime-technology.com/forum/index.php?topic=48928.0) I am going to resort to building my server with new hardware to try and sort the situation out, I needed to get a new CPU anyway as I want one with VT-d capability to replace the current 3570k.

 

I need only a CPU, Mobo and Ram, but I've been trying to decide whether to go for mainstream components or fork out a tiny bit more for a xenon, ECC ram and a server grade mobo (stability but at a speed loss?).

 

The main requirements are:

CPU with at least 4 cores with hyper threading

CPU and Mobo with VT-x and VT-d support (for virtualization and hardware pass through)

Mobo with at least 8 SATA ports (all 6gb/s if possible), 10 ports would be ideal.

Mobo with onboard GPU

32GB RAM (doesn't need to be fast current rig has 24gb 1600mhz DDR3)

Mobo with dual NIC but not necessary I can live with a PCI-E card.

 

So far I've come up with the following builds:

 

Mainstream i7 route

Asus Z170-Deluxe

Intel Core i7-6700K

Corsair Vengeance 32GB DDR4 PC4-21300C15 2666MHz

 

Server Xeon route

Supermicro X11SAE-F-O

Intel Xeon E3-1275 v5

32GB Samsung DDR4, PC4-17000 (2133MHz), 288 pin, ECC, Registered

 

I can't afford much more then that so the server build is as far as i can stretch but I'm looking for something stable and reliable, this is for home use of course so what does everyone think? Or do you suggest something else?

Just also been looking at a third option a x99 build which would get me a 6 core processor:

 

X99 Route

Asrock X99 Extreme4 3.1 Intel X99

Intel i7-5820K

Corsair Vengeance 32GB DDR4 PC4-21300C15 2666MHz

 

Would the extra 2 cores be worth it?

 

I'm planning to run various dockers and 2 vms (windows server 2008 and a Linux firewall distro).

Hi -

 

A couple of thoughts.  First, check out this thread on issues with IOMMU groups on Skylake.  There are some issues with pass through that you should know about before committing to Skylake (though lots of people are using it happily).  Second, the Supermicro X11SAE-F-O takes Unbuffered ECC RAM, not Registered.

 

I think ECC RAM is a good idea for an always-on server, and will build my next server with it.  I think the Intel i7-5820K is overkill for your usage - but I like overkill .

 

Thanks for letting me know about the IOMMU problems, thankfully I am already leaning towards the X99 build as i like the idea of having 6 cores. You say overkill (i like overkill too), I always like to have more than i need then try and watch a plex video and see the dreaded transcode progress spinner.

 

I am already running 8 docker programs, including plex with potentially 3 users, and a Windows server 2008 VM. In the future I am also planning on running a handbrake docker so I can offload my encodes and linux firewall vm (distro to be decided) to replace my current smoothwall server once I get the server running stable (passing through some nics), so in all i think the 6 cores will do quite nicely for that setup.

 

I'm not really super hot on server hardware so I'm trying to decide whether the xeon build is worth it for my situation considering it will give me less cores than the x99 build and slower clock speed. The x99 is also the cheapest build out of the 3 surprisingly which is why I'm leaning towards it.

If you can find an Intel i7-5820K setup for less than the Skylake setups, that would be a good value and I'd be very tempted myself.  And, for a desktop I like the higher clock speed but in a server you'll benefit from more cores/threads - I think the trade-off of a slightly slower clock speed is worth the extra cores for your use case.

When you say Skylake, do you mean Xeon Skylake or mainstream i7 Skylake?

 

I've changed the motherboard but here in the UK the x99 setup is coming in at £659.97.

Intel i7-5820K 3.30GHz

Corsair Vengeance 32GB DDR4 PC4-21300C15 2666MHz

Asus X99-A

 

The (i7) Skylake build is £665.97

Asus Z170-Deluxe

Intel Core i7-6700K

Corsair Vengeance 32GB DDR4 PC4-21300C15 2666MHz

 

Obviously the x99 is Haswell-E but no brainer for me.

 

I noticed the Asus X99-A II is now on preorder which has Broadwell-E compatibility so I'm tempted to change the motherboard to that as a future upgrade path for the processor.

"...  I'm looking for something stable and reliable ..." =>  Then go with server grade hardware with ECC memory.

 

If you want 6 cores, spring for a 6-core Xeon E5 series [You'll have to save a few more £ to pay for it  ];  but candidly an E3 series is fine.    If you go with the E3 series, only install 2 memory modules [you can use 2 16GB ECC modules to get 32GB];  with the E5 series you'll have buffered RAM so you can install as many modules as you want.

 

"...  I'm looking for something stable and reliable ..." =>  Then go with server grade hardware with ECC memory.

 

If you want 6 cores, spring for a 6-core Xeon E5 series [You'll have to save a few more £ to pay for it  ];  but candidly an E3 series is fine.    If you go with the E3 series, only install 2 memory modules [you can use 2 16GB ECC modules to get 32GB];  with the E5 series you'll have buffered RAM so you can install as many modules as you want.

 

If I were to do the server grade and have a high clock speed 6 core, then this would be my pick:

Intel Xeon E5-1650 V3, LGA 2011-3, Haswell, 6 Core, 3.5GHz

Supermicro MBD-X10SRA-O

(X2) Samsung M393A2G40DB1-CRC 16GB DDR4-2400Mhz LP ECC Registered

 

However it very nearly doubles my original budget (assuming that board and memory are ok) at £923.41. I could stick it on the credit card but not sure the wife would approve.

F it, my current server just hanged again getting sick of it, like gary said I originally said stability so dammit I will look into getting the Xeon build i just mentioned.

 

Can someone tell me if the mobo and RAM choices are good?

That's an excellent motherboard, but I'd recommend the MBD-X10SRL-F version, which has IPMI with onboard video.

 

You could run that "headless" -- you can do EVERYTHING from another PC -- or you can use a keyboard/mouse and not require an add-in video card (which you'd need with the board you listed).

 

The memory and CPU are excellent choices.

 

Unfortunately that board doest seem to be available in the UK, don't fancy importing so I may have to stick with the one I mentioned. IPMI sounds good but not essential i guess when I can pop in the next room and hit the reset button.

 

Thanks for the info.

Ahhhhhh noooooo went to order this morning and the Supermicro MBD-X10SRA-O was out of stock with no ETA for more stock. Since I am unable to order this board anywhere else in the UK I've been looking at alternatives.

 

The Asus Z10PA-U8 looks like a viable alternative, similar price and specs but also has IPMI which is a bonus. Does anyone know anything about this board? info seems to be thin on the ground. The UK shop also seems to list it as a Non-ECC which would seem stupid for a server board, Asus site says it supports DDR4 2400 /2133 /1866/1600/1333 RDIMM, which I'm guessing is ECC registered right?

I'm not familiar with that board but I've had a lot of good luck with Asus boards over the years.  The Memory/Device Support list shows plenty of ECC options so you're good there.

Same I always buy Asus boards for desktop pcs they have never failed me and always stable, I bought a Gigabyte board once and I've always had problems with it, infact its the one that's in my server at the moment! (the one that's causing me to buy this upgrade)

 

I only went for a Supermicro choice as they seem to be highly rated for server solutions. Does anyone think this Asus board could be a bit of a downgrade? should I wait for the Supermicro to come back in stock?

The Asus board should be fine.  C612 server-grade chipset;  registered RAM (Yes, they're ECC);  remote management (Asus's version of IPMI); Intel NICs; etc.

 

Given a choice I'd use SuperMicro just because of their very long-term server board quality reputation; but Asus is also a good manufacturer, and this board certainly looks good.    Same chipset as the SuperMicro, so it's not likely to have any significant differences.

 

 

Shop has said 7 days for more stock Since my server is pretty much hanging every day now I've got no choice but to switch boards.

 

Also like the idea that the Asus has an internal usb plug directly on the board, looks perfect for plugging the Unraid USB stick into (yes just being pedantic now)

 

Fingers crossed it solves my problems.

 

Thanks for the help Gary/tdallen much appreciated.

That'll be a GREAT system -- and I agree the internal USB plug is a very nice feature