March 1, 201610 yr Anybody have any thoughts on the two heatsinks below. I'll be using the ASRock EP2C602-4L/D16 SSI EEB Server Motherboard. http://m.newegg.com/Product/index?itemNumber=N82E16835608042 http://www.amazon.com/Noctua-Cooler-LGA2011-Platforms-NH-U12DXi4/dp/B00DWFQ42I#featureBulletsAndDetailBullets_secondary_view_div_1456796362754 I'm not sure that the dual fan heatsink isn't overkill. Any reason why I should need it? I'm using the Define XL R2 case. I'll be running at most 2 Vm's. Just installed the NH-U12DXi4. 2 of them. Only 1 fan each at the moment. Pretty tall is one thing I would say. The heat pipes stick out. I put them in a Lian Li PC-D8000 and they actually hit the center divider. I for sure thought it would clear it.
March 1, 201610 yr PSU question for the Asrock/Xenon build. I got 16 drives + 2 ssd cache pool. I was thinking of throwing in at least 1 older geforce 760 GTX and maybe a 5450 to play around with some vms. I've powered 14 drives with a Corsair hx650. It lacks a eps connector and more than 2 pci-e connectors. What would be ideal power wise? Corsair RM850i W or RM1000i W? Both include 2 EPS connectors and 6 x PCI-E Connectors. CORSAIR RM850i 850W ATX12V / EPS12V 80 PLUS GOLD Certified Full Modular Power Supply Nvidia Sli ready and crossfire support with C-link http://www.ncix.com/detail/corsair-rm850i-power-supply-zero-d6-109971.htm Corsair RM1000I Power Supply Zero RPM Silent Operation +12V 80+GOLD Modular 7 Years Warranty http://www.ncix.com/detail/corsair-rm1000i-power-supply-zero-a4-109972-1307.htm Same price right no (1000i has a $20 mir). Thanks!
March 1, 201610 yr PSU question for the Asrock/Xenon build. I got 16 drives + 2 ssd cache pool. I was thinking of throwing in at least 1 older geforce 760 GTX and maybe a 5450 to play around with some vms. I've powered 14 drives with a Corsair hx650. It lacks a eps connector and more than 2 pci-e connectors. What would be ideal power wise? Corsair RM850i W or RM1000i W? Both include 2 EPS connectors and 6 x PCI-E Connectors. CORSAIR RM850i 850W ATX12V / EPS12V 80 PLUS GOLD Certified Full Modular Power Supply Nvidia Sli ready and crossfire support with C-link http://www.ncix.com/detail/corsair-rm850i-power-supply-zero-d6-109971.htm Corsair RM1000I Power Supply Zero RPM Silent Operation +12V 80+GOLD Modular 7 Years Warranty http://www.ncix.com/detail/corsair-rm1000i-power-supply-zero-a4-109972-1307.htm Same price right no (1000i has a $20 mir). Thanks! This is just my opinion, but corsair power supplies have been getting sub par reviews for all models that have been released since 2012. I would get a power supply rated for operating at atleast 50c and the corsair 750 was rated at 30c, and then they just kinda "fixed it" and put an "i" in the model number. Id check out Seasonic and silverstone.
March 1, 201610 yr I am trying to locate a dual CPU ATX MB. I have found several Supermicro boards at the site, http://www.superbiiz.com/query.php?dp=1&dt=2&categry=226&name=Xeon-Server-Motherboard&pa0=Dual+LGA2011&pa5=ATX&brand=&pa1=&pa2=&pa3=&pa4=&pa6=&pa7=&pa8=&pa9=&stock=Yes&searchStr=Search+from+current+results&myanchor=%23displaytop&brand=&pa0=Dual+LGA2011&pa1=&pa2=&pa3=DDR3&pa4=&pa5=ATX&pa6=&pa7=&pa8=&pa9=&stock=Yes&nl=30&searchStr=Search+from+current+results&ob=r&myanchor=%23displaytop How can I tell if the are for v1 /v2 CPUs rather than v3s. thanks.
March 1, 201610 yr I am trying to locate a dual CPU ATX MB. I have found several Supermicro boards at the site, http://www.superbiiz.com/query.php?dp=1&dt=2&categry=226&name=Xeon-Server-Motherboard&pa0=Dual+LGA2011&pa5=ATX&brand=&pa1=&pa2=&pa3=&pa4=&pa6=&pa7=&pa8=&pa9=&stock=Yes&searchStr=Search+from+current+results&myanchor=%23displaytop&brand=&pa0=Dual+LGA2011&pa1=&pa2=&pa3=DDR3&pa4=&pa5=ATX&pa6=&pa7=&pa8=&pa9=&stock=Yes&nl=30&searchStr=Search+from+current+results&ob=r&myanchor=%23displaytop How can I tell if the are for v1 /v2 CPUs rather than v3s. thanks. DDR4 ram is v3, DDR3 is v1/v2.
March 1, 201610 yr Author I am trying to locate a dual CPU ATX MB. I have found several Supermicro boards at the site, http://www.superbiiz.com/query.php?dp=1&dt=2&categry=226&name=Xeon-Server-Motherboard&pa0=Dual+LGA2011&pa5=ATX&brand=&pa1=&pa2=&pa3=&pa4=&pa6=&pa7=&pa8=&pa9=&stock=Yes&searchStr=Search+from+current+results&myanchor=%23displaytop&brand=&pa0=Dual+LGA2011&pa1=&pa2=&pa3=DDR3&pa4=&pa5=ATX&pa6=&pa7=&pa8=&pa9=&stock=Yes&nl=30&searchStr=Search+from+current+results&ob=r&myanchor=%23displaytop How can I tell if the are for v1 /v2 CPUs rather than v3s. thanks. Check Supermicro's own product page
March 1, 201610 yr I am trying to locate a dual CPU ATX MB. I have found several Supermicro boards at the site, http://www.superbiiz.com/query.php?dp=1&dt=2&categry=226&name=Xeon-Server-Motherboard&pa0=Dual+LGA2011&pa5=ATX&brand=&pa1=&pa2=&pa3=&pa4=&pa6=&pa7=&pa8=&pa9=&stock=Yes&searchStr=Search+from+current+results&myanchor=%23displaytop&brand=&pa0=Dual+LGA2011&pa1=&pa2=&pa3=DDR3&pa4=&pa5=ATX&pa6=&pa7=&pa8=&pa9=&stock=Yes&nl=30&searchStr=Search+from+current+results&ob=r&myanchor=%23displaytop How can I tell if the are for v1 /v2 CPUs rather than v3s. thanks. I ordered this one... Has not arrived yet. http://www.newegg.com/Product/Product.aspx?Item=N82E16813182670
March 1, 201610 yr Seems a few more boards might be back in stock at newegg for anyone looking. Newegg.ca http://www.newegg.ca/Product/Product.aspx?Item=N82E16813157350&_ga=1.264325583.1725455903.1431643741 Newegg.com http://www.newegg.com/Product/Product.aspx?Item=N82E16813157350
March 1, 201610 yr Just got the board mounted in a Corsair 540. Can't wait to start testing. EP2C602-4L/D16
March 1, 201610 yr Got my system up and running, however my second graphics card will not pass through on my ASRock EP2C602 board. Card worked fine in previous e3-1245v3 setup. Have this card in the PCIe slot closest to the RAM. Other card, in the x16 slot at opposite end of board, works perfect. I am going to try a bit more debugging before posting a help thread in proper forum. Error I get is below. I have BIOS set to initiate onboard GPU, not PCIe GPU: 2016-03-01 23:48:41.708+0000: starting up libvirt version: 1.2.18, qemu version: 2.3.0 Domain id=3 is tainted: high-privileges Domain id=3 is tainted: custom-argv Domain id=3 is tainted: host-cpu char device redirected to /dev/pts/2 (label charserial0) 2016-03-01T23:48:42.684449Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: error opening /dev/vfio/40: Operation not permitted 2016-03-01T23:48:42.684484Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to get group 40 2016-03-01T23:48:42.684498Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device initialization failed 2016-03-01T23:48:42.684510Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device 'vfio-pci' could not be initialized 2016-03-01 23:48:42.732+0000: shutting down
March 1, 201610 yr Just got the board mounted in a Corsair 540. Can't wait to start testing. EP2C602-4L/D16 I am shocked and awed by how you were able to fit that board in that case. That thing is tiny, but nonetheless a really cool case. Props to you if everything fits. Thought I'd share the case I have and will use once I receive the Intel board and all other parts: http://www.nanoxiausa.com/collections/full-tower-case/products/nanoxia-deep-silence-6-nxds6ww-hptx-full-tower-case
March 2, 201610 yr Got my system up and running, however my second graphics card will not pass through on my ASRock EP2C602 board. Card worked fine in previous e3-1245v3 setup. Have this card in the PCIe slot closest to the RAM. Other card, in the x16 slot at opposite end of board, works perfect. I am going to try a bit more debugging before posting a help thread in proper forum. Error I get is below. I have BIOS set to initiate onboard GPU, not PCIe GPU: 2016-03-01 23:48:41.708+0000: starting up libvirt version: 1.2.18, qemu version: 2.3.0 Domain id=3 is tainted: high-privileges Domain id=3 is tainted: custom-argv Domain id=3 is tainted: host-cpu char device redirected to /dev/pts/2 (label charserial0) 2016-03-01T23:48:42.684449Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: error opening /dev/vfio/40: Operation not permitted 2016-03-01T23:48:42.684484Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to get group 40 2016-03-01T23:48:42.684498Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device initialization failed 2016-03-01T23:48:42.684510Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device 'vfio-pci' could not be initialized 2016-03-01 23:48:42.732+0000: shutting down Check this out. There was apparently a limitation for IOMMU groups above like 32...
March 2, 201610 yr Got my system up and running, however my second graphics card will not pass through on my ASRock EP2C602 board. Card worked fine in previous e3-1245v3 setup. Have this card in the PCIe slot closest to the RAM. Other card, in the x16 slot at opposite end of board, works perfect. I am going to try a bit more debugging before posting a help thread in proper forum. Error I get is below. I have BIOS set to initiate onboard GPU, not PCIe GPU: 2016-03-01 23:48:41.708+0000: starting up libvirt version: 1.2.18, qemu version: 2.3.0 Domain id=3 is tainted: high-privileges Domain id=3 is tainted: custom-argv Domain id=3 is tainted: host-cpu char device redirected to /dev/pts/2 (label charserial0) 2016-03-01T23:48:42.684449Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: error opening /dev/vfio/40: Operation not permitted 2016-03-01T23:48:42.684484Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to get group 40 2016-03-01T23:48:42.684498Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device initialization failed 2016-03-01T23:48:42.684510Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device 'vfio-pci' could not be initialized 2016-03-01 23:48:42.732+0000: shutting down Had the same problem, try the second PCIE3.0 slot down instead of the top one. I got two 770s running in two VMs And I'm getting 53 degrees Celsius at 3.0 Ghz running prime95 for an hour with the Corsair liquid coolers. Took me forever to get the temp sensors to load @.@ Can now try to start overclocking and actually know if I'm gonna burn. Anybody know how to pass through a folder from a ram disk to all your VMs? Also I'm wanting to get four GTX 770's in here but alas, double width GPU won't fit. I got a riser cable but the card isn't responding with it at all. Any other options besides a slim waterblock?
March 2, 201610 yr Anyone using or have any experience with Nanya Ram modules? Specifically the 8G sticks of NT8GC72C4NG0NL-CG PC3L-10600R 2RX4 DDR3-1333MHz ECC REG Server Memory. Just trying to figure out if there will be any issues. It seems relatively cheaper than the other alternatives of Samsung or Hynix. I have the ASROCK L4/D16 and would like to use all 16 slots for 128GB.
March 2, 201610 yr Thought I'd share the case I have and will use once I receive the Intel board and all other parts: http://www.nanoxiausa.com/collections/full-tower-case/products/nanoxia-deep-silence-6-nxds6ww-hptx-full-tower-case Be aware that on the Nanoxia cases, if you want to put cages in the 5.25 drive bays, you'll have to remove the upper door. I have the Deep Silence 5 and the door completely seals off any airflow to the upper drive bays and the drives get very hot. The door is easy to remove though.
March 2, 201610 yr are those the Xi4 coolers? will ram fit in the first slots adjacent to the cooler or are they hampered by the cooler?
March 2, 201610 yr Oh man a thing of beauty! Welcome to the club! ... Now let me find you a membership card ... Good for 15% off the buffet at the Sizzler..
March 2, 201610 yr Got my system up and running, however my second graphics card will not pass through on my ASRock EP2C602 board. Card worked fine in previous e3-1245v3 setup. Have this card in the PCIe slot closest to the RAM. Other card, in the x16 slot at opposite end of board, works perfect. I am going to try a bit more debugging before posting a help thread in proper forum. Error I get is below. I have BIOS set to initiate onboard GPU, not PCIe GPU: 2016-03-01 23:48:41.708+0000: starting up libvirt version: 1.2.18, qemu version: 2.3.0 Domain id=3 is tainted: high-privileges Domain id=3 is tainted: custom-argv Domain id=3 is tainted: host-cpu char device redirected to /dev/pts/2 (label charserial0) 2016-03-01T23:48:42.684449Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: error opening /dev/vfio/40: Operation not permitted 2016-03-01T23:48:42.684484Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to get group 40 2016-03-01T23:48:42.684498Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device initialization failed 2016-03-01T23:48:42.684510Z qemu-system-x86_64: -device vfio-pci,host=81:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device 'vfio-pci' could not be initialized 2016-03-01 23:48:42.732+0000: shutting down Had the same problem, try the second PCIE3.0 slot down instead of the top one. I got two 770s running in two VMs And I'm getting 53 degrees Celsius at 3.0 Ghz running prime95 for an hour with the Corsair liquid coolers. Took me forever to get the temp sensors to load @.@ Can now try to start overclocking and actually know if I'm gonna burn. Anybody know how to pass through a folder from a ram disk to all your VMs? Also I'm wanting to get four GTX 770's in here but alas, double width GPU won't fit. I got a riser cable but the card isn't responding with it at all. Any other options besides a slim waterblock? Check this out. There was apparently a limitation for IOMMU groups above like 32...
March 2, 201610 yr Thought I'd share the case I have and will use once I receive the Intel board and all other parts: http://www.nanoxiausa.com/collections/full-tower-case/products/nanoxia-deep-silence-6-nxds6ww-hptx-full-tower-case Be aware that on the Nanoxia cases, if you want to put cages in the 5.25 drive bays, you'll have to remove the upper door. I have the Deep Silence 5 and the door completely seals off any airflow to the upper drive bays and the drives get very hot. The door is easy to remove though. I placed a vertical fan drive cage in that area that holds two SSD drives so that I wouldn't have stagnant air. With 15 drives in the case none of the drives go over 90 degrees F. Pretty cool in that case for sure but I also have no more room for any more drives, which sucks. My have to sell this case and buy a Norco 20 or 24 bay.
March 2, 201610 yr May be better off searching eBay for a used Supermicro case (check for 2TB+ backplane issues). I saw some with dual 900W PSUs for $300-400 with CPUs, RAM and controller cards! Although, most of the controller cards were PCI-X... That said, apparently the Supermicro build quality is so much better than the Norco. As it stands, I'm not super stoked about my non hotswap Norco, supports ATX and above... but without removing the drive cages which isn't documented and a ton of screws it isn't easy to put it in or take out.
March 2, 201610 yr are those the Xi4 coolers? will ram fit in the first slots adjacent to the cooler or are they hampered by the cooler? They are NH-U12DX i4. Ram would fit in the first slots.
March 2, 201610 yr @MetDeath, I bought a used 4U supermicro case for my build and although it is well-built, the 5 80mm fans inside the case and the 2 40mm fans in each power supply are loud. I have a space under the stairs in the middle of my house where I want to put my server. However, the noise level is so high that if I put it there, I can hear it throughout the house. I am thinking about replacing the two supermicro power supplies with a standard ATX seasonic, and the 5 80mm fans with something quieter. It seems that SC846 series cases are not made to be quiet because system admins seem to think this is normal. If it is quieter than a hair dryer going full blast, they deem it to be quiet.
Archived
This topic is now archived and is closed to further replies.