October 14, 201510 yr Author Hahahah @ snoring comments Well, I don't want to jinx it but I think it should be damn quiet. I have built many computers over the years and I ONLY use noctua fans, I cannot tolerate noisy things, i simply can't. My other computers, if you put the ear to them you cannot tell if they are on. On my Fractal Define R4 air cooled build, the loudest things are the videocards if you're playing the game or something, that's because I didn't bother swapping out the coolers. On the HTPC... well it's water cooled and silent, fans don't spin up higher than 900rpm, and at 900 they are silent. Both of those have SSDs though. My synology nas DS1812+ you can hear the fans(non noctua) and HDDS when seeking, I wouldn't put it in my bedroom So I am expecting this new build to be completely silent, except for when the drives are seeking, the only thing I am not sure about is the 80mm noctua fans, i've never used them.
October 14, 201510 yr I had one of the stock norco fans die on me within the first couple months of owning it. I installed these noctua fans and it's VERY quiet. As in I could sleep next to it. And that's even with the fans spinning 100%. I still keep it in the basement because that's where I have my server rack but I could keep it in the living room if I wanted to. It's quiet. 3 x Noctua NF-F12 PWM 120mm 2 x Noctua NF-R8 PWM 80mm
October 14, 201510 yr Interesting that the Noctua fans are that quiet -- definitely nice to know. I'd think that with a bank of them large enough to cool the 24-bay Norco the collective noise would be noticeable ... but apparently not.
October 14, 201510 yr Yeah, I was pretty surprised too. It's like night and day difference compared to the stock fans. I have 15 4TB wd reds in the case so far and they rarely get much over 30C unless i'm doing a parity check.
October 14, 201510 yr Author oh oh... I am in trouble it seems that the CPU cooler is not compatible with this mobo!? what gives!? It seems that the area designated marked area is narrower and the bracket kinda overlays some of the components. Cooler is NH-U9B SE2 http://i.imgur.com/mLlrBx3.jpg[/img] http://i.imgur.com/RmATB69.jpg[/img] This is a first! I emailed Noctua to see what's going on, this is strange!
October 14, 201510 yr That's a hell of a heat sink/cooler for a processor you're not going to be overclocking anyway. If it was me I'd send it back and use the stock intel cooler that came with your CPU.
October 14, 201510 yr Author That's a hell of a heat sink/cooler for a processor you're not going to be overclocking anyway. If it was me I'd send it back and use the stock intel cooler that came with your CPU. Stock cooler is way too loud, I am obsessed with quiet
October 14, 201510 yr That's a hell of a heat sink/cooler for a processor you're not going to be overclocking anyway. If it was me I'd send it back and use the stock intel cooler that came with your CPU. Stock cooler is way too loud, I am obsessed with quiet Gotcha. I don't know what to tell you if the holes don't line up on that bracket.
October 14, 201510 yr Author Holes line up perfectly, it's just on bottom right the rubbery part of the bracket sits on top of some tiny components of the back of the board, and I have no idea if pressure of the bracket can damage the board.
October 14, 201510 yr Author Anywho, I returned it to Amazon, and ordered another newer model of this fan (NH-U9S), newer model seems to have a better narrower bracket. Will see how that goes. In regards to overclocking and overkill fan, this fan will allow fans to spin at much lower rpm and still keeping the CPU nice and cool even if I will be using plex server etc... At the same time the heat from HDDS will be coming into the main chamber which has to be taken into account. So big heatsink + low RPM fans = still nice and cool + longer component live. In any case this fan looks stupidly tiny compared to Noctua NH-D14 which I have in my main gaming rig
October 14, 201510 yr Holes line up perfectly, it's just on bottom right the rubbery part of the bracket sits on top of some tiny components of the back of the board, and I have no idea if pressure of the bracket can damage the board. I doubt it would matter, but it certainly doesn't hurt to replace it with one that doesn't have the issue.
October 15, 201510 yr Author So I booted the system up and it's indeed DEAD silent with the exception of stock CPU cooler. I did run into another issue with supermicro ipmi and had to reconfigure fan thresholds because they kept spinning up and down (very annoying) because the thresholds were set to about 400rpm and fans were spinning at ~ 300. I am hoping I would be able to control the fans properly with some sort of script from unraid based on HDD temperature. Also how does one set CPU fan speeds? Another thing motherboard did come with IR firmware for the raid controller so I flashed it to IT mode.
October 15, 201510 yr I did run into another issue with supermicro ipmi and had to reconfigure fan thresholds because they kept spinning up and down (very annoying) because the thresholds were set to about 400rpm and fans were spinning at ~ 300. Can you elaborate on this? The fans in my case sound like they are cycling fast/slow. They are 4-pin fans with PWM connected to my SuperMicro X10SL7-F.
October 15, 201510 yr Author I did run into another issue with supermicro ipmi and had to reconfigure fan thresholds because they kept spinning up and down (very annoying) because the thresholds were set to about 400rpm and fans were spinning at ~ 300. Can you elaborate on this? The fans in my case sound like they are cycling fast/slow. They are 4-pin fans with PWM connected to my SM S10XL7-F. I knew something was wrong when fans were doing their funny thing. Login into IPMI interface via web and check sensors/logs/health page thing you do will see that fans in question show red/orange thing next to them. You can also show threshold to know what current limits are. You can adjust the values like described in this post I had a spare linux vm so that was easy. https://calvin.me/quick-how-to-decrease-ipmi-fan-threshold/
October 16, 201510 yr Author Wow... lots of adventures here I ran into big trouble booting the system with m1015 controllers installed... So I insert two cards in try to boot and get this error message: mpt bios fault 01h encountered at adapter pci (01h 00h 00h) http://i.imgur.com/Q73zclA.png[/img] I can still go into the SAS config but I wont see the onboard controller anymore: (note on this pic i only had one card inserted not two, in case of two cards i see both) http://i.imgur.com/4BNSTNF.png[/img] Now If I remove the cards then I see onboard controller: http://i.imgur.com/pjnPyNy.png[/img] I contacted Supermicro support and so far they have been super nice. The contact gave me new firmware for LSI controller PH20 to match my m1015s but that didnt solve the issue. I have received new bios for the mobo from support afterwards but I wasnt able to reflash the mobo, not sure why. Meanwhile after much tinkering in the bios I got this working:.... Maybe... not sure if I screwed something up or not. http://i.imgur.com/IOGEQBK.png[/img] What I did was: I went to PCIE config and changed CPU SLOT6 GEN X to Gen2 (m1015 is gen 2 apparently) This got rid of the error 01h.... http://i.imgur.com/OHbv5sw.png[/img] Then in order to get all 3 controllers to show up I had to disable onboard SAS OPROM option as well as SLOT6 and SLOT5 oprom options: http://i.imgur.com/MSsC1in.png[/img] So.... I have no idea what I did... My guess is that SM was not detecting the speed of PCIE for the cards properly? Also I disable booting from optionroms? but the funny thing is that it still boots using OPROM... weird... I replied to the SM guy and I will see what they say. Reason I wanted option rom is to have staggered startup of HDDS on power on, but I guess it doesnt matter with unraid since when you start array it still spins up all drives at once? Maybe it's better to disable/reflash all cards without option rom? Anyway right now I am doing preclear on all 7 disks I have and it's going at 185MB/s... after 12 hours it's only on step2 (42%) of 10 on 5TB drives
October 16, 201510 yr With a single OPROM, you should be able to configure settings for all your adapters. When you start the array, the drives should already be spinning, having been staggered up during the POST. Thanks for detailing this, as I am sure others will follow and find themselves in the same place.
October 16, 201510 yr Author With a single OPROM, you should be able to configure settings for all your adapters. When you start the array, the drives should already be spinning, having been staggered up during the POST. Thanks for detailing this, as I am sure others will follow and find themselves in the same place. That's what I figured, but if we go by bios settings all oproms should be disabled But it appears not to be the case I guess once the hdds are done preclearing I will do more tests... maybe I will flash m1015 to JUST IT with no oprom and see if I can still control them with onboard one.
October 16, 201510 yr I've got basicly the same setup as you and was getting the same error message. I had to flash all 3 controllers again without boot roms or it wouldn't play nice. Just disabling them isn't enough. Apparently LSI 2308 doesn't want to peacfully coexist with 2008 controllers with the roms active. I was getting bios hangs and all kinds of crap. Once you get rid of all the roms everything's good.
October 16, 201510 yr Author I've got basicly the same setup as you and was getting the same error message. I had to flash all 3 controllers again without boot roms or it wouldn't play nice. Just disabling them isn't enough. Apparently LSI 2308 doesn't want to peacfully coexist with 2008 controllers with the roms active. I was getting bios hangs and all kinds of crap. Once you get rid of all the roms everything's good. That's so cool! Same setup Muahahhaha I "fixed" it somehow..... I want a rock solid system, I guess I will see what's going on after I preclear those drives, I have no idea how long it takes. I am still in contact with SM, TUMS what bios version do you have? I have 3.0. Did you check your setting for GEN X for the m1015? By the way, how do you control your fans based on HDD temperature?
October 16, 201510 yr Author Regarding fans, I installed Fan Auto Control plugin but it wouldnt detect PWM controller, untill I ran modprobe ipmi-si modprobe coretemp modprobe w83627ehf but now it seems this plugin doesnt use HDD temperature as a value. Does anyone know what sensor it uses?
October 16, 201510 yr I've got basicly the same setup as you and was getting the same error message. I had to flash all 3 controllers again without boot roms or it wouldn't play nice. Just disabling them isn't enough. Apparently LSI 2308 doesn't want to peacfully coexist with 2008 controllers with the roms active. I was getting bios hangs and all kinds of crap. Once you get rid of all the roms everything's good. That's so cool! Same setup Muahahhaha I "fixed" it somehow..... I want a rock solid system, I guess I will see what's going on after I preclear those drives, I have no idea how long it takes. I am still in contact with SM, TUMS what bios version do you have? I have 3.0. Did you check your setting for GEN X for the m1015? By the way, how do you control your fans based on HDD temperature? Running 3.0 bios, AFAIK it's the latest. As far as fans I haven't really messed with them I just leave them at 100%. If they die a little sooner no biggie. I tried changing it to gen2 in the bios and the 01h error still didn't go away until I re-flashed and totally got rid of the boot roms.
October 17, 201510 yr Author Man this thing is slow!!! ================================================================== 1.15 = unRAID server Pre-Clear disk /dev/sdb = cycle 1 of 1, partition start on sector 1 = Disk Pre-Clear-Read completed DONE = Step 1 of 10 - Copying zeros to first 2048k bytes DONE = Step 2 of 10 - Copying zeros to remainder of disk to clear it DONE = Step 3 of 10 - Disk is now cleared from MBR onward. DONE = Step 4 of 10 - Clearing MBR bytes for partition 2,3 & 4 DONE = Step 5 of 10 - Clearing MBR code area DONE = Step 6 of 10 - Setting MBR signature bytes DONE = Step 7 of 10 - Setting partition 1 to precleared state DONE = Step 8 of 10 - Notifying kernel we changed the partitioning DONE = Step 9 of 10 - Creating the /dev/disk/by* entries DONE = Step 10 of 10 - Verifying if the MBR is cleared. DONE = Post-Read in progress: 84% complete. ( 4,242,499,788,800 of 5,000,981,078,016 bytes read ) 115 MB/s Disk Temperature: 31C, Elapsed Time: 36:43:32
October 18, 201510 yr Author I have made some progress and almost done with this build. Things I have learned: 1. After reflashing both of m1015s to IT mode without option rom, i learned that that didn't matter and the culprit is onboard option rom/card. It's dumb the moment you enable onboard option rom it kills one or both of m1015s. So if you do want to run option rom then you have to disable onboard one and then boot from m1015 one. Meh... whatever... 2. Supermicro Mobo temperature control features are a BITCH, you can't do much at all.... things I have learned here: * SM Sets fan rpm wat too low and fans by default are spinning at 300RPM which can kill some of your components. * FANS1-4 Are controlled by supermicro using CPU temperature... badly..... I almost fried my CPU by running prime95 to see if fans spin up temps went up to 60C. * Another thing is that the temperature thresholds on CPU sensor on SM are set to 100C WTF!? * If you do want to control your temperatures and set fan curves you gotta use fancontrol package. <-- this works really well, I have no idea why noone has made plugin for unraid yet.... maybe I will... for now I am starting it in /boot/go file by myself. * FANA on SM motherboard is separate and controlled by separate PWM controller which is awesome for HDD fan array. * I realized that dynamix plugin autofan is actually based on HDD temperatures and NOT "system"/mobo temperatures as it says so in description. what gives? * this system IS bedroom silent Things to take away from this Use good quality fans If using Supermicro Motherboard, install LM-Sensors package and use fancontrol to control your CPU fan and your Back fan (FAN1-4) are all tied to single PWM controller Hook up fan array to FANA, and use dynamix autofan plugin to control those fans Lower IPMI CPU threshold to realistic temperatures to actually get alerts if something does go wrong with CPU fan. Put FAN IPMI thresholds to 0 or something lower than your fan control software, so you dont get that annoying spinup/spin down cycle from SM, if your fans will start to fail that threshold will try to spin fans up(and will send you email) which is cool. Disable onboard SAS option rom Set m1015 pcie speed to GEN 2 Changed CPU heatsink with newer version of Noctua fan, it fits perfectly on the back of the motherboard, I guess they did revise their mounting brackets. http://i.imgur.com/2j8AZl8.jpg[/img] trying to get rid of mess of the cables http://i.imgur.com/d8eshFa.jpg[/img] http://i.imgur.com/b4DEEUx.jpg[/img] http://i.imgur.com/R7sjTpL.jpg[/img] I still have to get the last power cable then I will hook up the last backplane. http://i.imgur.com/B1zHuC6.jpg[/img]
October 18, 201510 yr Bravo! Looks good. One thing I did was put the 120mm fans on the other side of the fan wall so I had more room get my hands in to work on the backplanes, etc. Looks good though. I'm sure you'll love it. Did you end up disabling all your SAS Roms or are you keeping one of the M1015 Roms active?
October 18, 201510 yr Author Heh regarding fans, I figured an awesome way to move the wall out so it's not a problem to work on stuff You just unscrew the sides and bottom and move the wall back and forth as needed. For SAS roms current config is: 2x m1015 reflashed to PH20 without OPTION ROM [/size]Builtin SAS card flashed to PH20 including option ROM, i didnt want to mess with that. [/size]In bios stuff is set to GEN2 [/size]Option ROM for builtin SAS - Disabled.
Archived
This topic is now archived and is closed to further replies.