Unraid Server freezes randomly (SOLVED)

[offroadnut]

My Unraid server which is basic has been put together for just over two months and I have been fighting several issues, I finally got the MB temp alarm to stop hitting 100 deg by replacing tape under heat sinks and adding fans and getting through preclear with out locking up the server. Now the last issue is the server randomly locks up or freezes, this happens random times, people on plex or not. I've removed all dockers and reinstalled different dockers (Plex, Sonarr, Radarr, SAB, Pi Hole, Unifi Controller) and still does it I'm pulling my hair out and not sure what to do. Any assistance is greatly appreciated

 

Fractal node 804

Supermicro C7Z97-M-O Motherboard

Intel Core I7 4790K CPU

Corsair Vengence 1600 MH memory 32GB 4x8

EVGA 650SF power supply

4 WD shucked 8TB drives

2 WD Blue SSD drives 500GB (cache and Plex Cache)

offroadnut-diagnostics-20210825-1902(2).zip

Edited October 15, 2021 by offroadnut

[offroadnut]

Forgot to add I'm running Unraid version 6.9.2

[offroadnut]

Bumping for ideas, not liking having to power switch the server once a week when it locks up for unknown reasons.

[JorgeB]

Enable syslog server and post that log after a crash.

[offroadnut]

JorgeB,

 

 If I did it correctly the log above is from when i set it to mirror to flash? If not what you want/need let me know.

[ChatNoir]

The log mirrored to flash is not included in the diagnostics that only focuses on what is on RAM.

 

You need to grab the logfile from the flashdrive.

[offroadnut]

Ok thank you, I checked the server this morning and it crashed again, this is from the flash drive after I restarted the server.

syslog(1)

[JorgeB]

Nothing logged before the crash, this usually points to a hardware issue.

[Tristankin]

Also try downgrading to 6.8.3, 6.9.x caused random freezes for me every 1-2 days and I now have 60 day uptime on 6.8.3. I think the 6.9.x issue is intel specific.

[offroadnut]

So server froze up again this morning and had to reset the power, need to figure this out. I do not have any spare parts to swap out, all parts were bought and used in the build. I can run a mem test although I don't think it is that. The initial unraid version I bought was 6.9.2, being new to building computers I don't know how to change version to 6.8.3

syslog(2)

[Tristankin]

32 minutes ago, offroadnut said:

So server froze up again this morning and had to reset the power, need to figure this out. I do not have any spare parts to swap out, all parts were bought and used in the build. I can run a mem test although I don't think it is that. The initial unraid version I bought was 6.9.2, being new to building computers I don't know how to change version to 6.8.3

 

From memory I just had to replace everything outside of the config folder with the zip file contents. Make a backup of your usb drive first.

You may need to redo your cache drives as part of the downgrade so make sure nothing is set to only be on the cache.

Edited September 29, 2021 by Tristankin
clarification

[offroadnut]

Woke up this morning to my server frozen and unresponsive again after only back on for a day and half. I had ran memtest and no errors were found all pass. Getting frustrated with this, my old freenas box is still running no issues. I really like the Unraid system but wondering if I made a mistake in buying these parts and building Unraid server if it can't be reliable. Mew Logs attached, hopefully there is something in them, any help greatly appreciated.

offroadnut-diagnostics-20211002-0659.zip syslog(3)

[offroadnut]

bump, anybody able to help on this?

 

[JorgeB]

6 hours ago, offroadnut said:

anybody able to help on this?

Not without anything relevant logged before the crash like mentioned this is usually a hardware problem, one thing you can try it to boot the server in safe mode with all docker/VMs disable, let it run as a basic NAS for a few days, if it still crashes it's likely a hardware problem, if it doesn't start turning on the other services one by one.

[offroadnut]

Thank you, I will run it safe with all Dockers and VMs off and see what happens. It froze early this morning again. The Motherboard, PSU, and Memory were all new, CPU is used but we have pulled it and checked pins, it was working fine before he gave it to me. Unfortunately this was my first build of a computer (had help from friend) so I don't have spare parts to through at it. I restarted my freenas box so at least i'll have plex and live tv till this gets fixed.

offroadnut-diagnostics-20211003-0749.zip syslog(5)

[offroadnut]

So I thought I might have had this fixed but apparently not. I ran it a few days with all dockers deleted making it just a NAS. I was able to use VLC to watch my movies, no freezes or lock ups the few days like this. then i installed one docker, PiHole. it ran for a few days with no issues. Earlier today I installed binhex plex using default docker settings, while setting up the library the server froze up. couldn't even access it via IPMI. Not sure what happened, I looked at the attached logs but i'm not sure what i'm looking at with this stuff. Any help greatly appreciated.

syslog(6) offroadnut-diagnostics-20211008-1527.zip

[JorgeB]

Again nothing relevant logged before the crash.

[offroadnut]

Then i'm not sure what to do next or how to fix this?

[JorgeB]

If it's a hardware issue it's not easy to diagnose remotely, basically you'd need to smart swapping some parts around.

[offroadnut]

So I think I solved it, been running 3 days straight, I went back in bios and there is a setting I didn't understand that was defaulted to "suspend to RAM" I disabled that and seems to be running fine with PiHole, Plexx, and Unifi controller running.