Hey guys and gals,

 

Just wondering what would be the first thing to look at. I've been dealing with this issue on Unraid for a few months now.  About every 2-3 weeks, Plex and all my other containers will stop working, and in my docker tab, everything is stopped.

 

When I try to manually Restart the containers, I'm met with a 403 error. I stop the array, and then when my disks refresh and populate, I notice that my 2TB Samsung 980 PRO Cache drive is now missing (why the 403 error is happening no doubt).

 

I do a server reboot, and the cache drive is still missing.  The only thing that gets it to show back up is a complete Power Cycle of the server. I turn it off, and turn it back on, and the Cache Drive is recognized again, and I can start the array and all my Containers work as they should.

 

I would really like to get to the bottom of why the server is doing this, so any help would be appreciated.  I'm just not sure what to try first.

 

I didn't think to grab the diagnostics after this happened, but I did grab the diagnostics after the first reboot, when I noticed the cache drive was still missing, and the current diagnostics on startup after I completely Power Cycled the server.

 

File system on all my Hard drives are xfs, my cache drive is setup as btrfs.

 

Specs:

Asus Pro WS W680-ACE Motherboard

Intel 14700k

128GB DDR5 Kingston ECC Memory

1600 Watt EVGA Titanium PSU

2TB Samsung 980 Pro Cache Drive

24 WD Red Hard drives of various sizes

 

Containers:

Plex (linuxserver)

Radarr

Sonarr

Overseerr

Binhex-Sabnzbd

Binhex-Qbittorrentvpn

Tautulli

 

I did increase my docker img size to 50gb, to see if that would solve the issue, but that didn't seem to work.  That's all that I have tried so far.

 

Any help is appreciated.  Just trying to figure out where to look first.

tower-diagnostics-20240225-1659 (2).zip

Edited February 25, 20242 yr by investing-tote3683
Added more info.

12 hours ago, investing-tote3683 said:

I didn't think to grab the diagnostics after this happened

Post those next time it happens.

Ok, thank you.

 

I will remember to post the diagnostics when this happens again!  See ya in a couple weeks lol.

Ok, well it was less than a couple weeks.  

 

It happened faster this time around.  Here are the logs I pulled after it happened, and before I powered down the server.

 

Same thing happened as before.  Cache Drive disappeared again, and I had to power off the server completely to get it to show back up again.

 

Thanks for all your help.

syslog.txt

NVMe device dropped offline, make sure it's well seated and/or try a different m.2 slot if available, you can also try this, on the main GUI page click on the flash drive, scroll down to "Syslinux Configuration", make sure it's set to "menu view" (top right) and add this to your default boot option, after "append initrd=/bzroot"

nvme_core.default_ps_max_latency_us=0 pcie_aspm=off

e.g.:

append initrd=/bzroot nvme_core.default_ps_max_latency_us=0 pcie_aspm=off

Reboot and see if it makes a difference.