Unsealed0019

Swapped the motherboard - that wasn't it. Swapped the CPU and could then boot anything under the sun again.

PassMark Memtest passed 100% no errors - booted without issue. Booting from a restored backup USB drive (brand new drive) runs into same boot failure (won't get past Loading /bzroot... OK) - USB devices turn off after and system hangs. New USB sticks show exact same symptoms (Unraid or Ubuntu). After removing all GPUs, reverting memory to some older sticks, unplugging power to hard drive cages, behavior is still about the same. After a CMOS reset, CSM would remain enabled - motherboard strangeness after bios update. Seems like I need a new motherboard or PSU but the PSU swap in the past didn't resolve the issue and only by tweaking some BIOS power settings did the issue temporarily go away (about a year).

I’ve hit a new wall in troubleshooting: Memory: I pulled 2 RAM sticks (down to 64 GB, 2×32 GB). With this setup, the system won’t boot at all. I cannot run the bundled Unraid memtest (it freezes at “Loading... /something OK”). Currently running PassMark MemTest86 instead (UEFI), since at least that one launches. Boot behavior: Attempting to boot Unraid from the flash now also freezes during startup (USB devices shut off, must hard reset). Safe mode resets on it's own. Normal mode hangs at the boot menu screen, which feels less like an OS/driver issue and more like a hardware or flash media issue. Flash drive suspicion: Plugging the Unraid USB stick into a Windows machine triggers “errors detected, scan and fix”. This makes me suspect the flash drive may be at least part of the problem, though as you mentioned this is also likely to happen from unclean shutdowns. BIOS: I restored to optimized defaults and only made a couple of edits: Typical Current Idle Enabled SVM and IOMMU Secure Boot off Will let memtest go for a while then will try booting the new USB drive. I do have some older smaller memory sticks I could revert back to just to outright rule out the current sticks.

If, when I plug it into a windows PC, it says 'errors detected, scan and fix' would that then indicate an issue and should I perform that action?

Thanks JorgeB - I will try that. I'm not sure how to tell which hardware component would be most likely to be having the problem. I'm leaning towards replacing the memory first but would likely get ECC this time which also requires a different CPU anyway. One other thing I forgot to mention is that when I had Tips and Tweaks installed, it did not show there being a CPU governor, which I wasn't sure if it was because of the BIOS tweaks or a software issue that could be resolved. This System Driver is not present on the crashing server: acpi_cpufreq (ACPI Processor P-States Driver) : cpufreq What is the likelihood this is a failing USB Flash drive - can I test for that?

Hi all, I'm at my whits end after spending an entire day troubleshooting this with ChatGPT and other resources. I’m running into recurring stability issues with my Unraid server that I can’t seem to pin down. The system will randomly crash or reset without leaving anything useful in the syslogs. Crashes can happen hours apart, days, or even weeks—it’s very inconsistent. I have another Unraid server set to receive the logs and it just cuts off prior to the crash. This started happening again about a week or two ago. Around that time, I had added a new Docker container and disabled another, but otherwise made very few changes. I already tried disabling the new container, but the crashes continue. A bit of history: About a year ago, I had the exact same problem (random crashing, no logs). I replaced the PSU at that time, but it didn’t solve it. I then adjusted some BIOS settings to avoid AMD CPU C-state and power idle issues, updated the BIOS, and added another fan to bring cooler air into the room. After making those changes, the problem went away for quite a while. Fast-forward to now, the random crashes are back. I swapped in another PSU again just to rule it out, but no improvement. So far, the system just drops dead with no warning and nothing in the logs. I’m trying to determine if this is hardware-related (CPU, RAM, motherboard, etc.), BIOS/firmware settings, or something within Unraid/Docker that’s triggering instability. BIOS Settings I’ve Adjusted (for stability) Since this seems to be hardware/firmware related, here are the BIOS settings I’ve already reviewed or changed while troubleshooting: CPU / Power Management: Disabled Global C-States and set Power Idle Control to a non-low power mode (to avoid Ryzen deep idle bugs). Disabled Core Performance Boost for stability (trading performance for consistency). Disabled CPU Watchdog Timer (server was crashing even with it off). Memory / DRAM: Enabled/disabled Power Down Enable (tried both). Left Gear Down Mode and Cmd2T at Auto for compatibility. Experimented with DRAM refresh modes and scrubber controls (kept mostly on Auto to avoid instability). XMP/DOCP profile currently disabled (running JEDEC defaults for max stability). Interconnect / DF Options: Tweaked Memory Interleaving and related settings (left at Auto eventually). Disabled DF Sync Flood Propagation (to prevent cascading errors). Left DF C-States mostly disabled for consistency. PCIe / GPU / IOMMU: PCIe ASPM Mode set to Disabled (to prevent link power management from destabilizing GPUs). Using multiple GPUs (WX5100 passthrough (VFIO), plus iGPU & WX2100 for Dockers) - stopped using WX2100 and only using iGPU, VM using WX5100 stopped UMA Frame Buffer Size set manually to avoid auto-adjustment issues (1G). Security / Virtualization: TSME (Transparent Secure Memory Encryption) disabled (or default, I forget but didn't matter). SEV / SEV-ES options left off. CSM (Compatibility Support Module) can’t be enabled anymore after BIOS update (seems forced UEFI). Secure Boot disabled. Misc / Timers: High Precision Event Timer (HPET): currently disabled. Power Loading: enabled to stabilize low-power PSU states (Typical Current). Spread Spectrum: disabled (to avoid clock modulation issues). Other Notes: System previously stable after disabling C-states and forcing power idle workarounds. Crashes now occur regardless of these settings. System Specs Motherboard: Gigabyte X570 AORUS ULTRA (latest BIOS, F39g) CPU: AMD Ryzen 7 5700G with Radeon Graphics @ 3800 MHz (with iGPU – Cezanne Vega) Memory: 128 GB non-ECC (running at JEDEC defaults, XMP off) GPUs: AMD Radeon WX 5100 (passthrough to VM) AMD Radeon WX 2100 (Docker use / compute) Integrated GPU (Cezanne Vega, used for Docker/host tasks) PSU: Recently replaced (Seasonic 800W) Cooling: Added extra intake fan for airflow in server room (which was part of the year-ago effort) Boot: Unraid on USB flash, UEFI-only (CSM disabled by firmware), Secure Boot off It may or may not be related to running a separate Ubuntu VM, which is currently shut down, and I am waiting to see if it crashes. Has anyone else experienced this pattern of random, log-less crashes on Unraid, especially with AMD platforms? What would be the most systematic way to isolate the cause? Thanks in advance for any ideas or troubleshooting steps I might have missed.

I'm running into the same general symptoms and issue (random crashing without anything useful in the syslogs - could be hours apart, days, or weeks)... Started happening out of the blue again about a week or two ago. I had added a new docker and turned off another, but other than that very few changes. Of course I tried disabling the new docker but that didn't make a difference. I already replaced the PSU and it made no difference. About a year ago, I was having the same issue, which is when I replaced the PSU but since that wasn't it, I also tweaked some BIOS settings to force the AMD CPU to not have c-states, or power idle issues, etc. I also updated the BIOS, and put in another fan for the room to pull in some cooler air. The issue went away after a number of changes but I know it crashed after the PSU swap.

I can try different USB ports but there's been a recent regression as far as I can tell. Several versions ago this wasn't an issue (or several versions of the plugin ago). Not the controller(s) but a few individual devices, yes. Those are successfully being passed and many preclears have been successful without this issue. I've been able to successfully preclear drives this with non-UASP enclosures a dozen times or so but the past several versions of UNRAID seem to have made this more problematic. Perhaps related but at least one time the unassigned devices plugin dropped nfs/smb shares and needed a reboot. The plugin itself may be part of the issue here.

Ok I got one with that feature and it's the same situation... any ideas?

Alright, confirmed both of mine do not have that.

Same issue as well, tried two different USB 3.0 external drive enclosures. Rebooting gets it working again but then eventually detection fails.

Thirded - it would be awesome if there was a simple way after doing "Stop All" to do "Start All" (which were set to auto start).

I did not! That was it, thanks

I'm on 6.12.3 but cannot see this option to launch remote-viewer - where are they located?

They are updated Ubuntu systems running v4 Checked with nfsstat -s & nfsstat -c Some extra info: UNRAID is NFS server Ubuntu bare metal is one client (haven't actually tested deleting from here, no cause of crash to my knowledge) Ubuntu UNRAID VM is another client (this seems to be where I see the issues the most with deletes and what not) I use UD SMB mounts (no NFS for UD) The bare metal system was seeing stale file handle issues (all NFS clients were) but that issue is passed now.