-
-
Unraid Random Reboots & Crashes on ZFS Array Start - Now Occurring with New SSDs Too
- Unraid Random Reboots & Crashes on ZFS Array Start - Now Occurring with New SSDs Too
For the past two months, my previously stable Unraid server (running fine for ~1 year) has been experiencing unexplained, sudden reboots. The key issues are: Random Reboots: The system reboots without warning, logs, or error messages. It behaves like a sudden power cut followed by an immediate restart. Array Failure: These reboots eventually led to the main array failing to start. ZFS Mirror Crash: Attempting to start the array (which includes a ZFS mirror pool of SSDs) causes the system to either reboot instantly or freeze completely indefinitely (observed when trying Safe Mode). Hardware Replacement Didn't Fix: Suspecting the SSDs, I backed up data, replaced both SSDs with new ones, and created a completely new configuration. The array started successfully initially. Problem Recurrence: Unfortunately, the sudden, unexplained reboot symptom has now occurred again even with the new hardware and configuration. The core problem persists: sudden, unlogged reboots, now happening even after replacing the SSDs and rebuilding the ZFS pool. bnas-diagnostics-20250727-1653.zipByronD changed their profile photo- Upload Speed Crashes to KB/s After 500~650MB - All Fixes Failed
Thank you for the suggestions. To address your requests: Network Environment: The NAS isn't on my local network - it's remotely accessed through a reverse proxy at a separate physical location. Consistent Reproduction Paths: The slowdown occurs identically when uploading via: UNRAID's native Simple File Manager Cloud applications (e.g. kodbox Tunnel) running in Docker containers Diagnostics Clarification Needed: While I can reproduce the issue on demand, could you advise how to properly capture diagnostics during active transfers?- Upload Speed Crashes to KB/s After 500~650MB - All Fixes Failed
Apologies for any confusion caused. To clarify: my earlier tests were conducted on directories within the array, but this wasn't meant to imply the array was the root cause. Following your suggestion, I've now tested pools and confirmed the same issue occurs there.- Upload Speed Crashes to KB/s After 500~650MB - All Fixes Failed
Thank you for the suggestions. I've also tested uploading to other pools - including those made of different HDD configurations and SSD pools - and observed the same behavior. The issue likely isn't specific to the array.- Upload Speed Crashes to KB/s After 500~650MB - All Fixes Failed
array. Once the speed drops to mere KB/s, it remains persistently slow. Normal high-speed upload capability only resumes after a period of time, allowing another 500~650MB upload before again reverting to KB/s speeds.- Upload Speed Crashes to KB/s After 500~650MB - All Fixes Failed
UNRAID: After uploading approximately 500~650MB, the speed drops to mere KB/s. Various troubleshooting methods have been attempted, but the issue persists consistently. The root cause remains unclear. Has anyone encountered similar issues? Guidance would be greatly appreciated. bnas-diagnostics-20250601-1037.zip- if the NIC on the motherboard can passthrough the VMs?
After troubleshooting and communicating with the motherboard manufacturer it was concluded that it was a firmware issue and the manufacturer is in the process of fixing it. For your information. 😃- if the NIC on the motherboard can passthrough the VMs?
Thanks for the tip! After some effort, the passthrough can now be set up, but the VM with passthrough NIC won't start and will report this error “internal error: Unknown PCI header type ‘127’ for device ‘0000:03:00.0’”. Here is the virtual machine configuration: <?xml version='1.0' encoding='UTF-8'?> <domain type='kvm'> <name>Linux</name> <uuid>30abee1c-47d7-18a9-f5f5-07c69370bcd5</uuid> <description>openwrt</description> <metadata> <vmtemplate xmlns="unraid" name="Linux" icon="linux.png" os="linux"/> </metadata> <memory unit='KiB'>524288</memory> <currentMemory unit='KiB'>524288</currentMemory> <memoryBacking> <nosharepages/> </memoryBacking> <vcpu placement='static'>20</vcpu> <cputune> <vcpupin vcpu='0' cpuset='0'/> <vcpupin vcpu='1' cpuset='1'/> <vcpupin vcpu='2' cpuset='2'/> <vcpupin vcpu='3' cpuset='3'/> <vcpupin vcpu='4' cpuset='4'/> <vcpupin vcpu='5' cpuset='5'/> <vcpupin vcpu='6' cpuset='6'/> <vcpupin vcpu='7' cpuset='7'/> <vcpupin vcpu='8' cpuset='8'/> <vcpupin vcpu='9' cpuset='9'/> <vcpupin vcpu='10' cpuset='10'/> <vcpupin vcpu='11' cpuset='11'/> <vcpupin vcpu='12' cpuset='12'/> <vcpupin vcpu='13' cpuset='13'/> <vcpupin vcpu='14' cpuset='14'/> <vcpupin vcpu='15' cpuset='15'/> <vcpupin vcpu='16' cpuset='16'/> <vcpupin vcpu='17' cpuset='17'/> <vcpupin vcpu='18' cpuset='18'/> <vcpupin vcpu='19' cpuset='19'/> </cputune> <os> <type arch='x86_64' machine='pc-q35-7.1'>hvm</type> </os> <features> <acpi/> <apic/> </features> <cpu mode='host-passthrough' check='none' migratable='on'> <topology sockets='1' dies='1' cores='10' threads='2'/> <cache mode='passthrough'/> </cpu> <clock offset='utc'> <timer name='rtc' tickpolicy='catchup'/> <timer name='pit' tickpolicy='delay'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/openwrt-23.05.3-x86-64-generic-squashfs-combined-efi.img'/> <target dev='hdc' bus='virtio'/> <serial>vdisk1</serial> <boot order='1'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x10'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x11'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x1'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0x12'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='4' port='0x13'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/> </controller> <controller type='pci' index='5' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='5' port='0x14'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/> </controller> <controller type='virtio-serial' index='0'> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <controller type='sata' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='usb' index='0' model='ich9-ehci1'> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <interface type='bridge'> <mac address='a8:b8:e0:03:d8:a1'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='pty'> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <channel type='unix'> <target type='virtio' name='org.qemu.guest_agent.0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <input type='tablet' bus='usb'> <address type='usb' bus='0' port='1'/> </input> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <graphics type='vnc' port='-1' autoport='yes' websocket='-1' listen='0.0.0.0' keymap='en-us'> <listen type='address' address='0.0.0.0'/> </graphics> <audio id='1' type='none'/> <video> <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/> </video> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/> </hostdev> <memballoon model='none'/> </devices> </domain> Thanks again, guys. bnas-diagnostics-20240603-0058.zip- if the NIC on the motherboard can passthrough the VMs?
I have been trying to passthrough a NIC to my VMs. For some reason I cannot select the NIC interfaces under system devices as the check boxes are greyed out and state "in use by Unraid". - The virtualization options are turned on. - Configuration in syslinux.cfg "vfio-pci.ids=8086:125c" or "pci-stub.ids=8086:125c" - lspci -s 03:00.0 -vvv | grep Capabilities Capabilities: [40] Power Management version 3 Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+ Capabilities: [70] MSI-X: Enable+ Count=5 Masked- Capabilities: [a0] Express (v2) Endpoint, MSI 00 Capabilities: [100 v2] Advanced Error Reporting Capabilities: [140 v1] Device Serial Number a8-b8-e0-ff-ff-03-d8-a1 Capabilities: [1c0 v1] Latency Tolerance Reporting Capabilities: [1f0 v1] Precision Time Measurement Capabilities: [1e0 v1] L1 PM Substates SR-IOV doesn't seem to be supported!!! Hopefully the fellows who know about all this can give me some help. - Unraid Random Reboots & Crashes on ZFS Array Start - Now Occurring with New SSDs Too