Nanobug

Same issue for me, and the same fix. Version 7.3.1

I'll check on next reboot, just to be sure. I won't do it now though

Yeah, I can see that. But I'ver never enabled it on any servers. But I'll double check it on next boot. Changing C states and removing eco mode made it run for 2 days and 5 hours without issues. Thank you for helping out, both of you!

I don't run with XMP/DOCP/EXPO on my Unraid server at all. Never did. Thanks though So far it's at 31 hours, so it looks stable. But I'll give it tomorrow as well, just to be sure

So far so good. It haven't become unresponsive yet, and it just hit the 18 hours uptime mark. If this was the fix, it's really odd that it started becoming a problem 2 months after I upgraded it to 7.0.0 and the BIOS haven't been updated for quite some time.

I did have eco mode on my 5900X to save a bit of power. I don't need it to boost and all that, 12 cores is more than sufficient, and it's been running just fine for years until now. But I've disabled it now, and disablec the C state power savings. I'll let you know again in a day or two. Thank you so far!

At 4 AM CET it disconnected from the network. I'm pretty sure it's exactly at 4 AM, and that's oddly specific, but it could be a coincidence. I'll reboot it and get the diagnostics.

Tried a different bank now at a 3.X port, and so far it booted. I'll see if it stops working within the next 24 hours.

Just to try it in a different system, it's easiner in a VM for me.

Doesn't look like a RAM issue to me: I'll try a VM tomorrow, been a bit busy today. I'll let you know if it can boot on that

I've started the memtest now, I'll let it run for 24 hours and post the result. I'll try the other device afterwards, I think I've got an old NUC somewhere I can add it to, or just use a VM on my desktop and pass it through. I'll figure it out. I see I was a bit off on that. It's still powered on, but it's unresponsive in anyway. No SSH, no WebUI, even the local terminal is unresponsive. Network wise it also disconnects. I've tried 3 different USB ports, 2 of the USB2 and one of them USB3. I'll try another set as well, just to be sure. That'll be after the memtest since I've alreadt startarted it. I'll let you know tomorrow. Thanks so far guys!

I'm running Unraid 7.0.0 on it, and it's been running that for 2 months or so. Yesterday, I noticed the Unraid server was off, so I booted it and thought that was it. But this morning, it was down again, and I decieded to take a look. As the title says, it hangs on the "Verifying bzfirmware checksum". What I've done so far: Before I did anything, I copied all the files on the USB drive as a backup, just in case. Then I've verified the USB drive, which had errors accordingly to Windows when I checked it in that. After wards it reported no errors. The problem persisted. I tried this solution: Which worked, but was followed by a new error: rc.udev - Triggering udev events... Which I managed to fix by changing USB port. Later that evening, it crashed, and I checked the USB drive, and it had errors again, so I decided to replace it. It wasn't a new drive, but it didn't report any errors, so I went with it. I used Rufus to make it bootable, downloaded the zip files (decided to upgrade to 7.0.1 now that I'm at it), copied the files over and replaced the config files. Now, it's stuck on the "verifying bzfirmware checksum" again. I can't for the life of me figure out why I keep having issues. I'm starting to think there's a hardware error somewhere. Is there anyway I can see what the actual issue is?

There's a "Proxmox Backup Server" container that works even better

I wasn't sure, but thank you And sorry for my brainfart 😅

I missed a few words there 😅 When I exclude the disk and shrink the array, I guess my parity is going back normal, to take over if another disk fails then?

When I exclude shrink the array, I guess my parity is going back normal, to take over if another disk fails then?

Hello Unraid community, I wasn't able to find any on this, unless my Google Fu failed me. I've got a disk that died, that I'm not intending to replace, since I've got enough free space anyway. It's a 4 TB disk, and I've got more than 10 TB available disk space right now. Will I be able to move the data to other disks with a tool like Unbalance, or doing it manually in the terminal, and shrink the array afterwards?

Just for reference, this till works

Just wanted to give my experience with this. I haven't tested SMB, but I'm using 10 Gbit networking, which is fluctuating a bit, but for the most part, it runs above 8 Gbit out of 10 Gbit on iperf tests. I've enabled jumbo frames in my switch at 9000 MTU, and the same for the NIC in Unraid, and on the other server (Proxmox). Hardware used: Switch: USW EnterpriseXG 24 NIC: X540-T2 I'm sure there's room for improvements, but this is where I'm at right now.

Then I guess it's just how you understand the wording. Guess I'll upgrade the other switch and do 2 iPerf switch at the same time to see if I can get something along the lines of 2 x 10 Gbit then. Thank you

Thank you for the reply I agree. But Ubiquiti says differently on the Port Aggregation FAQ:

Hello, First of, I'm not entirely sure where the problem is, it might not even be on Unraid, so I'm posting all the information I can think of. I'm trying to setup LAG/LACP with 2 x 10 Gbit NIC. Some hardware information: CPU is 5900X in both servers. The NIC in each server is an Intel X540 T2. The switch is a USW-EnterpriseXG-24. I'm testing it between an Unraid server, and a VM in Proxmox. The VM has 4 CPU's and 8 GB of RAM, and only runs Speedtest and iPerf. I'm testing wit iPerf3. So far, Unraid has these settings on the NIC: # Generated settings: IFNAME[0]="br0" DHCP_KEEPRESOLV="yes" DNS_SERVER1="1.XXX.XXX.1" DNS_SERVER2="1.XXX.XXX.1" DHCP6_KEEPRESOLV="yes" BRNAME[0]="br0" BRNICS[0]="eth0" BRSTP[0]="no" BRFD[0]="0" PROTOCOL[0]="ipv4" USE_DHCP[0]="yes" USE_DHCP6[0]="yes" VLANID[0,1]="30" DESCRIPTION[0,1]="DMZ - 30" PROTOCOL[0,1]="ipv4" VLANID[0,2]="40" DESCRIPTION[0,2]="Storage - 40" PROTOCOL[0,2]="ipv4" VLANID[0,3]="50" DESCRIPTION[0,3]="Smart Home - 50" PROTOCOL[0,3]="ipv4" VLANID[0,4]="60" DESCRIPTION[0,4]="Surveilance - 60" PROTOCOL[0,4]="ipv4" VLANID[0,5]="70" DESCRIPTION[0,5]="Services - 70" PROTOCOL[0,5]="ipv4" VLANID[0,6]="100" DESCRIPTION[0,6]="Server - 100" PROTOCOL[0,6]="ipv4" VLANID[0,7]="200" DESCRIPTION[0,7]="North Hosting - 200" PROTOCOL[0,7]="ipv4" VLANS[0]="8" IFNAME[1]="br1" BONDNAME[1]="bond1" BONDING_MIIMON[1]="100" BRNAME[1]="br1" BRSTP[1]="no" BRFD[1]="0" DESCRIPTION[1]="10 Gbit aggregation" BONDING_MODE[1]="4" BONDNICS[1]="eth1 eth2" BRNICS[1]="bond1" PROTOCOL[1]="ipv4" USE_DHCP[1]="yes" MTU[1]="9000" DESCRIPTION[1,1]="DMZ - 30" VLANID[1,1]="30" PROTOCOL[1,1]="ipv4" DESCRIPTION[1,2]="Storage - 40" VLANID[1,2]="40" PROTOCOL[1,2]="ipv4" DESCRIPTION[1,3]="Smart Home - 50" VLANID[1,3]="50" PROTOCOL[1,3]="ipv4" DESCRIPTION[1,4]="Surveilance - 60" VLANID[1,4]="60" PROTOCOL[1,4]="ipv4" DESCRIPTION[1,5]="Services - 70" VLANID[1,5]="70" PROTOCOL[1,5]="ipv4" DESCRIPTION[1,6]="Server - 100" VLANID[1,6]="100" PROTOCOL[1,6]="ipv4" DESCRIPTION[1,7]="North Hosting - 200" VLANID[1,7]="200" PROTOCOL[1,7]="ipv4" VLANS[1]="8" SYSNICS="2" I've also added the diagnostics zip file. The Proxmox network settings: # Loopback interface auto lo iface lo inet loopback # enp7s0 interface with static IP auto enp7s0 #iface enp7s0 inet manual iface enp7s0 inet static address 10.0.20.3 netmask 255.255.255.0 gateway 10.0.20.1 # Bonding setup for enp8s0f0 and enp8s0f1 auto bond0 iface bond0 inet manual bond-slaves enp8s0f0 enp8s0f1 bond-miimon 100 bond-mode 802.3ad bond-xmit-hash-policy layer2-3 bond-lacp-rate 1 # vmbr1 using bond0 auto vmbr1 iface vmbr1 inet manual bridge-ports bond0 bridge-stp off bridge-fd 0 bridge-vlan-aware yes bridge-vids 2-4094 Along with ethtool -K <interface> lro on ifconfig <interface> mtu 9000 on both enp8s0f0 and enp8s0f1. The same settings are made on the VM, it just has a different IP. The vmbr1 is attatched to the VM within the vNIC. For the switch, I've attatched a screenshot of the settings: Only the jumbo frames have been enabled otherwise. No matter what I do, I get an iPerf test similar to this: I know I'm not supposed to get the full 20 Gbit, but I should be able to get ~2x that give or take. Accordingly to Ubiquiti, I should get more with aggregation enabled. https://help.ui.com/hc/en-us/articles/360007279753-Port-Aggregation-FAQs What I've tried so far: Disabling jumbo frames. Enabling/disabling the Large Receive Offload (LRO). Enabling/disabling TCP Segmentation Offload (TSO). Rebooting each device one at a time. iPerf setting with parallel streams (cores). iPerf setting with UDP. iPerf setting higher TCP window size. iPerf setting a longer time. iPerf setting Nagle's Algorithm disabled. iPerf setting with taskset to bind a specific core. Tried to look into the drivers for the NICs, but it seems like they were included in the kernels a while back. As mentioned in the begining, I'm not sure where the problems is exactly. Can someone check if it's correctly configured in Unraid at least? Maybe even the switch and Proxmox as well? storage-03-diagnostics-20240829-2251.zip

It was, and still is a really long fight with the retailer. But so far I've ordered another motherboard. Once I booted up the server, the disk showed up, I can browse and see that data in ther CLI at least, so I assume it's working. Thank you @JorgeB

Haven't forgotten this. I wanted to try this out in the same rotation as I changed the motherboard (I ran out of x16 PCIE slots on the old one), but the one I got, was DOA, so I'm in the process of RMA at the retailer now. I'll let you know when I know something. Thanks again@JorgeB

I'll try it later today and see if it works, and get back to you. Thanks