Unraid Web GUI freezes Goes Offline Randomly Then Comes Back Responsive Again

[becksworth]

I recently moved my server into a closet. It was working fine beforehand. I simply moved it five feet from where it was sitting. Now since I moved it, the web gui has been locking up randomly. When it locks up I cannot access the Web GUI or any dockers. Then it comes back randomly, I log back in and everything works again for a couple minutes. Then the process repeats. It seems to lock up when I am doing tasks, such as starting up dockers. Transferring with filezilla etc. My setup is pretty simple, with 8 drives and 4 dockers running. No VMs.

 

I upgraded to 6.8.2, thought that was the problem so downgraded back to 6.8.1 and it still happens. I swapped with another mobo I had laying around and it still happens. I switched ethernet cords and rebooted my router and same results. Any ideas?

[Squid]

You should post your diagnostics showing this behaviour

[becksworth]

2 hours ago, Squid said:

You should post your diagnostics showing this behaviour

What diagnostics am I looking for? Sorry I am pretty new at this!

[Squid]

Tools, diagnostics

 

Post entire zip file

[becksworth]

3 hours ago, Squid said:

Tools, diagnostics

 

Post entire zip file

Here's the zip file for the diagnostics I ran. Thank you!

 

 

tower-diagnostics-20200226-0751.zip

Edited February 26, 2020 by becksworth

[sdamaged]

Lol the single diagnostics zip would have sufficed... It contains all of the above

 

Did you say you were copying files when this happened?  I've raised a bug report for the same thing.  System locks up and freezes, dockers stop working when copying files to the server cache

 

Not sure if related...

 

EDIT - Lots of CRC errors on ata4: SError: { UnrecovData 10B8B BadCRC }

 

Possible bad drive or cable.

 

 

Edited February 26, 2020 by sdamaged

[becksworth]

7 minutes ago, sdamaged said:

Lol the single diagnostics zip would have sufficed... It contains all of the above

 

Did you say you were copying files when this happened?  I've raised a bug report for the same thing.  System locks up and freezes, dockers stop working when copying files to the server cache

 

Not sure if related...

Haha yeah sorry. It's fixed now, just the zip file. Yep, it happens when trying to download files from filezilla. But it also locks up on my randomly just browsing around the gui. This just started happening to me once I moved my server to my downstairs closet last week. Before that it was solid.

[sdamaged]

Hmm i think maybe moving the server has knocked the cable or the drive

 

Seeing some UDMA CRC Errors on the drive - SAMSUNG_HD204UI_S2H7J90B713375-20200226-0751 disk4 (sde)

 

 ata4: SError: { UnrecovData HostInt 10B8B BadCRC }

 

I would turn it off, open it up and check all cables and connections.  The drive is also 3.8 years old, so possibly on its way out - just something to think about

Edited February 26, 2020 by sdamaged

[becksworth]

1 minute ago, sdamaged said:

Hmm i think maybe moving the server has knocked the cable or the drive

 

Seeing some UDMA CRC Errors on the drive - SAMSUNG_HD204UI_S2H7J90B713375-20200226-0751 disk4 (sde)

 

I would turn it off, open it up and check all cables and connections

That's the thing. I swapped it out with a completely different motherboard yesterday and it's still acting the same. The CRC errors I was getting with this mobo when I was using it for unraid and I was having no issues then. I know for sure the cables are all secured because I made sure yesterday. Switching up the hardware did nothing to fix this so I'm at a loss.

[sdamaged]

Could you try a different SATA cable on that drive? If its the same cable you're using, then that's the only constant (other than the drive...!)

Edited February 26, 2020 by sdamaged

[becksworth]

15 minutes ago, sdamaged said:

Could you try a different SATA cable on that drive? If its the same cable you're using, then that's the only constant (other than the drive...!)

Just swapped out the cable. Booting up now. Will update when it's up and running

[becksworth]

Same result. Just started transferring with filezilla and it locked up right away. The file didn't even make it past 0.1%

[sdamaged]

OK, do you have a different SATA port, or a different drive to try?  I assume you're using SATA from the motherboard?

 

Also, maybe try swapping the cable / port from a good drive to the suspect one

 

See if the issue happens still. (process of elimination!)

Edited February 26, 2020 by sdamaged

[becksworth]

3 minutes ago, sdamaged said:

OK, do you have a different SATA port, or a different drive to try?  I assume you're using SATA from the motherboard?

 

Also, maybe try swapping the cable / port from a good drive to the suspect one

 

See if the issue happens still. (process of elimination!)

I did swap up the port it was plugged into. The one change this time however was I got no CRC errors. Yeah, I am using the sata from the motherboard.

[sdamaged]

Still freezing with the drive on a different port?

[becksworth]

5 minutes ago, sdamaged said:

Still freezing with the drive on a different port?

Yep, same results unfortunately 

[trurl]

The hard resets on ata4 in those original diagnostics were referring to disk5. I don't know what connections you have now.

 

Post new diagnostics.

[sdamaged]

OK so either a new disk with CRC errors, or this is a disk that has been moved to the other port the previous erroring drive was using

 

I see your Supermicro X8DTL is using an older BIOS (2.0), it looks like 2.1b is available now so might be worth upgrading to that as well.

 

 

[becksworth]

1 hour ago, trurl said:

The hard resets on ata4 in those original diagnostics were referring to disk5. I don't know what connections you have now.

 

Post new diagnostics.

Here are the new diagnostics.

tower-diagnostics-20200226-1029.zip

[sdamaged]

Seeing read and write errors on disk 4 too

 

200 Multi_Zone_Error_Rate (Rate of errors during write.)     22

1 Raw_Read_Error_Rate (Frequency of errors during read operations.) 5768

[becksworth]

Disk 4 currently has no data written on it. Would it be worth it to unplug it from the array and see if the freezing persists?

[becksworth]

So I wiped my USB and started fresh. Threw my old config folder in there and booted up and everything is working perfectly again... I will mark as solved if this behavior keeps up!

[becksworth]

The freezing has started again. Though it doesn't seem to happen as frequently as it was before the USB reformat.

[sdamaged]

Yeah i'm wondering if the disks are an issue. I would pull disk 4 (it will then use the parity), and see if the freezing persists.  Then if all is OK, put that one back in (check parity is valid or you might have to let it rebuild) then move onto the next disk etc

Pain i know...!

 

Just to add, it could still be an unRAID issue, as i mentioned i have definitely found a bug which i raised the relevant part of the forum. Same resulting problem as you, everything drops off and stops working, all dockers etc.  This is happening on network copies for me - i see you mentioned using FileZilla as well...

Edited February 27, 2020 by sdamaged

[trurl]

7 hours ago, sdamaged said:

I would pull disk 4 (it will then use the parity), and see if the freezing persists.  Then if all is OK, put that one back in (check parity is valid or you might have to let it rebuild)

If there are any writes of any kind from anything to the emulated disk then it is definitely going to need to be rebuilt since the pulled disk will definitely be out--of-sync with parity.