Server in bad shape, USB Failed or Blacklisted : steps to fix ?

[potjoe]

Hi all, 

 

Accessing the Web UI, I noticed today some big troubles in my server. I do not live in the same location, so I don't know when it started. 

The webUI is off, displaying failed to open stream everywhere, most of options and pages are unavailable (I cannot access diagnostic or logs through UI). The USB key seems to be blacklisted OR offline, but I wanted to post here before attempting a reboot or anything. 

 

Here are some screenshots.

 

Could you provide me with instructions to diagnose / fix its current state ?

 

I've been running unraid for years without any issue. 

[JorgeB]

Post the output of:

 

df -h

 

[potjoe]

root@MonaLisa:~# df -h
Filesystem      Size  Used Avail Use% Mounted on
rootfs          7.7G  1.7G  6.1G  22% /
tmpfs            32M  1.9M   31M   6% /run
/dev/sda1        29G  754M   29G   3% /boot
overlay         7.7G  1.7G  6.1G  22% /lib/firmware
overlay         7.7G  1.7G  6.1G  22% /lib/modules
devtmpfs        8.0M     0  8.0M   0% /dev
tmpfs           7.8G     0  7.8G   0% /dev/shm
cgroup_root     8.0M     0  8.0M   0% /sys/fs/cgroup
tmpfs           128M  100M   29M  78% /var/log
tmpfs           1.0M     0  1.0M   0% /mnt/disks
tmpfs           1.0M     0  1.0M   0% /mnt/remotes
tmpfs           1.0M     0  1.0M   0% /mnt/addons
tmpfs           1.0M     0  1.0M   0% /mnt/rootshare
/dev/md1        2.8T  2.6T  172G  94% /mnt/disk1
/dev/md2        2.8T  2.6T  179G  94% /mnt/disk2
/dev/md3        932G  714G  218G  77% /mnt/disk3
/dev/sdf1       466G  137G  329G  30% /mnt/cache
/dev/sdg1       239G   43G  197G  18% /mnt/cache_nvme
shfs            6.4T  5.9T  568G  92% /mnt/user0
shfs            6.4T  5.9T  568G  92% /mnt/user
/dev/loop2       40G   20G   20G  51% /var/lib/docker
tmpfs           7.8G  324M  7.5G   5% /var/lib/docker/containers
/dev/loop3      1.0G  4.4M  905M   1% /etc/libvirt

 

Here it is. Thank you for your help!

[JorgeB]

The flash drive still appears mounted, see if you can get the diagnostics in the CLI

[potjoe]

I managed to bypass the broken menu and to go directly to the Url of diagnose page, it worked. Here is the diagnostic. Sorry for the time lost

monalisa-diagnostics-20240327-1924.zip

[JorgeB]

Diags confirm flash drive problems, you can first try to re-format it and/or using a different USB port, ideally USB 2.0, if the same replace it.

[trurl]

Do you have a current backup of flash?

[potjoe]

Thank you for your help, I will try these different steps and keep you updated (change ports then format). It is now connected directly to the internal USB 2.0 header with an adapter, I'll first try to reseat it / then change it. I do have a quite recent backup thanks to unraid connect.