MartynK

My server was running fine this morning, I logged in done a couple of things and all was good. An hour or so later, my Uptime monitoring notified me that the WebUI was no longer available. The servers shares were still up and running, along with all the docker containers I have running. Below is what I have from my remote Syslog, there is nothing of value that I can see in the local Unraid logs. Anyone with any ideas ? <13>1 2025-09-12T01:00:01+08:00 Tower02 Plugin - - - Plugin Auto Update: Checking for available plugin updates <13>1 2025-09-12T01:00:15+08:00 Tower02 Plugin - - - Plugin Auto Update: Auto Updating dynamix.unraid.net.plg <13>1 2025-09-12T01:00:17+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:17+08:00 Tower02 plugin-manager - - - plugin-manager: creating: /boot/config/plugins/dynamix.my.servers/dynamix.unraid.net-4.21.0-x86_64-1.txz - downloading from URL https://stable.dl.unraid.net/unraid-api/dynamix.unraid.net-4.21.0-x86_64-1.txz <13>1 2025-09-12T01:00:19+08:00 Tower02 plugin-manager - - - plugin-manager: checking: /boot/config/plugins/dynamix.my.servers/dynamix.unraid.net-4.21.0-x86_64-1.txz - SHA256 <13>1 2025-09-12T01:00:20+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:20+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:20+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:20+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:29+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:29+08:00 Tower02 plugin-manager - - - plugin-manager: running: 'anonymous' <13>1 2025-09-12T01:00:32+08:00 Tower02 flash_backup - - - flash_backup: stop watching for file changes <13>1 2025-09-12T01:00:33+08:00 Tower02 flash_backup - - - flash_backup: flush: /usr/local/emhttp/plugins/dynamix.my.servers/scripts/UpdateFlashBackup update <13>1 2025-09-12T01:00:36+08:00 Tower02 flash_backup - - - flash_backup: checking for changes every 1800 seconds <13>1 2025-09-12T01:00:47+08:00 Tower02 rc.nginx - - - rc.nginx: Reloading Nginx server daemon... <13>1 2025-09-12T01:00:47+08:00 Tower02 rc.nginx - - - rc.nginx: Checking configuration for correct syntax and then trying to open files referenced in configuration... <13>1 2025-09-12T01:00:47+08:00 Tower02 rc.nginx - - - rc.nginx: /usr/sbin/nginx -t -c /etc/nginx/nginx.conf <13>1 2025-09-12T01:00:47+08:00 Tower02 rc.nginx - - - rc.nginx: Reloading Nginx server daemon configuration... <13>1 2025-09-12T01:00:48+08:00 Tower02 plugin-manager - - - plugin-manager: dynamix.unraid.net.plg updated <22>1 2025-09-12T01:00:49+08:00 Tower02 sSMTP 2917604 - - sSMTP[2917604]: Creating SSL connection to host <22>1 2025-09-12T01:00:50+08:00 Tower02 sSMTP 2917604 - - sSMTP[2917604]: SSL connection using ECDHE-RSA-AES256-GCM-SHA384 <22>1 2025-09-12T01:00:53+08:00 Tower02 sSMTP 2917604 - - sSMTP[2917604]: Sent mail for [email protected] (221 Service closing TLS SSL transmission session) uid=0 username=root outbytes=714 <13>1 2025-09-12T01:00:53+08:00 Tower02 Plugin - - - Plugin Auto Update: Checking for language updates <13>1 2025-09-12T01:00:53+08:00 Tower02 Plugin - - - Plugin Auto Update: Community Applications Plugin Auto Update finished <13>1 2025-09-12T02:00:02+08:00 Tower02 Docker - - - Docker Auto Update: Community Applications Docker Autoupdate running <13>1 2025-09-12T02:00:02+08:00 Tower02 Docker - - - Docker Auto Update: Checking for available updates <13>1 2025-09-12T02:01:09+08:00 Tower02 Docker - - - Docker Auto Update: No updates will be installed <13>1 2025-09-12T04:40:03+08:00 Tower02 root - - - root: Fix Common Problems Version 2025.08.07 <13>1 2025-09-12T05:00:01+08:00 Tower02 recycle.bin - - - recycle.bin: Scheduled: Files older than 7 days have been removed <13>1 2025-09-12T05:27:43+08:00 Tower02 webgui - - - webgui: Successful login user root from 192.168.200.50 <30>1 2025-09-12T05:28:07+08:00 Tower02 ool - - - ool www[3304468]: /usr/local/emhttp/plugins/recycle.bin/scripts/rc.recycle.bin 'purge' <13>1 2025-09-12T05:28:07+08:00 Tower02 recycle.bin - - - recycle.bin: User: Files older than 7 days have been removed <30>1 2025-09-12T05:28:08+08:00 Tower02 ool - - - ool www[3306131]: /usr/local/emhttp/plugins/recycle.bin/scripts/rc.recycle.bin 'empty' <13>1 2025-09-12T05:28:11+08:00 Tower02 recycle.bin - - - recycle.bin: User: Recycle Bin has been emptied <30>1 2025-09-12T05:28:21+08:00 Tower02 ool - - - ool www[3306131]: /usr/local/emhttp/plugins/recycle.bin/scripts/rc.recycle.bin 'empty' <13>1 2025-09-12T05:28:21+08:00 Tower02 recycle.bin - - - recycle.bin: User: Recycle Bin has been emptied *** It Crashed Here *** <13>1 2025-09-12T08:31:10+08:00 Tower02 reload_services - - - reload_services: execute queued job 1 <46>1 2025-09-12T08:31:10+08:00 Tower02 rsyslogd - - - rsyslogd: action 'action-2-builtin:omfwd' resumed (module 'builtin:omfwd') [v8.2102.0 try https://www.rsyslog.com/e/2359 ] <13>1 2025-09-12T08:31:19+08:00 Tower02 rc.nginx - - - rc.nginx: Reloading Nginx server daemon... <13>1 2025-09-12T08:31:19+08:00 Tower02 rc.nginx - - - rc.nginx: Checking configuration for correct syntax and then trying to open files referenced in configuration... <13>1 2025-09-12T08:31:19+08:00 Tower02 rc.nginx - - - rc.nginx: /usr/sbin/nginx -t -c /etc/nginx/nginx.conf <13>1 2025-09-12T08:31:19+08:00 Tower02 rc.nginx - - - rc.nginx: Reloading Nginx server daemon configuration... <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: #033[33m[PM2][WARN] #033[39mApplications unraid-api not running, starting... <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: #033[33m[PM2][WARN] #033[39mApp unraid-api has option 'wait_ready' set, waiting for app to be ready... <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: #033[32m[PM2] #033[39mApp [unraid-api] launched (1 instances) <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: ┌────┬───────────────┬─────────────┬─────────┬─────────┬──────────┬────────┬──────┬───────────┬──────────┬──────────┬──────────┬──────────┐ <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: │ id │ name │ namespace │ version │ mode │ pid │ uptime │ ↺ │ status │ cpu │ mem │ user │ watching │ <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: ├────┼───────────────┼─────────────┼─────────┼─────────┼──────────┼────────┼──────┼───────────┼──────────┼──────────┼──────────┼──────────┤ <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: │ #033[1m#033[36m0#033[39m#033[22m │ unraid-api │ default │ 4.21.0… │ #033[7m#033[1mfork#033[22m#033[27m │ 8245 │ 12s │ 0 │ #033[32m#033[1monline#033[22m#033[39m │ 0% │ 168.4mb │ #033[1mroot#033[22m │ #033[90mdisabled#033[39m │ <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: └────┴───────────────┴─────────────┴─────────┴─────────┴──────────┴────────┴──────┴───────────┴──────────┴──────────┴──────────┴──────────┘ <13>1 2025-09-12T08:31:20+08:00 Tower02 root - - - root: Starting nchan processes... <13>1 2025-09-12T08:31:20+08:00 Tower02 rc.nginx - - - rc.nginx: Nginx server daemon... Started. <13>1 2025-09-12T08:31:20+08:00 Tower02 rc.nginx - - - rc.nginx: Starting Nginx server daemon... <13>1 2025-09-12T08:31:20+08:00 Tower02 rc.nginx - - - rc.nginx: Nginx server daemon... Already started. <14>1 2025-09-12T08:31:20+08:00 Tower02 emhttpd - - - emhttpd: shcmd (56): /etc/rc.d/rc.flash_backup start <13>1 2025-09-12T08:31:20+08:00 Tower02 flash_backup - - - flash_backup: stop watching for file changes <13>1 2025-09-12T08:31:20+08:00 Tower02 flash_backup - - - flash_backup: flush: /usr/local/emhttp/plugins/dynamix.my.servers/scripts/UpdateFlashBackup update <13>1 2025-09-12T08:31:23+08:00 Tower02 flash_backup - - - flash_backup: checking for changes every 1800 seconds <13>1 2025-09-12T08:31:28+08:00 Tower02 webgui - - - webgui: Successful login user root from 192.168.200.51 <13>1 2025-09-12T08:31:31+08:00 Tower02 recycle.bin - - - recycle.bin: Starting Recycle Bin <13>1 2025-09-12T08:31:36+08:00 Tower02 Parity - - - Parity Check Tuning: Unclean shutdown detected <13>1 2025-09-12T08:31:36+08:00 Tower02 Parity - - - Parity Check Tuning: Send notification: Unclean shutdown detected: See Troubleshooting section of the Unraid OS Manual in the online documetaion to get guidance on resolving this (type=alert link=) <22>1 2025-09-12T08:31:37+08:00 Tower02 sSMTP 9425 - - sSMTP[9425]: Creating SSL connection to host <22>1 2025-09-12T08:31:38+08:00 Tower02 sSMTP 9425 - - sSMTP[9425]: SSL connection using ECDHE-RSA-AES256-GCM-SHA384 <22>1 2025-09-12T08:31:40+08:00 Tower02 sSMTP 9425 - - sSMTP[9425]: Sent mail for [email protected] (221 Service closing TLS SSL transmission session) uid=0 username=root outbytes=799

Thanks for all the advice. Its odd because both of the shares had no files on the array, there were directories of the same name but that was all. I have deleted the directories from the array, lets see what happens.

Sorry, I did not post the di ags, here they aretower02-diagnostics-20240705-1057.zip, I am not sure what else to add.

I have a 500gb M2 as my cache drive. The usual shares are on there plus two that I have added, downloads and downloading. When I look at the share setup, the are exclusive to the SSD and nothing is on the array. Yet when I look at the shares screen, one shows 8.1tb and the second 24tb free disk space. Even those numbers dont equate to what is free on the actual array. Whats even worse, when I go in to the directory browser for the /usr path, I see that both of the shares have allocations on random disks in the array. How has this happened and what can I do to fix it ?

The only way I got around the "job running" message when something was not running (like a phantom process) was a total reboot. Sometimes I found multiple copies of rsync running and killing those would stop a real running job.

I am currently copying 10's of TB around which is taking days. Whats adding to the time is that I often see the speed of transfer has dropped so I go look at the running processes to see multiple rsync's running. Normally I see 3 copies of rsync running (as a group) when things are OK, but when it goes wrong, I look at the processes and I can see multiple groups of rsync. If I cancel the running copy, it normally kills off one of the rsync groups, but I am left with any other groups which I have to kill manually. I am sure this cannot be normal and I am not sure what is causing the problem. How can I find out ?

Yes, the are USB and the serial numbers are being passed, it looks like some times they dont come through correctly, so the reboot clears things up and the are passed OK.

Odd because I have seen a number of occasions where there correct number of disks have been passed over, just they have just not dropped in to the correct allocation.

This must be an issue with the order that the USB disks are found at the hardware level. I find that if I reboot, normally once, but sometimes twice, everything just works perfectly, all the disks are found in the right order etc. its a shame this cannot be fixed somehow as using USB enclosures for low throughput needs are a cheap solution with Unraid.

I have two servers sitting on the same network both configured exactly the same way. If I go to APPS on the first on it loads and I also get the message " Backup Server Active. Some icons may not appear, and plugin installations may be affected". If I go to APPS on the second one, it gives an error "Download of appfeed failed." also "Last JSON error Recorded: Syntax error" Its also going on about DNS servers, but I know they are all working as both servers are using the same, if I go to a terminal on the second server I can access and resolve DNS fine. What am I missing ?

I found another major issue with this. When nothing was showing as the progress window had vanished, I could see my disks were still getting thrashed. When I looked at the process monitor, it had about 9 copies of (I think it was rsync) running or in a suspended state. I could not shutdown the array as it said it was blocked, in the end I had to go kill the processes one by one to allow me to reset the array and get it back up to speed.

I dont have the space for a real PC and external disks, so I only have this option. Its odd, because sometimes, not even the USB boot drive is working, something is odd. I have a new mini PC on order, hopefully it may help.

I have a mount to a SMB share and am copying files. The only problem is the window showing the status of the copy has vanished, its not now visible and the link at the bottom of the page has gone also. I can see that files are still copying if I look at disk activity or go look at the actual share on the array. How can I get the status window back, without it if I needed to cancel the copy I dont see how ?

I have a mount to a SMB share and am copying files. The only problem is the window showing the status of the copy has vanished, its not now visible and the link at the bottom of the page has gone also. I can see that files are still copying if I look at disk activity or go look at the actual share on the array. How can I get the status window back, without it if I needed to cancel the copy I dont see how ?

I have a really odd problem on a new server I am building. A Mini PC with two 5 bay USB disk enclosures which I am slowly adding disk to. When I reboot the server, it randomly drops disks from the array, if I power everything off, wait a few minutes and restart, sometimes it takes one or two cycles before the disks become visible again and I can place them back into their correct array allocation. I have also seen where one disks ID totally changed to a random name, yet again a reboot and the disk was "found" again with the correct ID. Not sure how to solve this, any help ?