Good Morning,

 

Been running into a consistent issue that I cant figure out. Unraid UI keeps crashing and is just returning a 500 after some time. Only thing that has been working is reboots. Nothing is sticking out in the logs. 

 

Any ideas / help would be appreciated. 

 

Things ive tired: 

* killed specific docker containers. 

* Rebooted nginx service 

 

So far my uptime has been about 2 days till it crashes. 

 

Aug 27 09:28:15 Tower nginx: 2021/08/27 09:28:15 [error] 5762#5762: *396253 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"

Aug 27 09:46:23 Tower nginx: 2021/08/27 09:46:23 [error] 5762#5762: *400258 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:46:39 Tower nginx: 2021/08/27 09:46:39 [error] 5762#5762: *400284 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:46:39 Tower nginx: 2021/08/27 09:46:39 [error] 5762#5762: *400961 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:46:39 Tower nginx: 2021/08/27 09:46:39 [error] 5762#5762: *400961 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:46:55 Tower nginx: 2021/08/27 09:46:55 [error] 5762#5762: *400493 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "GET /plugins/dynamix.apcupsd/include/UPSstatus.php?all=false HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:46:55 Tower nginx: 2021/08/27 09:46:55 [error] 5762#5762: *400493 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "GET /plugins/dynamix.apcupsd/include/UPSstatus.php?all=false HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:47:11 Tower nginx: 2021/08/27 09:47:11 [error] 5762#5762: *401084 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:47:11 Tower nginx: 2021/08/27 09:47:11 [error] 5762#5762: *401084 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:47:27 Tower nginx: 2021/08/27 09:47:27 [error] 5762#5762: *401146 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/update.wireguard.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:47:27 Tower nginx: 2021/08/27 09:47:27 [error] 5762#5762: *401146 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/update.wireguard.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:23 Tower nginx: 2021/08/27 09:48:23 [error] 5762#5762: *400258 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:23 Tower nginx: 2021/08/27 09:48:23 [error] 5762#5762: *400258 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:39 Tower nginx: 2021/08/27 09:48:39 [error] 5762#5762: *400284 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/Notify.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:39 Tower nginx: 2021/08/27 09:48:39 [error] 5762#5762: *400284 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/Notify.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:39 Tower nginx: 2021/08/27 09:48:39 [error] 5762#5762: *401698 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:39 Tower nginx: 2021/08/27 09:48:39 [error] 5762#5762: *401698 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:55 Tower nginx: 2021/08/27 09:48:55 [error] 5762#5762: *401736 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:48:55 Tower nginx: 2021/08/27 09:48:55 [error] 5762#5762: *401736 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:49:11 Tower nginx: 2021/08/27 09:49:11 [error] 5762#5762: *401770 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 09:49:11 Tower nginx: 2021/08/27 09:49:11 [error] 5762#5762: *401770 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "POST /webGui/include/DashUpdate.php HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Dashboard"
Aug 27 10:47:37 Tower nginx: 2021/08/27 10:47:37 [error] 5762#5762: *409319 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.253.0.4, server: , request: "GET /sub/cpuload?last_event_id=1629851369%3A0 HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3"
Aug 27 10:47:37 Tower nginx: 2021/08/27 10:47:37 [error] 5762#5762: *409319 auth request unexpected status: 504 while sending to client, client: 10.253.0.4, server: , request: "GET /sub/cpuload?last_event_id=1629851369%3A0 HTTP/1.1", host: "192.168.1.3"
Aug 27 11:38:57 Tower sshd[58668]: Connection from 10.10.1.63 port 1086 on 192.168.1.3 port 22 rdomain ""
Aug 27 11:38:58 Tower sshd[58668]: Postponed keyboard-interactive for root from 10.10.1.63 port 1086 ssh2 [preauth]
Aug 27 11:38:59 Tower sshd[58668]: Postponed keyboard-interactive/pam for root from 10.10.1.63 port 1086 ssh2 [preauth]
Aug 27 11:38:59 Tower sshd[58668]: Accepted keyboard-interactive/pam for root from 10.10.1.63 port 1086 ssh2
Aug 27 11:38:59 Tower sshd[58668]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)
Aug 27 11:39:00 Tower sshd[58668]: Starting session: shell on pts/4 for root from 10.10.1.63 port 1086 id 0
Aug 27 11:39:18 Tower sshd[59817]: Connection from 10.10.1.63 port 1043 on 192.168.1.3 port 22 rdomain ""
Aug 27 11:39:19 Tower sshd[59817]: Postponed keyboard-interactive for root from 10.10.1.63 port 1043 ssh2 [preauth]
Aug 27 11:39:19 Tower sshd[59817]: Postponed keyboard-interactive/pam for root from 10.10.1.63 port 1043 ssh2 [preauth]
Aug 27 11:39:19 Tower sshd[59817]: Accepted keyboard-interactive/pam for root from 10.10.1.63 port 1043 ssh2
Aug 27 11:39:19 Tower sshd[59817]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)
Aug 27 11:39:19 Tower sshd[59817]: Starting session: shell for root from 10.10.1.63 port 1043 id 0
Aug 27 11:39:25 Tower nginx: 2021/08/27 11:39:25 [error] 5762#5762: *416028 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 10.10.1.63, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth_request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.3", referrer: "http://192.168.1.3/Main"
Aug 27 11:39:25 Tower nginx: 2021/08/27 11:39:25 [error] 5762#5762: *416028 auth request unexpected status: 504 while sending to client, client: 10.10.1.63, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.1.3", referrer: "http://192.168.1.3/Main"

 

syslog

Unraid is still up. Still not sure what the root issue is. 

how were you able to resolve this issue? i uninstalled a couple of plugins and I don't want to restart since there is an important process running in the background

Attach Diagnostics to your NEXT post in this thread.

system diagnostics didn't work and it was hanging forever.

 

2024/01/22 15:44:07 [error] 9215#9215: *27035 auth request unexpected status: 504 while sending to client, client: 195.*****, server: , request: "GET /VMs HTTP/2.0", host: "195.*******:4114", referrer: "https://195.*********:4114/Main"
, upstream: "fastcgi://unix:/var/run/php5-fpm.sock"

2024/01/22 16:25:29 [error] 9215#9215: *34192 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.158, server: , request: "GET /Main HTTP/2.0", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "****.local"

 

restarting php5-frm resolved it

 

command:

/etc/rc.d/rc.nginx restart

/etc/rc.d/rc.php-fpm restart