Unresponsive GUI

Hello everyone,

Need your help in finding out what's giving my Unraid server a hard time. The problem I'm getting is that the server becomes unresponsive (GUI and dockers) though I can still ssh to it and browse the shares, and even access the data (both cache and disks). Today is the second time I am experiencing this and I can't see anything obvious to what's causing it. And, only way to fix it is to force power off and turn it on again.

There are several factors that can be at play here as I've recently upgraded (fix+upgrade)  the server after running into some disk issues. The changes that were done were to replace 4xSSD cache pool with 4xNVME cache pool. Replaced a dying drive and adding an additional one. 

 The errors I'm seeing in the syslog are bellow and I've also attached the support bundle. 

Jul  1 16:48:52 FLN-HST01 nginx: 2022/07/01 16:48:52 [error] 3154#3154: *3707543 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.89, server: 1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net, request: "GET /Main HTTP/2.0", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net"
Jul  1 16:48:52 FLN-HST01 nginx: 2022/07/01 16:48:52 [error] 3154#3154: *3707543 auth request unexpected status: 504 while sending to client, client: 192.168.1.89, server: 1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net, request: "GET /Main HTTP/2.0", host: "1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net"
Jul  1 16:59:32 FLN-HST01 nginx: 2022/07/01 16:59:32 [error] 3154#3154: *3707543 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.89, server: 1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net, request: "GET /favicon.ico HTTP/2.0", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net", referrer: "https://1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net/Main"
Jul  1 16:59:32 FLN-HST01 nginx: 2022/07/01 16:59:32 [error] 3154#3154: *3707543 auth request unexpected status: 504 while sending to client, client: 192.168.1.89, server: 1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net, request: "GET /favicon.ico HTTP/2.0", host: "1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net", referrer: "https://1dde8578119935a3a3e85af1020c02f26257a3b8.unraid.net/Main"

Any support is greatly appreciated,
Florin

fln-hst01.home-diagnostics-20220701-1641.zip

Edited July 1, 20224 yr by flncazacu