GUI partially locked, out of memory

[dja]

As the title states, my GUI is loading *some* pages. Logs show memory is full...so I'm not surprised. I'm seeing the sys log showing "Increase nchan_max_reserved_memory." a LOT. 

Things were running great until the RC 4.1 update. Could that be related? I suspect a VM hung, but shutting that down didn't resolve things. It's prob. hung in memory. Docker is working, at least. Zeus-diagnostics-20230429-1921.zip

 

Anyway, before I rebooted I wanted to see if anyone had an idea what went south or something to try.  Diags I could capture are attached. It hung on creation, so not sure if it finished or just hung in process. 

[dja]

Seeing this logging in Libvirt. Is this possibly related @SimonF ? I'm not seeing anything in /var/log/vfio-pci-errors however. 
*Note, I verified the path mentioned does exist and is R/W

 

2023-04-30 00:39:55.113+0000: 16323: info : libvirt version: 8.7.0
2023-04-30 00:39:55.113+0000: 16323: info : hostname: ZEUS
2023-04-30 00:39:55.113+0000: 16323: error : qemuVirtioFSStart:198 : internal error: the virtiofs export directory '/mnt/remotes/YALE-FORTY-FIVE_YALE-FORTY-FIVE/GoogleDrive/WORK/DW' does not exist
2023-04-30 00:39:55.113+0000: 16323: error : virPidFileAcquirePath:401 : Failed to acquire pid file '/run/libvirt/qemu/4-CAD-fs0-fs.pid': Resource temporarily unavailable
2023-04-30 00:39:55.347+0000: 16323: error : qemuAutostartDomain:197 : internal error: Failed to autostart VM 'CAD': internal error: the virtiofs export directory '/mnt/remotes/YALE-FORTY-FIVE_YALE-FORTY-FIVE/GoogleDrive/WORK/DW' does not exist
2023-04-30 00:49:12.750+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 00:59:13.568+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:09:14.382+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:19:15.190+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:29:16.007+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:39:16.833+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:49:17.645+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:59:18.462+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:09:19.274+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:19:20.092+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:29:20.914+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:39:21.744+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:49:22.555+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:59:23.335+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:09:24.167+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:19:25.018+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:29:25.867+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:39:26.717+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:49:27.546+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:59:28.359+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 04:09:29.195+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error

 

Edited April 30, 2023 by dja

[SimonF]

12 hours ago, dja said:

Seeing this logging in Libvirt. Is this possibly related @SimonF ? I'm not seeing anything in /var/log/vfio-pci-errors however. 
*Note, I verified the path mentioned does exist and is R/W

 

2023-04-30 00:39:55.113+0000: 16323: info : libvirt version: 8.7.0
2023-04-30 00:39:55.113+0000: 16323: info : hostname: ZEUS
2023-04-30 00:39:55.113+0000: 16323: error : qemuVirtioFSStart:198 : internal error: the virtiofs export directory '/mnt/remotes/YALE-FORTY-FIVE_YALE-FORTY-FIVE/GoogleDrive/WORK/DW' does not exist
2023-04-30 00:39:55.113+0000: 16323: error : virPidFileAcquirePath:401 : Failed to acquire pid file '/run/libvirt/qemu/4-CAD-fs0-fs.pid': Resource temporarily unavailable
2023-04-30 00:39:55.347+0000: 16323: error : qemuAutostartDomain:197 : internal error: Failed to autostart VM 'CAD': internal error: the virtiofs export directory '/mnt/remotes/YALE-FORTY-FIVE_YALE-FORTY-FIVE/GoogleDrive/WORK/DW' does not exist
2023-04-30 00:49:12.750+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 00:59:13.568+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:09:14.382+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:19:15.190+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:29:16.007+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:39:16.833+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:49:17.645+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 01:59:18.462+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:09:19.274+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:19:20.092+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:29:20.914+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:39:21.744+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:49:22.555+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 02:59:23.335+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:09:24.167+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:19:25.018+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:29:25.867+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:39:26.717+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:49:27.546+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 03:59:28.359+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error
2023-04-30 04:09:29.195+0000: 16276: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error

 

I dont think this should be related. I have an nchan issue if I am om the dashboard page in a tab on android tab. This seems not to process and nchan stores waiting for the device so I dont leave it open on that device.