remblack Posted January 4 Share Posted January 4 Hi all, I'm having an problem with unraid showing USB off line. Yesterday I restarted the server and after worked as expected. This morning after the problem cameback. I stopped the array and started once again and also made the problem go away. If this would be a problem with the USB I would expect the problem to persist after reboot or stopping/staring the pool This have happened 3 times, yesteray 10am and then at night and happened again today at 10am. Thanks in advance !! Jan 4 08:29:05 server nginx: 2024/01/04 08:29:05 [alert] 10227#10227: worker process 1326 exited on signal 6 Jan 4 08:29:06 server nginx: 2024/01/04 08:29:06 [alert] 10227#10227: worker process 1429 exited on signal 6 Jan 4 08:29:07 server nginx: 2024/01/04 08:29:07 [alert] 10227#10227: worker process 1589 exited on signal 6 Jan 4 08:29:08 server nginx: 2024/01/04 08:29:08 [alert] 10227#10227: worker process 1723 exited on signal 6 Jan 4 08:29:09 server nginx: 2024/01/04 08:29:09 [alert] 10227#10227: worker process 1843 exited on signal 6 Jan 4 08:29:10 server nginx: 2024/01/04 08:29:10 [alert] 10227#10227: worker process 1951 exited on signal 6 Jan 4 08:29:11 server nginx: 2024/01/04 08:29:11 [alert] 10227#10227: worker process 2080 exited on signal 6 Jan 4 08:29:12 server nginx: 2024/01/04 08:29:12 [alert] 10227#10227: worker process 2136 exited on signal 6 Jan 4 08:29:13 server nginx: 2024/01/04 08:29:13 [alert] 10227#10227: worker process 2357 exited on signal 6 Jan 4 08:29:14 server nginx: 2024/01/04 08:29:14 [alert] 10227#10227: worker process 2778 exited on signal 6 Jan 4 08:29:15 server nginx: 2024/01/04 08:29:15 [alert] 10227#10227: worker process 3168 exited on signal 6 Jan 4 08:29:16 server nginx: 2024/01/04 08:29:16 [alert] 10227#10227: worker process 3472 exited on signal 6 Jan 4 08:29:17 server nginx: 2024/01/04 08:29:17 [alert] 10227#10227: worker process 3577 exited on signal 6 Jan 4 08:29:18 server nginx: 2024/01/04 08:29:18 [alert] 10227#10227: worker process 3678 exited on signal 6 Jan 4 08:29:19 server nginx: 2024/01/04 08:29:19 [alert] 10227#10227: worker process 3797 exited on signal 6 Jan 4 08:29:20 server nginx: 2024/01/04 08:29:20 [alert] 10227#10227: worker process 3909 exited on signal 6 Jan 4 08:29:21 server nginx: 2024/01/04 08:29:21 [alert] 10227#10227: worker process 4016 exited on signal 6 Jan 4 08:29:22 server nginx: 2024/01/04 08:29:22 [alert] 10227#10227: worker process 5227 exited on signal 6 Jan 4 08:31:04 server webGUI: Successful login user root from 10.0.2.249 Jan 4 08:50:35 server emhttpd: spinning down /dev/sdd Jan 4 08:55:47 server emhttpd: read SMART /dev/sdd Jan 4 08:58:17 server emhttpd: spinning down /dev/sdh Jan 4 08:58:45 server emhttpd: spinning down /dev/sdg Jan 4 08:59:34 server emhttpd: spinning down /dev/sdb Jan 4 09:00:32 server emhttpd: spinning down /dev/sde Jan 4 09:05:53 server emhttpd: read SMART /dev/sde Jan 4 09:08:09 server monitor: Stop running nchan processes Jan 4 09:22:34 server emhttpd: spinning down /dev/sdf Jan 4 09:22:59 server emhttpd: read SMART /dev/sdf Jan 4 09:55:48 server emhttpd: spinning down /dev/sdd Jan 4 09:58:14 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 09:58:14 server emhttpd: read SMART /dev/sdh Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdh Jan 4 09:58:14 server emhttpd: read SMART /dev/sdg Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdg Jan 4 09:58:14 server emhttpd: read SMART /dev/sdd Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdd Jan 4 09:58:14 server emhttpd: read SMART /dev/sdb Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdb Jan 4 09:58:14 server emhttpd: read SMART /dev/sdc Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdc Jan 4 09:58:14 server emhttpd: read SMART /dev/sdi Jan 4 09:58:14 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdi Jan 4 09:58:15 server emhttpd: read SMART /dev/sdh Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdh Jan 4 09:58:15 server emhttpd: read SMART /dev/sdg Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdg Jan 4 09:58:15 server emhttpd: read SMART /dev/sdd Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdd Jan 4 09:58:15 server emhttpd: read SMART /dev/sdb Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdb Jan 4 09:58:15 server emhttpd: read SMART /dev/sdc Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdc Jan 4 09:58:15 server emhttpd: read SMART /dev/sdi Jan 4 09:58:15 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdi Jan 4 09:58:16 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 09:58:16 server emhttpd: read SMART /dev/sdh Jan 4 09:58:16 server emhttpd: read SMART /dev/sdg Jan 4 09:58:16 server emhttpd: read SMART /dev/sdd Jan 4 09:58:16 server emhttpd: read SMART /dev/sdb Jan 4 09:58:16 server emhttpd: read SMART /dev/sdc Jan 4 09:58:16 server emhttpd: read SMART /dev/sdi Jan 4 09:58:47 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 09:58:48 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 09:59:46 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 09:59:47 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:00:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:00:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:00:02 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:00:32 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:00:38 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:00:39 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:00:40 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:00:45 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:00:46 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:00:47 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:01:01 server samba-dcerpcd[25616]: [2024/01/04 10:01:01.721807, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:01:01 server samba-dcerpcd[25616]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:01:01 server samba-dcerpcd[25616]: [2024/01/04 10:01:01.724043, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:01:01 server samba-dcerpcd[25616]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:01:01 server samba-dcerpcd[25616]: [2024/01/04 10:01:01.726101, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:01:01 server samba-dcerpcd[25616]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:01:01 server samba-dcerpcd[25616]: [2024/01/04 10:01:01.728123, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:01:01 server samba-dcerpcd[25616]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:01:01 server winbindd[21546]: [2024/01/04 10:01:01.766821, 0] ../../source3/winbindd/winbindd_samr.c:71(open_internal_samr_conn) Jan 4 10:01:01 server winbindd[21546]: open_internal_samr_conn: Could not connect to samr pipe: NT_STATUS_CONNECTION_REFUSED Jan 4 10:01:01 server winbindd[21546]: [2024/01/04 10:01:01.808273, 0] ../../source3/winbindd/winbindd_samr.c:71(open_internal_samr_conn) Jan 4 10:01:01 server winbindd[21546]: open_internal_samr_conn: Could not connect to samr pipe: NT_STATUS_CONNECTION_DISCONNECTED Jan 4 10:01:02 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) Jan 4 10:01:02 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:01:03 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:01:21 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:01:23 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:01:47 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:01:48 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:02:01 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:02:02 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:02:03 server sSMTP[17342]: Creating SSL connection to host Jan 4 10:02:03 server sSMTP[17342]: SSL connection using TLS_AES_256_GCM_SHA384 Jan 4 10:02:05 server sSMTP[17342]: Sent mail for [email protected] (221 2.0.0 closing connection a18-20020aa78e92000000b006d9beb968c3sm18042176pfr.106 - gsmtp) uid=0 username=xxx outbytes=516 Jan 4 10:02:05 server sSMTP[25616]: Creating SSL connection to host Jan 4 10:02:05 server sSMTP[25616]: SSL connection using TLS_AES_256_GCM_SHA384 Jan 4 10:02:07 server sSMTP[25616]: Sent mail for [email protected] (221 2.0.0 closing connection e6-20020a170902744600b001d4b0ae7052sm8445005plt.135 - gsmtp) uid=0 username=xxx outbytes=503 Jan 4 10:03:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:03:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:03:02 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:03:03 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:04:20 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:04:21 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:04:29 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:04:33 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:05:54 server emhttpd: spinning down /dev/sde Jan 4 10:06:18 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:06:18 server emhttpd: read SMART /dev/sde Jan 4 10:06:18 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sde Jan 4 10:06:19 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:06:19 server emhttpd: read SMART /dev/sde Jan 4 10:07:54 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:07:55 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:08:46 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:08:47 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:09:46 server monitor: Stop running nchan processes Jan 4 10:22:54 server emhttpd: spinning down /dev/sdf Jan 4 10:23:12 server emhttpd: read SMART /dev/sdf Jan 4 10:23:36 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:23:37 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:24:16 server unraid-api[11464]: ✔️ UNRAID API started successfully! Jan 4 10:24:17 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:24:18 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:24:20 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:24:22 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:24:23 server monitor: Stop running nchan processes Jan 4 10:25:02 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:25:03 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:25:05 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) Jan 4 10:25:05 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:25:05 server rc.diskinfo[1368]: PHP Warning: exec(): Unable to fork [/usr/bin/timeout 10 /bin/lsblk -nbP -o name,type,size,fstype 2>/dev/null] in /usr/local/emhttp/plugins/unassigned.devices.preclear/scripts/rc.diskinfo on line 309 Jan 4 10:25:06 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:25:08 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:25:29 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:26:04 server monitor: Stop running nchan processes Jan 4 10:34:12 server root: ACPI action down is not defined Jan 4 10:34:26 server agetty[8680]: tty1: invalid character 0x1b in login name Jan 4 10:37:51 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:37:52 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:38:05 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:38:06 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:38:14 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:38:31 server emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) Jan 4 10:38:32 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:38:36 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:38:40 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:38:46 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:38:56 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:39:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:39:01 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:03 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:04 server unassigned.devices: Warning: shell_exec(/usr/bin/cat /proc/mounts | awk '{print $1 ',' $2}') took longer than 2s! Jan 4 10:39:05 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:06 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:07 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:08 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:10 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:11 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:12 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:13 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:16 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:17 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:19 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:20 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:25 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:26 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:39:51 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:39:55 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:40:01 server samba-dcerpcd[8680]: [2024/01/04 10:40:01.851748, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:40:01 server samba-dcerpcd[8680]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:40:01 server samba-dcerpcd[8680]: [2024/01/04 10:40:01.853603, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:40:01 server samba-dcerpcd[8680]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:40:01 server samba-dcerpcd[8680]: [2024/01/04 10:40:01.855362, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:40:01 server samba-dcerpcd[8680]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:40:01 server samba-dcerpcd[8680]: [2024/01/04 10:40:01.857113, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:40:01 server samba-dcerpcd[8680]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:40:01 server samba-dcerpcd[8680]: [2024/01/04 10:40:01.858849, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:40:01 server samba-dcerpcd[8680]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:40:01 server winbindd[21546]: [2024/01/04 10:40:01.899247, 0] ../../source3/winbindd/winbindd_samr.c:71(open_internal_samr_conn) Jan 4 10:40:01 server winbindd[21546]: open_internal_samr_conn: Could not connect to samr pipe: NT_STATUS_CONNECTION_REFUSED Jan 4 10:40:01 server winbindd[21546]: [2024/01/04 10:40:01.946781, 0] ../../source3/winbindd/winbindd_samr.c:71(open_internal_samr_conn) Jan 4 10:40:01 server winbindd[21546]: open_internal_samr_conn: Could not connect to samr pipe: NT_STATUS_CONNECTION_REFUSED Jan 4 10:40:03 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:40:04 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:40:05 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:40:06 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:40:48 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:40:49 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:40:53 server unassigned.devices: Warning: shell_exec(/usr/bin/cat /proc/mounts | awk '{print $1 ',' $2}') took longer than 2s! Jan 4 10:40:53 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:40:54 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:40:59 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:41:00 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:41:01 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:41:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:41:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:41:11 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:41:52 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:41:53 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:42:02 server samba-dcerpcd[26299]: [2024/01/04 10:42:02.019211, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 4 10:42:02 server samba-dcerpcd[26299]: sys_popenv: fork failed: Resource temporarily unavailable Jan 4 10:42:35 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:42:37 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:42:41 server rc.diskinfo[5861]: PHP Warning: exec(): Unable to fork [/usr/bin/timeout 10 /bin/lsblk -nbP -o name,type,size,fstype 2>/dev/null] in /usr/local/emhttp/plugins/unassigned.devices.preclear/scripts/rc.diskinfo on line 309 Jan 4 10:42:45 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:42:49 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:42:50 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:42:56 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:43:00 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:43:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:43:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:43:05 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:43:28 server emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) Jan 4 10:43:29 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:43:35 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:43:36 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:43:46 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:43:46 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:43:54 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:43:59 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:44:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:44:01 server crond[1684]: unable to fork (user root php /usr/local/emhttp/plugins/community.applications/scripts/notices.php > /dev/null 2>&1) Jan 4 10:44:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:44:15 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:44:16 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:44:34 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:44:49 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:44:56 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:44:59 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:45:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:45:02 server unassigned.devices: Warning: shell_exec(/bin/lsblk -nb -o size '/dev/sdf' 2>/dev/null) took longer than 0s! Jan 4 10:45:09 server unassigned.devices: Warning: shell_exec(/bin/lsblk -nb -o size '/dev/sdi' 2>/dev/null) took longer than 0s! Jan 4 10:45:09 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:18 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:21 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:24 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:25 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:27 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:29 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 4 TIMES] ### Jan 4 10:45:32 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:32 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:45:35 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:38 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:38 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:45:43 server monitor: Stop running nchan processes Jan 4 10:45:44 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:45:47 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:50 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:50 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:45:51 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:45:56 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:45:57 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:45:59 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:46:01 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:46:02 server sSMTP[4174]: Creating SSL connection to host Jan 4 10:46:02 server sSMTP[4174]: SSL connection using TLS_AES_256_GCM_SHA384 Jan 4 10:46:02 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:46:02 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:46:04 server sSMTP[4174]: Sent mail for [email protected] (221 2.0.0 closing connection s13-20020a170902b18d00b001d46a313b51sm17844477plr.72 - gsmtp) uid=0 username=xxx outbytes=516 Jan 4 10:46:05 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 18 TIMES] ### Jan 4 10:46:52 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:46:52 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:46:55 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:01 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 5 TIMES] ### Jan 4 10:47:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:47:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:47:01 server crond[1684]: unable to fork (user root /usr/bin/run-parts /etc/cron.hourly 1> /dev/null) Jan 4 10:47:01 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 3 TIMES] ### Jan 4 10:47:06 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:10 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:11 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:14 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:17 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:18 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:19 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:47:20 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:21 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:22 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:23 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:47:23 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:25 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:26 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:29 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:47:33 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdh Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdg Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdd Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sde Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdb Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdf Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdc Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: nvme0n1 Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdi Jan 4 10:47:34 server emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sda Jan 4 10:47:41 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:47:42 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:47:44 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token Jan 4 10:47:47 server monitor: Stop running nchan processes Jan 4 10:47:47 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 16 TIMES] ### Jan 4 10:48:45 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:48:46 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) Jan 4 10:48:49 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:05 server emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) Jan 4 10:49:06 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:18 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:49:31 server root: error: /plugins/unassigned.devices/UnassignedDevices.php: missing csrf_token ### [PREVIOUS LINE REPEATED 2 TIMES] ### Jan 4 10:49:33 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 2 TIMES] ### Jan 4 10:49:34 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:39 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:49:41 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:43 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:49:43 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) Jan 4 10:49:50 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:52 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:49:55 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:49:57 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:50:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:50:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:50:06 server monitor: Stop running nchan processes Jan 4 10:50:13 server emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) Jan 4 10:50:14 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:50:35 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) ### [PREVIOUS LINE REPEATED 1 TIMES] ### Jan 4 10:50:35 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:50:41 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:50:42 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:50:44 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:50:46 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:50:49 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:50:50 server php-fpm[9879]: [ERROR] fork() failed: Resource temporarily unavailable (11) Jan 4 10:51:02 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:51:08 server unassigned.devices: Warning: shell_exec(/usr/bin/cat /proc/mounts | awk '{print $1 ',' $2}') took longer than 2s! Jan 4 10:51:18 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:51:30 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:51:31 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:51:33 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:51:50 server emhttpd: Pro key detected, GUID: 0..3 FILE: /boot/config/Pro.key Jan 4 10:51:51 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:52:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix/scripts/monitor &> /dev/null) Jan 4 10:52:01 server crond[1684]: unable to fork (user root /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null) Jan 4 10:52:31 server emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) Jan 4 10:52:41 server unassigned.devices: Warning: shell_exec(/usr/bin/cat /proc/mounts | awk '{print $1 ',' $2}') took longer than 2s! Jan 4 10:52:48 server emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 4 10:52:53 server monitor: Stop running nchan processes server-diagnostics-20240104-1208.zip Quote Link to comment
remblack Posted January 5 Author Share Posted January 5 This seems to be the same issue as but it does not seems to be a clear solution. I did not format the USB an recreated the USB from backup but the same happened again this morning. Started around the same time. Quote Link to comment
JorgeB Posted January 5 Share Posted January 5 It's not the first time I see this error but it's strange because there are no USB errors, still using a new flash drive may help. Quote Link to comment
remblack Posted January 6 Author Share Posted January 6 Sure I could do that @JorgeB, but can't you replace the USB just a number of times? considering the USB does no look bad this could happens again the one right? Can the GUID be cloned or maybe someone else with the same GUID causing this problem? or could this be an issue caused by bad ram stick? I mean seems so weird how random the problem is and the fact that seems to go away just by stopping and starting the array, not even required to restart the server. Quote Link to comment
JorgeB Posted January 6 Share Posted January 6 Automatic replacement is limited to once a year but you can contact support and they can replace it for you. 8 hours ago, remblack said: or could this be an issue caused by bad ram stick? It could be a different issue, but IMHO the flash drive would be the easiest thing to try first. Quote Link to comment
PhilBarker Posted January 6 Share Posted January 6 I'm having a very similar issue - only started a few weeks ago Nearly every day I get these errors Jan 6 06:06:40 Jarvis emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 6 06:06:41 Jarvis emhttpd: Pro key detected, GUID: 0781-5571-5501-060921121721 FILE: /boot/config/Pro.key Jan 6 06:07:06 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdf Jan 6 06:07:06 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdc Jan 6 06:07:06 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: nvme0n1 Jan 6 06:07:06 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdi Jan 6 06:07:06 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sda Jan 6 06:07:16 Jarvis kernel: br0: port 2(vnet0) entered disabled state Jan 6 06:07:16 Jarvis kernel: device vnet0 left promiscuous mode Jan 6 06:07:16 Jarvis kernel: br0: port 2(vnet0) entered disabled state Jan 6 06:07:16 Jarvis usb_manager: Info: rc.usb_manager vm_action HASS stopped end - Jan 6 06:07:22 Jarvis emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 6 06:07:23 Jarvis emhttpd: Pro key detected, GUID: 0781-5571-5501-060921121721 FILE: /boot/config/Pro.key Jan 6 06:08:00 Jarvis emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 6 06:08:01 Jarvis emhttpd: Pro key detected, GUID: 0781-5571-5501-060921121721 FILE: /boot/config/Pro.key And my home assistant VM is crashed every morning I don't believe there's anything wrong with the USB pen, it's not very old and other thanit disconnecting around 6am it has no issues. I really don't know what's going on - it seems to fairly consistently happen just after 6am but I can't see anything else running/scheduled around that time Quote Link to comment
remblack Posted January 6 Author Share Posted January 6 I think is the same issues. Mine is started 2-3 days ago and it has been consistent in the morning at around 10am mst time and at night but I have not pin point the time because I have been doing some testing. Now it happened 5pm and 1am. Now I'm testing running some RAM test just in case. I wonder there is a schedule that reports to UNRAID for license validation. Quote Link to comment
PhilBarker Posted January 6 Share Posted January 6 (edited) Yeah it's weird. I've had a bunch of bizarre issues on my server over Christmas... resolved all of them by swapping out my network card, finally ditched my pcie sata card for a proper HBA... now have nothing coming up in my syslog except every day I find those and one of my VM's is dead. Weirdly my other VM isn't affected (alpine linux) but the home assistant one crashes, and occasionally I find a few dead docker containers too - all die at the time the syslog shows the flash device errors. I've tried testing the usb stick in a PC and it seems fine, I can't see any errors about usb dropping or anything. Edited January 6 by PhilBarker Quote Link to comment
PhilBarker Posted January 6 Share Posted January 6 (edited) Just remembered I have all syslogs backed up so checked them all Jan 1 06:04:34 Jarvis usb_manager: Info: rc.usb_manager vm_action HASS stopped end - Jan 1 06:05:00 Jarvis emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 1 06:05:01 Jarvis emhttpd: Pro key detected, GUID: 0781-5571-5501-060921121721 FILE: /boot/config/Pro.key Jan 1 06:06:07 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did Jan 1 06:06:07 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did Jan 1 06:06:07 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did Jan 1 06:06:13 Jarvis emhttpd: Unregistered - flash device error (ENOFLASH7) Jan 1 06:06:14 Jarvis emhttpd: Pro key detected, GUID: 0781-5571-5501-060921121721 FILE: /boot/config/Pro.key Jan 1 06:10:31 Jarvis root: Mealie: Could not download icon https://cdn.statically.io/gh/KakersUK/docker-templates/mas Jan 1 06:48:15 Jarvis kernel: usb 7-1: USB disconnect, device number 6 Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager usb_remove Broadcom_Corp_BCM20702A0_5CF370A921D6 /dev/bus/usb Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager Device Match 007/006 vm: 007 006 Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager Removed 007/006 vm: nostate 007 006 Jan 1 06:48:15 Jarvis kernel: usb 7-1: new full-speed USB device number 7 using xhci_hcd Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager usb_add Broadcom_Corp_BCM20702A0_5CF370A921D6 /dev/bus/usb/007 Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM: chip id 63 Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM: features 0x07 Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM20702A Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM20702A1 (001.002.014) build 0000 Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM: firmware Patch file not found, tried: Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM: 'brcm/BCM20702A1-0b05-17cb.hcd' Jan 1 06:48:15 Jarvis kernel: Bluetooth: hci0: BCM: 'brcm/BCM-0b05-17cb.hcd' Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager Add device with more than one interface & connect serial . Jan 1 06:48:15 Jarvis usb_manager: Info: rc.usb_manager Autoconnect No Mapping found Broadcom_Corp_BCM20702A0_5CF370A9 almost the exact same timing when this happened last week but you can see that my bluetooth dongle disconnected, then reconnected - which is probably why HASS crashes as that device is passed through to the VM So it's almost like all the usb devices disconnect and reconnect. But I have absolutely no clue why Edited January 6 by PhilBarker Quote Link to comment
PhilBarker Posted January 6 Share Posted January 6 Hrmmmmmmmm sorry to spam this thread but.... Do you use powertop? I do and.. I checked /sys/module/usbcore/parameters and mine was 2. I'm going to try changing that to -1 - I'm wondering if powertop is making the usb devices suspend when it drops down to a certain c-state Quote Link to comment
remblack Posted January 6 Author Share Posted January 6 (edited) Hi @PhilBarker, thanks for all the info. I don't have powertop installed but I checked my system and the value came back with 2 cat /sys/module/usbcore/parameters/autosuspend 2 so I added the "usbcore.autosuspend=-1" to the syslinux.cfg label Unraid OS menu default kernel /bzimage append initrd=/bzroot usbcore.autosuspend=-1 After rebooting the server the values is -1. Hopefully this solved the problem. If this is the problem, I'm wondering how come this is a problem all the sudden. I haven't modify power related configuration and this server have been running for years without issues. Cheers! Edited January 6 by remblack Quote Link to comment
PhilBarker Posted January 6 Share Posted January 6 Yeah same here. My server has been up and running for maybe near a year now. I have used powertop for most of that but as you’ve confirmed the auto suspend is set as default anyway. Not had any issues until the last few weeks. Maybe this will solve it maybe it won’t. But if it does it doesn’t explain why it’s suddenly started happening Quote Link to comment
PhilBarker Posted January 7 Share Posted January 7 (edited) Well.... this morning same issue with HASS VM - it's dead But looking at logs I didn't have the error about the USB pen and unlicensed Jan 7 06:06:33 Jarvis kernel: br0: port 2(vnet2) entered disabled state Jan 7 06:06:33 Jarvis kernel: device vnet2 left promiscuous mode Jan 7 06:06:33 Jarvis kernel: br0: port 2(vnet2) entered disabled state Jan 7 06:06:34 Jarvis usb_manager: Info: rc.usb_manager vm_action HASS stopped end - Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdd Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdf Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdc Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: nvme0n1 Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sdi Jan 7 06:06:54 Jarvis emhttpd: error: device_read_smart, 9579: Cannot allocate memory (12): device_spinup: stream did not open: sda Jan 7 06:07:02 Jarvis samba-dcerpcd[9932]: [2024/01/07 06:07:02.017455, 0] ../../lib/util/sys_popen.c:80(sys_popenv) Jan 7 06:07:02 Jarvis samba-dcerpcd[9932]: sys_popenv: fork failed: Resource temporarily unavailable Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth983191f) entered disabled state Jan 7 06:10:01 Jarvis kernel: veth8a82458: renamed from eth0 Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth983191f) entered disabled state Jan 7 06:10:01 Jarvis kernel: device veth983191f left promiscuous mode Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth983191f) entered disabled state Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth26a5504) entered blocking state Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth26a5504) entered disabled state Jan 7 06:10:01 Jarvis kernel: device veth26a5504 entered promiscuous mode Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth26a5504) entered blocking state Jan 7 06:10:01 Jarvis kernel: docker0: port 3(veth26a5504) entered forwarding state Jan 7 06:10:02 Jarvis kernel: eth0: renamed from veth849cba1 Jan 7 06:10:02 Jarvis kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth26a5504: link becomes ready Jan 7 07:00:01 Jarvis root: Restarting CA Auto Turbo Mode Jan 7 07:00:01 Jarvis kernel: mdcmd (56): set md_write_method 1 Jan 7 07:00:01 Jarvis kernel: Jan 7 07:16:58 Jarvis emhttpd: spinning down /dev/sda Jan 7 07:30:54 Jarvis kernel: usb 3-1: USB disconnect, device number 2 Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager usb_remove Broadcom_Corp_BCM20702A0_5CF370A921D6 /dev/bus/usb/003/002 003 002 Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager Device Match 003/002 vm: 003 002 Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager Removed 003/002 vm: nostate 003 002 Jan 7 07:30:54 Jarvis kernel: usb 3-1: new full-speed USB device number 5 using xhci_hcd Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager usb_add Broadcom_Corp_BCM20702A0_5CF370A921D6 /dev/bus/usb/003/005 003 005 Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM: chip id 63 Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM: features 0x07 Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM20702A Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM20702A1 (001.002.014) build 0000 Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM: firmware Patch file not found, tried: Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM: 'brcm/BCM20702A1-0b05-17cb.hcd' Jan 7 07:30:54 Jarvis kernel: Bluetooth: hci0: BCM: 'brcm/BCM-0b05-17cb.hcd' Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager Add device with more than one interface & connect serial . Jan 7 07:30:54 Jarvis usb_manager: Info: rc.usb_manager Autoconnect No Mapping found Broadcom_Corp_BCM20702A0_5CF370A921D6 /dev/bus/usb/003/005 003 005 port 3-1 Still looks like my bluetooth dongle randomly disconnected though The only other thing I'm finding that seems to be connected is usually a dead docker container. Today was Lidarr I looked at the rebuild-dndc logs and found this /usr/bin/docker run -d --name="binhex-lidarr" --net="container:binhex-qbittorrentvpn" -e UMASK="000" -e PUID="99" -e PGID="100" -e TZ="Europe/London" -v "/mnt/cache/appdata/data":"/data":rw -v "/mnt/user/Music/":"/media":rw -v "/mnt/short_cache/Downloads/Torrents/":"/downloads":rw -v "/mnt/user/appdata/binhex-lidarr":"/config":rw binhex/arch-lidarr 84c7e97f86ddcc9a8a3b6c8fc351e962e358f6138b986f72b93d54fab8e5e101 /usr/bin/docker: Error response from daemon: failed to start shim: start failed: runtime: failed to create new OS thread (have 7 already; errno=11) runtime: may need to increase max user processes (ulimit -u) fatal error: newosproc This occured at 06:05 and the HASS VM crashed 1 minute after Edited January 7 by PhilBarker Quote Link to comment
remblack Posted January 7 Author Share Posted January 7 Same here, the issues came back roughly 6hrs after the "usbcore.autosuspend=-1" change. It sucks, I had all my hopes into this this, it made sense something like that would have cause a problem. I haven't look specific on the containers logs but I under the impression might be a side effect, once the problem with the USB arise the cluster become unstable until I stop the array. 1 Quote Link to comment
PhilBarker Posted January 10 Share Posted January 10 So this might be completely unrelated - but I hate not following up on an issue I took a day to have a proper look at my server, there's been some other issues like randomly very slow copying files, even when rsyncing from disk to disk I discovered `top` was showing a massive IO wait.. all the time, causing high CPU usage After trial and error, closing VM's, shutting down docker containers one by one - I discovered this was caused by the file integrity plugin when I had ticked to automatically generate hash's on file creation/change. I turned that off and the IO wait instantly dropped from 60-80 to 0. The whole server feels tons faster now, disk speeds are a lot higher. I had presumed that was a good setting rather than having it churn through everything once a week on a schedule, but obviously not as it sets up a load of inotify tasks and grinds the disks to a halt. Since I've sorted that issue, and rebooted, I've had 3 days now without any problem with the USB stick or the VM's - so I'm not saying they're related but I wonder as there has been loads of people with this issue on the forum and none have actually found a cause for it (unless their USB was actually bad) maybe it's just a side effect of the server basically dying from some other reason. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.