Thanks in advance,
I was following the IBRACORP guide to installing Authelia, struggling with the configuration.yaml as I could not get Authelia to launch.
I had been through several rounds of edits on the confiugration.yaml and attempted to launch Authelia when my array seemed to get kicked offline and the GUI was available but very unstable.
The Docker manager and VM manager reported that the array was offline, no dockers were visible or accessible from the GUI.
I tried to use the GUI to perform a clean reboot, but it became unresponsive and required a hard cycle.
The machine booted back into a parity check, but everything else seemed normal. I deleted the Authelia installation and appdata, figured I would chase that setup at another time.
Unfortunately this crashing has continued about every 15-20 hours.
I'll attach the diagnostics, I'm no expert but it seems like the Docker.img is corrupt? Is there something else going on?
Here's a snippet of the syslog, I received an email around 12:19AM stating that the parity check had finished. In reality it looks like the array just went offline.
Thanks again, diagnostics attached.
Feb 8 14:55:06 Tower kernel: eth0: renamed from vethea5eb4e
Feb 8 14:55:06 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethb9f82a8: link becomes ready
Feb 8 14:55:06 Tower kernel: docker0: port 6(vethba926a5) entered disabled state
Feb 8 14:55:06 Tower kernel: eth0: renamed from veth060af26
Feb 8 14:55:06 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethba926a5: link becomes ready
Feb 8 14:55:06 Tower kernel: docker0: port 6(vethba926a5) entered blocking state
Feb 8 14:55:06 Tower kernel: docker0: port 6(vethba926a5) entered forwarding state
Feb 8 14:55:11 Tower kernel: vethea5eb4e: renamed from eth0
Feb 8 14:55:11 Tower kernel: docker0: port 4(vethb9f82a8) entered disabled state
Feb 8 14:55:11 Tower kernel: docker0: port 4(vethb9f82a8) entered disabled state
Feb 8 14:55:11 Tower kernel: device vethb9f82a8 left promiscuous mode
Feb 8 14:55:11 Tower kernel: docker0: port 4(vethb9f82a8) entered disabled state
Feb 8 14:55:11 Tower kernel: docker0: port 4(veth3365f3b) entered blocking state
Feb 8 14:55:11 Tower kernel: docker0: port 4(veth3365f3b) entered disabled state
Feb 8 14:55:11 Tower kernel: device veth3365f3b entered promiscuous mode
Feb 8 14:55:11 Tower kernel: docker0: port 4(veth3365f3b) entered blocking state
Feb 8 14:55:11 Tower kernel: docker0: port 4(veth3365f3b) entered forwarding state
Feb 8 14:55:11 Tower kernel: eth0: renamed from veth14b8d0f
Feb 8 14:55:11 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth3365f3b: link becomes ready
Feb 8 14:58:03 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 15:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 15:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 15:26:25 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 15:54:48 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 16:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 16:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 16:23:09 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 16:25:16 Tower emhttpd: cmd: /usr/local/emhttp/plugins/community.applications/scripts/pluginInstall.php install https://raw.githubusercontent.com/Squidly271/ca.turbo/master/plugins/ca.turbo.plg
Feb 8 16:25:16 Tower ****: plugin: running: anonymous
Feb 8 16:25:16 Tower ****: plugin: running: anonymous
Feb 8 16:25:16 Tower ****: plugin: creating: /boot/config/plugins/ca.turbo/ca.turbo-2021.03.10-x86_64-1.txz - downloading from URL https://raw.github.com/Squidly271/ca.turbo/master/archive/ca.turbo-2021.03.10-x86_64-1.txz
Feb 8 16:25:17 Tower ****: plugin: checking: /boot/config/plugins/ca.turbo/ca.turbo-2021.03.10-x86_64-1.txz - MD5
Feb 8 16:25:17 Tower ****: plugin: running: /boot/config/plugins/ca.turbo/ca.turbo-2021.03.10-x86_64-1.txz
Feb 8 16:25:17 Tower ****: plugin: running: anonymous
Feb 8 16:25:17 Tower ****: plugin: running: anonymous
Feb 8 16:25:38 Tower ****: Starting Auto Turbo
Feb 8 16:25:38 Tower kernel: mdcmd (37): set md_write_method 1
Feb 8 16:25:38 Tower kernel:
Feb 8 16:26:28 Tower ****: Stopping Auto Turbo
Feb 8 16:26:28 Tower ****: Starting Auto Turbo
Feb 8 16:26:29 Tower kernel: mdcmd (38): set md_write_method 1
Feb 8 16:26:29 Tower kernel:
Feb 8 16:36:58 Tower emhttpd: spinning down /dev/sdh
Feb 8 16:36:58 Tower emhttpd: spinning down /dev/sdi
Feb 8 16:51:32 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 17:00:02 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 17:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 17:19:53 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 17:46:32 Tower webGUI: Successful login user **** from ****217
Feb 8 17:48:14 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 18:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 18:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 18:11:56 Tower webGUI: Successful login user **** from ****217
Feb 8 18:16:36 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 18:44:58 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 19:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 19:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 19:13:19 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 19:41:42 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 20:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 20:10:02 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 20:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 20:38:23 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 20:58:27 Tower sSMTP[34633]: Creating SSL connection to host
Feb 8 20:58:27 Tower sSMTP[34633]: SSL connection using TLS_AES_256_GCM_SHA384
Feb 8 20:58:29 Tower sSMTP[34633]: Sent mail for ********** (221 2.0.0 closing connection y3sm6443052oix.41 - gsmtp) uid=0 username=**** outbytes=707
Feb 8 21:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 21:06:44 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 21:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 21:35:06 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 22:00:07 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 22:03:28 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 22:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 22:31:50 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 23:00:12 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 23:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 8 23:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 8 23:28:34 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 8 23:56:55 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 9 00:00:16 Tower crond[3055]: exit status 1 from user **** /usr/local/sbin/mover &> /dev/null
Feb 9 00:08:15 Tower emhttpd: read SMART /dev/sdh
Feb 9 00:08:45 Tower emhttpd: read SMART /dev/sdi
Feb 9 00:10:08 Tower dhcpcd[2958]: br1: dhcp_sendudp: Network is unreachable
Feb 9 00:19:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:19:01 Tower sSMTP[36648]: Creating SSL connection to host
Feb 9 00:19:01 Tower sSMTP[36648]: SSL connection using TLS_AES_256_GCM_SHA384
Feb 9 00:19:03 Tower sSMTP[36648]: Sent mail for ********** (221 2.0.0 closing connection h2sm6140912ots.51 - gsmtp) uid=0 username=**** outbytes=715
Feb 9 00:19:15 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:20:00 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:20:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:20:45 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:21:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:21:31 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:22:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:22:17 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:23:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:23:03 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:23:49 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:24:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:24:34 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:25:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:25:17 Tower ipmiseld[7365]: ****6: Error connecting: session timeout
Feb 9 00:25:20 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:26:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:26:05 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:26:51 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:27:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:27:37 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:28:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:28:22 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only 4096 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:28:31 Tower winbindd[1400]: [2022/02/09 00:28:31.484103, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:28:31 Tower winbindd[1400]: messaging_reinit() failed: NT_STATUS_DISK_FULL
Feb 9 00:28:31 Tower nmbd[1401]: [2022/02/09 00:28:31.494604, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:28:31 Tower nmbd[1401]: messaging_reinit() failed: NT_STATUS_DISK_FULL
Feb 9 00:28:37 Tower smbd[1437]: [2022/02/09 00:28:37.208898, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:28:37 Tower smbd[1437]: messaging_reinit() failed: NT_STATUS_DISK_FULL
Feb 9 00:29:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:29:09 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:29:54 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:30:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:30:40 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:31:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:31:26 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:32:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:32:11 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:32:57 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:33:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:33:43 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:34:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:34:29 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:35:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:35:15 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:36:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:36:02 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:36:47 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:37:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:37:32 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:38:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:38:19 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:39:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:39:04 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:39:50 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:40:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:40:35 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:41:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:41:22 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:42:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:42:08 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:42:54 Tower rc.diskinfo[12839]: PHP Warning: file_put_contents(): Only -1 of 10928 bytes written, possibly out of free disk space in /etc/rc.d/rc.diskinfo on line 266
Feb 9 00:43:01 Tower crond[3055]: exit status 2 from user **** /usr/local/emhttp/plugins/dynamix.system.stats/scripts/sa1 1 1 &> /dev/null
Feb 9 00:43:31 Tower winbindd[36574]: [2022/02/09 00:43:31.492601, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:43:31 Tower winbindd[36574]: messaging_reinit() failed: NT_STATUS_DISK_FULL
Feb 9 00:43:31 Tower nmbd[36575]: [2022/02/09 00:43:31.499934, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:43:31 Tower nmbd[36575]: messaging_reinit() failed: NT_STATUS_DISK_FULL
Feb 9 00:43:37 Tower smbd[36975]: [2022/02/09 00:43:37.244701, 0] ../../source3/lib/util.c:500(reinit_after_fork)
Feb 9 00:43:37 Tower smbd[36975]: messaging_reinit() failed: NT_STATUS_DISK_FULL
tower-diagnostics-20220209-0800.zip