jude Posted May 14, 2018 Share Posted May 14, 2018 If anyone could help with this I would appreciate it. I have recently moved my unRaid system from dual Xeon hardware to an AMD Ryzen 1700 setup. I have sleep states disabled as well as zen states initialised on boot. The motherboard is an Asus X370-pro and it is on the most recent bios. The only docker i am running is Plex server and I have disabled or updated the plugins. I am able to pass through a GTX1070 to a Win10 VM and everything works as it should. The problem is that within 24-30 hours or a reboot the system becomes unstable and apps or VMs become partially unusable. When the system partially crashes the unRaid GUI is still accessible except that it shows that the array is offline. I am however able to ssh into the system. I can access the array disks as well as the fuse mounts that I have to google drive and I can access files and folder structure. In this state I cannot play anything from the Plex Server but it can be used to browse content. The Win10 VM generally continues to function even after the unRaid GUI partially crashes. No other VM's or dockers can be started as it sees the array as offline. Although this sometimes flickers back and fourth from online and offline. I am attaching the diagnostics file from after the most recent crash and manual reboot. Downloading the diagnostics after parts of the system have crashed gives files with no data. I left the GUI log window open and here are the results that I can see now from the most recent crash May 13 20:32:36 Tower login[16134]: ROOT LOGIN on '/dev/pts/3' May 13 20:35:36 Tower root: Fix Common Problems Version 2018.04.25 May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application CouchPotato has moderator comments listed May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application PlexMediaServer has moderator comments listed May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application plexpy has moderator comments listed May 13 20:50:43 Tower kernel: mdcmd (44): spindown 2 May 13 20:50:45 Tower kernel: mdcmd (45): spindown 5 May 13 20:51:14 Tower kernel: mdcmd (46): spindown 3 May 13 20:51:15 Tower kernel: mdcmd (47): spindown 4 May 13 20:51:48 Tower kernel: mdcmd (48): spindown 1 May 13 20:52:20 Tower kernel: mdcmd (49): spindown 6 May 13 20:52:21 Tower kernel: mdcmd (50): spindown 0 May 13 20:52:22 Tower kernel: mdcmd (51): spindown 7 May 13 21:30:56 Tower kernel: mdcmd (52): spindown 6 May 13 21:30:57 Tower kernel: mdcmd (53): spindown 7 May 13 21:31:21 Tower kernel: mdcmd (54): spindown 5 May 13 21:31:24 Tower kernel: mdcmd (55): spindown 2 May 13 21:31:25 Tower kernel: mdcmd (56): spindown 1 May 13 21:31:25 Tower kernel: mdcmd (57): spindown 4 May 13 21:31:38 Tower kernel: mdcmd (58): spindown 3 May 13 23:10:13 Tower emhttpd: shcmd (633): /usr/sbin/hdparm -y /dev/sdb May 13 23:10:13 Tower root: May 13 23:10:13 Tower root: /dev/sdb: May 13 23:10:13 Tower root: issuing standby command May 13 23:50:30 Tower emhttpd: shcmd (715): /usr/sbin/hdparm -y /dev/sdb May 13 23:50:31 Tower root: May 13 23:50:31 Tower root: /dev/sdb: May 13 23:50:31 Tower root: issuing standby command May 14 00:00:01 Tower crond[1943]: exit status 1 from user root /usr/local/emhttp/plugins/ca.update.applications/scripts/updateApplications.php >dev/null 2>&1 May 14 00:00:01 Tower sSMTP[23325]: Creating SSL connection to host May 14 00:00:01 Tower sSMTP[23325]: SSL connection using ECDHE-RSA-AES128-GCM-SHA256 May 14 00:00:02 Tower sSMTP[23325]: Authorization failed (535 5.7.8 https://support.google.com/mail/?p=BadCredentials e139-v6sm3665146ite.42 - gsmtp) May 14 00:52:25 Tower emhttpd: shcmd (840): /usr/sbin/hdparm -y /dev/sdb May 14 00:52:25 Tower root: May 14 00:52:25 Tower root: /dev/sdb: May 14 00:52:25 Tower root: issuing standby command May 14 02:10:28 Tower emhttpd: shcmd (997): /usr/sbin/hdparm -y /dev/sdb May 14 02:10:29 Tower root: May 14 02:10:29 Tower root: /dev/sdb: May 14 02:10:29 Tower root: issuing standby command May 14 02:33:37 Tower emhttpd: shcmd (1044): /usr/sbin/hdparm -y /dev/sdb May 14 02:33:37 Tower root: May 14 02:33:37 Tower root: /dev/sdb: May 14 02:33:37 Tower root: issuing standby command May 14 03:10:22 Tower emhttpd: shcmd (1118): /usr/sbin/hdparm -y /dev/sdb May 14 03:10:22 Tower root: May 14 03:10:22 Tower root: /dev/sdb: May 14 03:10:22 Tower root: issuing standby command May 14 03:34:01 Tower emhttpd: shcmd (1167): /usr/sbin/hdparm -y /dev/sdb May 14 03:34:01 Tower root: May 14 03:34:01 Tower root: /dev/sdb: May 14 03:34:01 Tower root: issuing standby command May 14 03:40:01 Tower crond[1943]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null May 14 04:10:17 Tower emhttpd: shcmd (1240): /usr/sbin/hdparm -y /dev/sdb May 14 04:10:17 Tower root: May 14 04:10:17 Tower root: /dev/sdb: May 14 04:10:17 Tower root: issuing standby command May 14 04:33:57 Tower emhttpd: shcmd (1289): /usr/sbin/hdparm -y /dev/sdb May 14 04:33:57 Tower root: May 14 04:33:57 Tower root: /dev/sdb: May 14 04:33:57 Tower root: issuing standby command May 14 04:40:08 Tower root: /mnt/cache: 155.1 GiB (166493286400 bytes) trimmed May 14 05:13:13 Tower emhttpd: shcmd (1368): /usr/sbin/hdparm -y /dev/sdb May 14 05:13:14 Tower root: May 14 05:13:14 Tower root: /dev/sdb: May 14 05:13:14 Tower root: issuing standby command May 14 05:50:28 Tower emhttpd: shcmd (1443): /usr/sbin/hdparm -y /dev/sdb May 14 05:50:28 Tower root: May 14 05:50:28 Tower root: /dev/sdb: May 14 05:50:28 Tower root: issuing standby command May 14 07:41:44 Tower emhttpd: shcmd (1667): /usr/sbin/hdparm -y /dev/sdb May 14 07:41:44 Tower root: May 14 07:41:44 Tower root: /dev/sdb: May 14 07:41:44 Tower root: issuing standby command May 14 08:42:09 Tower emhttpd: shcmd (1789): /usr/sbin/hdparm -y /dev/sdb May 14 08:42:09 Tower root: May 14 08:42:09 Tower root: /dev/sdb: May 14 08:42:09 Tower root: issuing standby command May 14 09:45:42 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token May 14 09:45:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:46:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:47:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:48:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:49:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:49:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 14 09:49:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token that last error repeats tower-diagnostics-20180514-1128.zip Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 Here's a screen shot of what the GUI looks like when its in the error state. Quote Link to comment
CHBMB Posted May 14, 2018 Share Posted May 14, 2018 The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem. 1 Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 23 minutes ago, CHBMB said: The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem. I did do some searching on card tokens prior to posting but I couldn't find anything that helpful. I just did another search and found the following post with this section. unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error. Edited August 20, 2017 by Squid Should I repost my problem in the current release thread? Quote Link to comment
Squid Posted May 14, 2018 Share Posted May 14, 2018 I did do some searching on card tokens prior to posting but I couldn't find anything that helpful. I just did another search and found the following post with this section. unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error. Edited August 20, 2017 by Squid Should I repost my problem in the current release thread? Run am there scan of fix common problems and see what it says. Also post diagnostics Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 1 minute ago, Squid said: 3 minutes ago, jude said: I did do some searching on card tokens prior to posting but I couldn't find anything that helpful. I just did another search and found the following post with this section. unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error. Edited August 20, 2017 by Squid Should I repost my problem in the current release thread? Run am there scan of fix common problems and see what it says. Also post diagnostics Fix common problems recommend changing my Plex docker from needo to another version as well as two other Dockers that I don't start anymore. The diagnostics that I get after rebooting should be attached to the original post. Please let me know if I should post them again. Thanks Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 diagnostics attached. Thanks tower-diagnostics-20180514-1429.zip Quote Link to comment
bonienl Posted May 14, 2018 Share Posted May 14, 2018 There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot. Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 3 minutes ago, bonienl said: There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot. I've taken the diagnostics from command line a couple of times when the error occurs and the text files are all empty the last time I tried this was the message that I received (I attached that zip file to this post, but its empty) root@Tower:~# diagnostics Starting diagnostics collection... sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device sh: line 0: echo: write error: No space left on device done. ZIP file '/boot/logs/tower-diagnostics-20180512-1232.zip' created. root@Tower:~# tower-diagnostics-20180512-1232.zip Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 Here is the error log from the GUI log from the previous time (day before). After this I removed the system temp plugin May 13 10:22:34 Tower kernel: mdcmd (64): spindown 3 May 13 10:22:41 Tower kernel: mdcmd (65): spindown 1 May 13 10:23:20 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered disabled state May 13 10:23:20 Tower kernel: device vnet0 entered promiscuous mode May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered forwarding state May 13 10:23:21 Tower avahi-daemon[6053]: Joining mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e. May 13 10:23:21 Tower avahi-daemon[6053]: New relevant interface vnet0.IPv6 for mDNS. May 13 10:23:21 Tower avahi-daemon[6053]: Registering new address record for fe80::fc54:ff:fe5f:d98e on vnet0.*. May 13 10:23:22 Tower kernel: vfio_ecap_init: 0000:07:00.0 hiding ecap 0x19@0x900 May 13 10:23:22 Tower kernel: vfio-pci 0000:08:00.3: enabling device (0000 -> 0002) May 13 10:25:34 Tower avahi-daemon[6053]: Interface vnet0.IPv6 no longer relevant for mDNS. May 13 10:25:34 Tower avahi-daemon[6053]: Leaving mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e. May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state May 13 10:25:34 Tower kernel: device vnet0 left promiscuous mode May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state May 13 10:25:34 Tower avahi-daemon[6053]: Withdrawing address record for fe80::fc54:ff:fe5f:d98e on vnet0. May 13 10:25:35 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem May 13 10:39:23 Tower kernel: mdcmd (66): spindown 3 May 13 10:39:24 Tower kernel: mdcmd (67): spindown 6 May 13 12:40:14 Tower login[2199]: ROOT LOGIN on '/dev/pts/0' May 13 12:40:16 Tower login[2295]: ROOT LOGIN on '/dev/pts/1' May 13 12:40:18 Tower login[2309]: ROOT LOGIN on '/dev/pts/2' May 13 12:40:18 Tower login[2319]: ROOT LOGIN on '/dev/pts/3' May 13 13:42:18 Tower emhttpd: shcmd (3106): /usr/sbin/hdparm -y /dev/sdb May 13 13:42:18 Tower root: May 13 13:42:18 Tower root: /dev/sdb: May 13 13:42:18 Tower root: issuing standby command May 13 14:41:00 Tower login[13491]: ROOT LOGIN on '/dev/pts/0' May 13 14:41:02 Tower login[13501]: ROOT LOGIN on '/dev/pts/1' May 13 14:41:02 Tower login[13511]: ROOT LOGIN on '/dev/pts/2' May 13 14:41:04 Tower login[13524]: ROOT LOGIN on '/dev/pts/3' May 13 15:41:37 Tower emhttpd: shcmd (3345): /usr/sbin/hdparm -y /dev/sdb May 13 15:41:37 Tower root: May 13 15:41:37 Tower root: /dev/sdb: May 13 15:41:37 Tower root: issuing standby command May 13 16:43:02 Tower emhttpd: shcmd (3469): /usr/sbin/hdparm -y /dev/sdb May 13 16:43:02 Tower root: May 13 16:43:02 Tower root: /dev/sdb: May 13 16:43:02 Tower root: issuing standby command May 13 18:05:06 Tower emhttpd: shcmd (3634): /usr/sbin/hdparm -y /dev/sdb May 13 18:05:06 Tower root: May 13 18:05:06 Tower root: /dev/sdb: May 13 18:05:06 Tower root: issuing standby command May 13 18:31:03 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token May 13 18:31:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:31:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:31:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:31:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:31:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:31:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:32:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:32:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:32:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:32:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:32:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:32:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:33:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:33:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:34:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:34:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:35:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:35:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:35:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:35:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:35:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:36:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:36:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:46 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:46 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:37:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:37:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:38:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:38:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:38:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:38:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:38:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:38:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:39:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:39:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:39:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:39:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:39:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:39:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:40:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:52 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:52 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:40:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:41:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:54 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:41:54 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:42:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:42:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:42:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:42:56 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:56 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:42:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:43:58 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:43:58 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:44:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:44:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:44:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:44:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:44:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:44:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:45:00 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:00 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:45:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:45:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:45:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:45:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:45:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:46:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:46:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:47:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:47:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:47:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:47:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:47:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:47:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:48:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:48:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:48:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:48:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:48:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:48:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:39 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:39 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:49:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:49:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:50:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:50:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:51:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:51:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:51:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:51:43 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:43 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:51:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:51:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:52:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:52:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:52:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:52:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:52:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:52:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:47 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:47 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:53:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:53:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:54:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:54:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:55:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:55:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:55:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:55:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:55:51 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:55:51 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:56:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:56:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:56:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:56:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:56:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:56:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:57:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:55 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:57:55 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:59:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:59:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:59:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 18:59:59 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 18:59:59 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:00:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:00:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:00:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:00:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:00:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:01:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:01:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:01:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:01:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:01:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:01:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:02:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:02:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:03:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:03:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:03:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:03:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:03:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:03:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:04:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:04:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:04:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:04:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:04:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:04:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:05:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:05:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:06:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:06:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:07:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token May 13 19:07:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token May 13 19:07:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token Quote Link to comment
bonienl Posted May 14, 2018 Share Posted May 14, 2018 (edited) The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)? Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error). Edited May 14, 2018 by bonienl Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 1 minute ago, bonienl said: The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)? Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error). OK that makes sense. I do have PlexServer setup to use ram for transcoding but I do not use transcoding on this machine or share it with anyone at another location that would require transcoding. The current transcode location is /tmp I'll change it to a location on the SSD cache drive and see if that makes things work better. I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible. Quote Link to comment
bonienl Posted May 14, 2018 Share Posted May 14, 2018 (edited) 16 minutes ago, jude said: I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible. Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal. So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result. # df Filesystem Size Used Avail Use% Mounted on rootfs 7.8G 655M 7.2G 9% / tmpfs 7.9G 0 7.9G 0% /dev/shm Edited May 14, 2018 by bonienl Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 1 minute ago, bonienl said: Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal. So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result. # df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 65870568 507928 65362640 1% / tmpfs 65988212 0 65988212 0% /dev/shm Thats really good to know. I'll keep an eye on that too. The Xeon system i've just migrated from had 128GB of ram so I never even thought about it. Having 16GB now is a bit of an adjustment. I'll monitor and report back. Thanks for the help Quote Link to comment
jude Posted May 14, 2018 Author Share Posted May 14, 2018 With one Win10 VM (4GB RAM) and a Plex Server docker running this is how the memory allocation looks. Does it look normal/OK? root@Tower:~# free -m total used free shared buff/cache available Mem: 15979 5651 252 2162 10075 7575 Swap: 0 0 0 root@Tower:~# root@Tower:~# df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 8138444 2211552 5926892 28% / tmpfs 32768 680 32088 3% /run devtmpfs 8138456 0 8138456 0% /dev tmpfs 8181420 0 8181420 0% /dev/shm cgroup_root 8192 0 8192 0% /sys/fs/cgroup tmpfs 131072 836 130236 1% /var/log root@Tower:~# ps aux | awk '{print $6/1024 " MB\t\t" $11}' | sort -n 0 MB COMMAND 0 MB [amd_iommu_v2] 0 MB [ata_sff] 0 MB [btrfs-cache] 0 MB [btrfs-cache] 0 MB [btrfs-cleaner] 0 MB [btrfs-cleaner] 0 MB [btrfs-delalloc] 0 MB [btrfs-delalloc] 0 MB [btrfs-delayed-m] 0 MB [btrfs-delayed-m] 0 MB [btrfs-endio-met] 0 MB [btrfs-endio-met] 0 MB [btrfs-endio-met] 0 MB [btrfs-endio-met] 0 MB [btrfs-endio-rai] 0 MB [btrfs-endio-rai] 0 MB [btrfs-endio-rep] 0 MB [btrfs-endio-rep] 0 MB [btrfs-endio-wri] 0 MB [btrfs-endio-wri] 0 MB [btrfs-endio] 0 MB [btrfs-endio] 0 MB [btrfs-extent-re] 0 MB [btrfs-extent-re] 0 MB [btrfs-fixup] 0 MB [btrfs-fixup] 0 MB [btrfs-flush_del] 0 MB [btrfs-flush_del] 0 MB [btrfs-freespace] 0 MB [btrfs-freespace] 0 MB [btrfs-qgroup-re] 0 MB [btrfs-qgroup-re] 0 MB [btrfs-readahead] 0 MB [btrfs-readahead] 0 MB [btrfs-rmw] 0 MB [btrfs-rmw] 0 MB [btrfs-submit] 0 MB [btrfs-submit] 0 MB [btrfs-transacti] 0 MB [btrfs-transacti] 0 MB [btrfs-worker-hi] 0 MB [btrfs-worker-hi] 0 MB [btrfs-worker] 0 MB [btrfs-worker] 0 MB [ccp-1-q2] 0 MB [ccp-1-q3] 0 MB [ccp-1-q4] 0 MB [cpuhp/0] 0 MB [cpuhp/10] 0 MB [cpuhp/11] 0 MB [cpuhp/12] 0 MB [cpuhp/13] 0 MB [cpuhp/14] 0 MB [cpuhp/15] 0 MB [cpuhp/1] 0 MB [cpuhp/2] 0 MB [cpuhp/3] 0 MB [cpuhp/4] 0 MB [cpuhp/5] 0 MB [cpuhp/6] 0 MB [cpuhp/7] 0 MB [cpuhp/8] 0 MB [cpuhp/9] 0 MB [crypto] 0 MB [devfreq_wq] 0 MB [edac-poller] 0 MB [fw_event_mpt2sa] 0 MB [ipv6_addrconf] 0 MB [irq/27-AMD-Vi] 0 MB [kblockd] 0 MB [kcompactd0] 0 MB [kdevtmpfs] 0 MB [khugepaged] 0 MB [kintegrityd] 0 MB [ksmd] 0 MB [ksoftirqd/0] 0 MB [ksoftirqd/10] 0 MB [ksoftirqd/11] 0 MB [ksoftirqd/12] 0 MB [ksoftirqd/13] 0 MB [ksoftirqd/14] 0 MB [ksoftirqd/15] 0 MB [ksoftirqd/1] 0 MB [ksoftirqd/2] 0 MB [ksoftirqd/3] 0 MB [ksoftirqd/4] 0 MB [ksoftirqd/5] 0 MB [ksoftirqd/6] 0 MB [ksoftirqd/7] 0 MB [ksoftirqd/8] 0 MB [ksoftirqd/9] 0 MB [kswapd0] 0 MB [kthreadd] 0 MB [kthrotld] 0 MB [kvm-pit/3772] 0 MB [kworker/0:0H] 0 MB [kworker/0:0] 0 MB [kworker/0:1H] 0 MB [kworker/0:2] 0 MB [kworker/10:0H] 0 MB [kworker/10:0] 0 MB [kworker/10:1H] 0 MB [kworker/10:1] 0 MB [kworker/11:0H] 0 MB [kworker/11:1H] 0 MB [kworker/11:1] 0 MB [kworker/11:2] 0 MB [kworker/12:0H] 0 MB [kworker/12:0] 0 MB [kworker/12:1H] 0 MB [kworker/12:2] 0 MB [kworker/13:0H] 0 MB [kworker/13:0] 0 MB [kworker/13:1H] 0 MB [kworker/13:1] 0 MB [kworker/14:0H] 0 MB [kworker/14:1H] 0 MB [kworker/14:1] 0 MB [kworker/14:2] 0 MB [kworker/15:0H] 0 MB [kworker/15:0] 0 MB [kworker/15:1H] 0 MB [kworker/15:1] 0 MB [kworker/1:0H] 0 MB [kworker/1:1H] 0 MB [kworker/1:1] 0 MB [kworker/1:2] 0 MB [kworker/2:0H] 0 MB [kworker/2:1H] 0 MB [kworker/2:1] 0 MB [kworker/2:2] 0 MB [kworker/3:0H] 0 MB [kworker/3:0] 0 MB [kworker/3:1H] 0 MB [kworker/3:1] 0 MB [kworker/4:0H] 0 MB [kworker/4:1H] 0 MB [kworker/4:1] 0 MB [kworker/4:2] 0 MB [kworker/5:0H] 0 MB [kworker/5:1H] 0 MB [kworker/5:1] 0 MB [kworker/5:2] 0 MB [kworker/6:0H] 0 MB [kworker/6:0] 0 MB [kworker/6:1H] 0 MB [kworker/6:1] 0 MB [kworker/7:0H] 0 MB [kworker/7:1H] 0 MB [kworker/7:1] 0 MB [kworker/7:2] 0 MB [kworker/8:0H] 0 MB [kworker/8:0] 0 MB [kworker/8:1H] 0 MB [kworker/8:1] 0 MB [kworker/8:2] 0 MB [kworker/9:0H] 0 MB [kworker/9:1H] 0 MB [kworker/9:1] 0 MB [kworker/9:2] 0 MB [kworker/u32:0] 0 MB [kworker/u32:1] 0 MB [kworker/u32:2] 0 MB [kworker/u33:0] 0 MB [lockd] 0 MB [loop0] 0 MB [loop1] 0 MB [loop2] 0 MB [loop3] 0 MB [md] 0 MB [mdrecoveryd] 0 MB [migration/0] 0 MB [migration/10] 0 MB [migration/11] 0 MB [migration/12] 0 MB [migration/13] 0 MB [migration/14] 0 MB [migration/15] 0 MB [migration/1] 0 MB [migration/2] 0 MB [migration/3] 0 MB [migration/4] 0 MB [migration/5] 0 MB [migration/6] 0 MB [migration/7] 0 MB [migration/8] 0 MB [migration/9] 0 MB [mm_percpu_wq] 0 MB [netns] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [nfsd] 0 MB [oom_reaper] 0 MB [poll_mpt2sas0_s] 0 MB [rcu_bh] 0 MB [rcu_preempt] 0 MB [rcu_sched] 0 MB [rcuob/0] 0 MB [rcuob/1] 0 MB [rcuob/2] 0 MB [rcuob/3] 0 MB [rcuob/4] 0 MB [rcuob/5] 0 MB [rcuob/6] 0 MB [rcuob/7] 0 MB [rcuop/0] 0 MB [rcuop/1] 0 MB [rcuop/2] 0 MB [rcuop/3] 0 MB [rcuop/4] 0 MB [rcuop/5] 0 MB [rcuop/6] 0 MB [rcuop/7] 0 MB [rcuos/0] 0 MB [rcuos/1] 0 MB [rcuos/2] 0 MB [rcuos/3] 0 MB [rcuos/4] 0 MB [rcuos/5] 0 MB [rcuos/6] 0 MB [rcuos/7] 0 MB [reiserfs/md1] 0 MB [reiserfs/md2] 0 MB [reiserfs/md3] 0 MB [reiserfs/md4] 0 MB [reiserfs/md5] 0 MB [rpciod] 0 MB [scsi_eh_0] 0 MB [scsi_eh_10] 0 MB [scsi_eh_1] 0 MB [scsi_eh_2] 0 MB [scsi_eh_3] 0 MB [scsi_eh_4] 0 MB [scsi_eh_5] 0 MB [scsi_eh_6] 0 MB [scsi_eh_7] 0 MB [scsi_eh_8] 0 MB [scsi_eh_9] 0 MB [scsi_tmf_0] 0 MB [scsi_tmf_10] 0 MB [scsi_tmf_1] 0 MB [scsi_tmf_2] 0 MB [scsi_tmf_3] 0 MB [scsi_tmf_4] 0 MB [scsi_tmf_5] 0 MB [scsi_tmf_6] 0 MB [scsi_tmf_7] 0 MB [scsi_tmf_8] 0 MB [scsi_tmf_9] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [spinupd] 0 MB [unraidd] 0 MB [usb-storage] 0 MB [vfio-irqfd-clea] 0 MB [vhost-3772] 0 MB [writeback] 0 MB [xfs-buf/md6] 0 MB [xfs-buf/md7] 0 MB [xfs-buf/sdb1] 0 MB [xfs-cil/md6] 0 MB [xfs-cil/md7] 0 MB [xfs-cil/sdb1] 0 MB [xfs-conv/md6] 0 MB [xfs-conv/md7] 0 MB [xfs-conv/sdb1] 0 MB [xfs-data/md6] 0 MB [xfs-data/md7] 0 MB [xfs-data/sdb1] 0 MB [xfs-eofblocks/m] 0 MB [xfs-eofblocks/m] 0 MB [xfs-eofblocks/s] 0 MB [xfs-log/md6] 0 MB [xfs-log/md7] 0 MB [xfs-log/sdb1] 0 MB [xfs-reclaim/md6] 0 MB [xfs-reclaim/md7] 0 MB [xfs-reclaim/sdb] 0 MB [xfs_mru_cache] 0 MB [xfsaild/md6] 0 MB [xfsaild/md7] 0 MB [xfsaild/sdb1] 0 MB [xfsalloc] 0 MB [xprtiod] 0.00390625 MB runsv 0.00390625 MB runsv 0.00390625 MB runsv 0.00390625 MB runsv 0.00390625 MB runsv 0.0429688 MB /usr/bin/runsvdir 0.0859375 MB /usr/sbin/acpid 0.109375 MB /usr/sbin/avahi-dnsconfd 0.226562 MB /usr/sbin/dnsmasq 0.257812 MB avahi-daemon: 0.558594 MB /usr/local/sbin/shfs 0.660156 MB tail 0.753906 MB sleep 0.78125 MB /bin/sh 0.792969 MB /usr/bin/tail 0.800781 MB init 0.875 MB /bin/timeout 1.43359 MB /usr/sbin/atd 1.55469 MB /usr/sbin/crond 1.62891 MB /sbin/agetty 1.71484 MB /sbin/agetty 1.71484 MB /sbin/agetty 1.71484 MB /usr/sbin/inetd 1.76562 MB /sbin/agetty 1.85156 MB /sbin/agetty 1.86719 MB /sbin/agetty 2.01172 MB sort 2.17969 MB /usr/sbin/rpc.mountd 2.19531 MB /sbin/apcupsd 2.21484 MB /sbin/rpcbind 2.24219 MB /usr/sbin/dnsmasq 2.32422 MB /usr/bin/dbus-daemon 2.48047 MB ps 2.66797 MB /usr/local/sbin/emhttpd 2.75781 MB find 2.77344 MB /usr/sbin/sshd 2.78516 MB /bin/bash 2.78906 MB /bin/bash 2.78906 MB /usr/sbin/cron 2.79688 MB /bin/bash 2.80469 MB sh 2.85547 MB /usr/local/sbin/emhttpd 2.91406 MB /usr/sbin/netatalk 2.93359 MB /bin/bash 3.24609 MB docker-containerd-shim 3.25391 MB /usr/sbin/rsyslogd 3.26172 MB awk 3.27344 MB avahi-daemon: 3.49219 MB /usr/sbin/virtlockd 3.58984 MB nginx: 3.68359 MB /bin/bash 3.70703 MB -bash 3.83594 MB -bash 3.85547 MB -bash 3.89844 MB -bash 3.94141 MB -bash 3.94141 MB -bash 3.94141 MB /sbin/udevd 4.01953 MB /usr/sbin/virtlogd 4.06641 MB /usr/sbin/cnid_metad 4.3125 MB /usr/sbin/smbd 4.48828 MB Plex 4.68359 MB /usr/sbin/afpd 4.91797 MB sshd: 5.21484 MB /usr/sbin/ntpd 5.29297 MB ttyd 5.82812 MB /sbin/rpc.statd 5.85547 MB /usr/sbin/smbd 5.93359 MB /usr/sbin/nmbd 6.1875 MB /usr/local/sbin/shfs 6.59375 MB /usr/sbin/winbindd 6.61328 MB syslog-ng 7.52734 MB nginx: 9.34375 MB /usr/sbin/winbindd 9.36719 MB /usr/bin/python3 9.96094 MB /usr/sbin/winbindd 12.4258 MB php-fpm: 13.2344 MB docker-containerd 13.8633 MB php-fpm: 13.8672 MB php-fpm: 15.8867 MB /usr/sbin/smbd 16.457 MB /usr/lib/plexmediaserver/Plex 16.832 MB /usr/sbin/smbd 18.4961 MB /usr/sbin/libvirtd 20.1875 MB rcloneorig 21.2383 MB rcloneorig 23.2266 MB /usr/bin/php 34.5 MB Plex 43.2773 MB /usr/bin/dockerd 43.5078 MB Plex 46.1836 MB Plex 56.9062 MB rcloneorig 61.5156 MB Plex 175.668 MB ./Plex 4160.18 MB /usr/bin/qemu-system-x86_64 root@Tower:~# Quote Link to comment
jude Posted May 15, 2018 Author Share Posted May 15, 2018 The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%. root@Tower:~# df -h / Filesystem Size Used Avail Use% Mounted on rootfs 7.8G 7.5G 282M 97% / root@Tower:~# df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 8138444 7850684 287760 97% / tmpfs 32768 628 32140 2% /run devtmpfs 8138456 0 8138456 0% /dev tmpfs 8181420 0 8181420 0% /dev/shm cgroup_root 8192 0 8192 0% /sys/fs/cgroup tmpfs 131072 836 130236 1% /var/log /dev/sda1 3938272 1341680 2596592 35% /boot /dev/loop0 7680 7680 0 100% /lib/modules /dev/loop1 4608 4608 0 100% /lib/firmware /dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1 /dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2 /dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3 /dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4 /dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5 /dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6 /dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7 /dev/sdb1 499863384 337906828 161956556 68% /mnt/cache shfs 15625840360 12767995060 2857845300 82% /mnt/user0 shfs 16125703744 13105901888 3019801856 82% /mnt/user google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google /dev/loop2 20971520 5332000 13948304 28% /var/lib/docker encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted /dev/loop3 1048576 17380 647164 3% /etc/libvirt root@Tower:~# root@Tower:~# free -m total used free shared buff/cache available Mem: 15979 944 4286 7668 10748 6773 Swap: 0 0 0 root@Tower:~# I've taken another diagnostic that I'll attach to this post. How do I figure out whats filling up Rootfs? tower-diagnostics-20180515-1343.zip Quote Link to comment
CHBMB Posted May 15, 2018 Share Posted May 15, 2018 The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%. root@Tower:~# df -h / Filesystem Size Used Avail Use% Mounted on rootfs 7.8G 7.5G 282M 97% / root@Tower:~# df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 8138444 7850684 287760 97% / tmpfs 32768 628 32140 2% /run devtmpfs 8138456 0 8138456 0% /dev tmpfs 8181420 0 8181420 0% /dev/shm cgroup_root 8192 0 8192 0% /sys/fs/cgroup tmpfs 131072 836 130236 1% /var/log /dev/sda1 3938272 1341680 2596592 35% /boot /dev/loop0 7680 7680 0 100% /lib/modules /dev/loop1 4608 4608 0 100% /lib/firmware /dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1 /dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2 /dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3 /dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4 /dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5 /dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6 /dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7 /dev/sdb1 499863384 337906828 161956556 68% /mnt/cache shfs 15625840360 12767995060 2857845300 82% /mnt/user0 shfs 16125703744 13105901888 3019801856 82% /mnt/user google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google /dev/loop2 20971520 5332000 13948304 28% /var/lib/docker encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted /dev/loop3 1048576 17380 647164 3% /etc/libvirtroot@Tower:~# root@Tower:~# free -m total used free shared buff/cache available Mem: 15979 944 4286 7668 10748 6773 Swap: 0 0 0root@Tower:~# I've taken another diagnostic that I'll attach to this post. How do I figure out whats filling up Rootfs?tower-diagnostics-20180515-1343.zipPost your docker run command for Plex. My money is going to be on that. Quote Link to comment
jude Posted May 15, 2018 Author Share Posted May 15, 2018 Ho 7 minutes ago, CHBMB said: 9 minutes ago, jude said: The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%. root@Tower:~# df -h / Filesystem Size Used Avail Use% Mounted on rootfs 7.8G 7.5G 282M 97% / root@Tower:~# df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 8138444 7850684 287760 97% / tmpfs 32768 628 32140 2% /run devtmpfs 8138456 0 8138456 0% /dev tmpfs 8181420 0 8181420 0% /dev/shm cgroup_root 8192 0 8192 0% /sys/fs/cgroup tmpfs 131072 836 130236 1% /var/log /dev/sda1 3938272 1341680 2596592 35% /boot /dev/loop0 7680 7680 0 100% /lib/modules /dev/loop1 4608 4608 0 100% /lib/firmware /dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1 /dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2 /dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3 /dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4 /dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5 /dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6 /dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7 /dev/sdb1 499863384 337906828 161956556 68% /mnt/cache shfs 15625840360 12767995060 2857845300 82% /mnt/user0 shfs 16125703744 13105901888 3019801856 82% /mnt/user google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google /dev/loop2 20971520 5332000 13948304 28% /var/lib/docker encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted /dev/loop3 1048576 17380 647164 3% /etc/libvirtroot@Tower:~# root@Tower:~# free -m total used free shared buff/cache available Mem: 15979 944 4286 7668 10748 6773 Swap: 0 0 0root@Tower:~# I've taken another diagnostic that I'll attach to this post. How do I figure out whats filling up Rootfs?tower-diagnostics-20180515-1343.zip Post your docker run command for Plex. My money is going to be on that. Sorry, how do I find that? Quote Link to comment
CHBMB Posted May 15, 2018 Share Posted May 15, 2018 There's a link in my signature or there's a link in the Docker FAQ sticky. Quote Link to comment
jude Posted May 15, 2018 Author Share Posted May 15, 2018 (edited) OK found an explanation of how to get the docker run command here Here is the docker run command root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='PlexMediaServer-needo' --net='host' --privileged=true -e TZ="America/Chicago" -e HOST_OS="unRAID" -e 'VERSION'='' -v '/mnt/cache/apps/Plex/transcode':'/transcode':'rw' -v '/mnt/cache/apps/Plex/':'/config':'rw' -v '/mnt/':'/mnt':'rw' -v '/mnt/disks/encrypted/movies':'/MoviesArchive':'ro,slave' -v '/mnt/disks/encrypted/tv':'/TVarchive':'ro,slave' --cpuset-cpus=2,3,4,5,6,7 'needo/plex' fcfd206c0fd16979cc4f3e33a00a11278409daf696593b712a75d965ae55f96d Edited May 15, 2018 by jude Quote Link to comment
CHBMB Posted May 15, 2018 Share Posted May 15, 2018 Aside from using needo's extremely old container version of Plex, can't see anything there that is directly mapped to memory. Quote Link to comment
jude Posted May 15, 2018 Author Share Posted May 15, 2018 11 minutes ago, CHBMB said: Aside from using needo's extremely old container version of Plex, can't see anything there that is directly mapped to memory. Is there a way of listing the contents of Rootfs to show whats going on? Quote Link to comment
John_M Posted May 15, 2018 Share Posted May 15, 2018 Why don't you try not running certain add-ons for a while? If your rootfs fills up in 22 hours it should only take a day to eliminate each one once and for all. Quote Link to comment
jude Posted May 16, 2018 Author Share Posted May 16, 2018 I think it all stems from the cache setting for Rclone cache mounts. I've made changes to Rclone cache configuration and i'll monitor to see if this works. Quote Link to comment
jude Posted May 16, 2018 Author Share Posted May 16, 2018 Things are working much better now. I'm going to call it solved. The Cache setting in Rclone was set too high. I have lowered maximum cache to 1GB. Rootfs is now staying around 21% full. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.