uninitialized csrf_token error - Rootfs full (solved) - General Support

May 14, 20188 yr

If anyone could help with this I would appreciate it.

I have recently moved my unRaid system from dual Xeon hardware to an AMD Ryzen 1700 setup. I have sleep states disabled as well as zen states initialised on boot.

The motherboard is an Asus X370-pro and it is on the most recent bios.

The only docker i am running is Plex server and I have disabled or updated the plugins.

I am able to pass through a GTX1070 to a Win10 VM and everything works as it should.

The problem is that within 24-30 hours or a reboot the system becomes unstable and apps or VMs become partially unusable. When the system partially crashes the unRaid GUI is still accessible except that it shows that the array is offline. I am however able to ssh into the system. I can access the array disks as well as the fuse mounts that I have to google drive and I can access files and folder structure. In this state I cannot play anything from the Plex Server but it can be used to browse content. The Win10 VM generally continues to function even after the unRaid GUI partially crashes. No other VM's or dockers can be started as it sees the array as offline. Although this sometimes flickers back and fourth from online and offline.

I am attaching the diagnostics file from after the most recent crash and manual reboot.

Downloading the diagnostics after parts of the system have crashed gives files with no data. I left the GUI log window open and here are the results that I can see now from the most recent crash

May 13 20:32:36 Tower login[16134]: ROOT LOGIN on '/dev/pts/3'

May 13 20:35:36 Tower root: Fix Common Problems Version 2018.04.25

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application CouchPotato has moderator comments listed

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application PlexMediaServer has moderator comments listed

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application plexpy has moderator comments listed

May 13 20:50:43 Tower kernel: mdcmd (44): spindown 2

May 13 20:50:45 Tower kernel: mdcmd (45): spindown 5

May 13 20:51:14 Tower kernel: mdcmd (46): spindown 3

May 13 20:51:15 Tower kernel: mdcmd (47): spindown 4

May 13 20:51:48 Tower kernel: mdcmd (48): spindown 1

May 13 20:52:20 Tower kernel: mdcmd (49): spindown 6

May 13 20:52:21 Tower kernel: mdcmd (50): spindown 0

May 13 20:52:22 Tower kernel: mdcmd (51): spindown 7

May 13 21:30:56 Tower kernel: mdcmd (52): spindown 6

May 13 21:30:57 Tower kernel: mdcmd (53): spindown 7

May 13 21:31:21 Tower kernel: mdcmd (54): spindown 5

May 13 21:31:24 Tower kernel: mdcmd (55): spindown 2

May 13 21:31:25 Tower kernel: mdcmd (56): spindown 1

May 13 21:31:25 Tower kernel: mdcmd (57): spindown 4

May 13 21:31:38 Tower kernel: mdcmd (58): spindown 3

May 13 23:10:13 Tower emhttpd: shcmd (633): /usr/sbin/hdparm -y /dev/sdb

May 13 23:10:13 Tower root:

May 13 23:10:13 Tower root: /dev/sdb:

May 13 23:10:13 Tower root: issuing standby command

May 13 23:50:30 Tower emhttpd: shcmd (715): /usr/sbin/hdparm -y /dev/sdb

May 13 23:50:31 Tower root:

May 13 23:50:31 Tower root: /dev/sdb:

May 13 23:50:31 Tower root: issuing standby command

May 14 00:00:01 Tower crond[1943]: exit status 1 from user root /usr/local/emhttp/plugins/ca.update.applications/scripts/updateApplications.php >dev/null 2>&1

May 14 00:00:01 Tower sSMTP[23325]: Creating SSL connection to host

May 14 00:00:01 Tower sSMTP[23325]: SSL connection using ECDHE-RSA-AES128-GCM-SHA256

May 14 00:00:02 Tower sSMTP[23325]: Authorization failed (535 5.7.8 https://support.google.com/mail/?p=BadCredentials e139-v6sm3665146ite.42 - gsmtp)

May 14 00:52:25 Tower emhttpd: shcmd (840): /usr/sbin/hdparm -y /dev/sdb

May 14 00:52:25 Tower root:

May 14 00:52:25 Tower root: /dev/sdb:

May 14 00:52:25 Tower root: issuing standby command

May 14 02:10:28 Tower emhttpd: shcmd (997): /usr/sbin/hdparm -y /dev/sdb

May 14 02:10:29 Tower root:

May 14 02:10:29 Tower root: /dev/sdb:

May 14 02:10:29 Tower root: issuing standby command

May 14 02:33:37 Tower emhttpd: shcmd (1044): /usr/sbin/hdparm -y /dev/sdb

May 14 02:33:37 Tower root:

May 14 02:33:37 Tower root: /dev/sdb:

May 14 02:33:37 Tower root: issuing standby command

May 14 03:10:22 Tower emhttpd: shcmd (1118): /usr/sbin/hdparm -y /dev/sdb

May 14 03:10:22 Tower root:

May 14 03:10:22 Tower root: /dev/sdb:

May 14 03:10:22 Tower root: issuing standby command

May 14 03:34:01 Tower emhttpd: shcmd (1167): /usr/sbin/hdparm -y /dev/sdb

May 14 03:34:01 Tower root:

May 14 03:34:01 Tower root: /dev/sdb:

May 14 03:34:01 Tower root: issuing standby command

May 14 03:40:01 Tower crond[1943]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null

May 14 04:10:17 Tower emhttpd: shcmd (1240): /usr/sbin/hdparm -y /dev/sdb

May 14 04:10:17 Tower root:

May 14 04:10:17 Tower root: /dev/sdb:

May 14 04:10:17 Tower root: issuing standby command

May 14 04:33:57 Tower emhttpd: shcmd (1289): /usr/sbin/hdparm -y /dev/sdb

May 14 04:33:57 Tower root:

May 14 04:33:57 Tower root: /dev/sdb:

May 14 04:33:57 Tower root: issuing standby command

May 14 04:40:08 Tower root: /mnt/cache: 155.1 GiB (166493286400 bytes) trimmed

May 14 05:13:13 Tower emhttpd: shcmd (1368): /usr/sbin/hdparm -y /dev/sdb

May 14 05:13:14 Tower root:

May 14 05:13:14 Tower root: /dev/sdb:

May 14 05:13:14 Tower root: issuing standby command

May 14 05:50:28 Tower emhttpd: shcmd (1443): /usr/sbin/hdparm -y /dev/sdb

May 14 05:50:28 Tower root:

May 14 05:50:28 Tower root: /dev/sdb:

May 14 05:50:28 Tower root: issuing standby command

May 14 07:41:44 Tower emhttpd: shcmd (1667): /usr/sbin/hdparm -y /dev/sdb

May 14 07:41:44 Tower root:

May 14 07:41:44 Tower root: /dev/sdb:

May 14 07:41:44 Tower root: issuing standby command

May 14 08:42:09 Tower emhttpd: shcmd (1789): /usr/sbin/hdparm -y /dev/sdb

May 14 08:42:09 Tower root:

May 14 08:42:09 Tower root: /dev/sdb:

May 14 08:42:09 Tower root: issuing standby command

May 14 09:45:42 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token

May 14 09:45:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

that last error repeats

tower-diagnostics-20180514-1128.zip

Quote

May 14, 20188 yr

Author

Here's a screen shot of what the GUI looks like when its in the error state.

Quote

May 14, 20188 yr

The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem.

Quote

May 14, 20188 yr

Author

23 minutes ago, CHBMB said:

The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem.

I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.

I just did another search and found the following post with this section.

unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.

Edited August 20, 2017 by Squid

Should I repost my problem in the current release thread?

Quote

May 14, 20188 yr

I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.

I just did another search and found the following post with this section.

unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.
Edited August 20, 2017 by Squid

Should I repost my problem in the current release thread?

Run am there scan of fix common problems and see what it says. Also post diagnostics

Quote

May 14, 20188 yr

Author

1 minute ago, Squid said:

3 minutes ago, jude said:

I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.

I just did another search and found the following post with this section.

unitialized csrf_token - Thus far the community has never onceseen any report of this being logged. Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running. EDIT: There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.
Edited August 20, 2017 by Squid

Should I repost my problem in the current release thread?

Run am there scan of fix common problems and see what it says. Also post diagnostics

Fix common problems recommend changing my Plex docker from needo to another version as well as two other Dockers that I don't start anymore. The diagnostics that I get after rebooting should be attached to the original post. Please let me know if I should post them again. Thanks

Quote

May 14, 20188 yr

Author

diagnostics attached. Thanks

tower-diagnostics-20180514-1429.zip

Quote

May 14, 20188 yr

There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot.

Quote

May 14, 20188 yr

Author

3 minutes ago, bonienl said:

There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot.

I've taken the diagnostics from command line a couple of times when the error occurs and the text files are all empty

the last time I tried this was the message that I received (I attached that zip file to this post, but its empty)

root@Tower:~# diagnostics

Starting diagnostics collection... sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

done.

ZIP file '/boot/logs/tower-diagnostics-20180512-1232.zip' created.

root@Tower:~#

tower-diagnostics-20180512-1232.zip

Quote

May 14, 20188 yr

Author

Here is the error log from the GUI log from the previous time (day before). After this I removed the system temp plugin

May 13 10:22:34 Tower kernel: mdcmd (64): spindown 3

May 13 10:22:41 Tower kernel: mdcmd (65): spindown 1

May 13 10:23:20 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:23:20 Tower kernel: device vnet0 entered promiscuous mode

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered forwarding state

May 13 10:23:21 Tower avahi-daemon[6053]: Joining mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e.

May 13 10:23:21 Tower avahi-daemon[6053]: New relevant interface vnet0.IPv6 for mDNS.

May 13 10:23:21 Tower avahi-daemon[6053]: Registering new address record for fe80::fc54:ff:fe5f:d98e on vnet0.*.

May 13 10:23:22 Tower kernel: vfio_ecap_init: 0000:07:00.0 hiding ecap 0x19@0x900

May 13 10:23:22 Tower kernel: vfio-pci 0000:08:00.3: enabling device (0000 -> 0002)

May 13 10:25:34 Tower avahi-daemon[6053]: Interface vnet0.IPv6 no longer relevant for mDNS.

May 13 10:25:34 Tower avahi-daemon[6053]: Leaving mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e.

May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:25:34 Tower kernel: device vnet0 left promiscuous mode

May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:25:34 Tower avahi-daemon[6053]: Withdrawing address record for fe80::fc54:ff:fe5f:d98e on vnet0.

May 13 10:25:35 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem

May 13 10:39:23 Tower kernel: mdcmd (66): spindown 3

May 13 10:39:24 Tower kernel: mdcmd (67): spindown 6

May 13 12:40:14 Tower login[2199]: ROOT LOGIN on '/dev/pts/0'

May 13 12:40:16 Tower login[2295]: ROOT LOGIN on '/dev/pts/1'

May 13 12:40:18 Tower login[2309]: ROOT LOGIN on '/dev/pts/2'

May 13 12:40:18 Tower login[2319]: ROOT LOGIN on '/dev/pts/3'

May 13 13:42:18 Tower emhttpd: shcmd (3106): /usr/sbin/hdparm -y /dev/sdb

May 13 13:42:18 Tower root:

May 13 13:42:18 Tower root: /dev/sdb:

May 13 13:42:18 Tower root: issuing standby command

May 13 14:41:00 Tower login[13491]: ROOT LOGIN on '/dev/pts/0'

May 13 14:41:02 Tower login[13501]: ROOT LOGIN on '/dev/pts/1'

May 13 14:41:02 Tower login[13511]: ROOT LOGIN on '/dev/pts/2'

May 13 14:41:04 Tower login[13524]: ROOT LOGIN on '/dev/pts/3'

May 13 15:41:37 Tower emhttpd: shcmd (3345): /usr/sbin/hdparm -y /dev/sdb

May 13 15:41:37 Tower root:

May 13 15:41:37 Tower root: /dev/sdb:

May 13 15:41:37 Tower root: issuing standby command

May 13 16:43:02 Tower emhttpd: shcmd (3469): /usr/sbin/hdparm -y /dev/sdb

May 13 16:43:02 Tower root:

May 13 16:43:02 Tower root: /dev/sdb:

May 13 16:43:02 Tower root: issuing standby command

May 13 18:05:06 Tower emhttpd: shcmd (3634): /usr/sbin/hdparm -y /dev/sdb

May 13 18:05:06 Tower root:

May 13 18:05:06 Tower root: /dev/sdb:

May 13 18:05:06 Tower root: issuing standby command

May 13 18:31:03 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token

May 13 18:31:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:46 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:52 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:54 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:56 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:58 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:00 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:39 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:43 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:47 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:51 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:55 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:59 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

Quote

May 14, 20188 yr

The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)?

Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error).

Edited May 14, 20188 yr by bonienl

Quote

May 14, 20188 yr

Author

1 minute ago, bonienl said:

The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)?

Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error).

OK that makes sense. I do have PlexServer setup to use ram for transcoding but I do not use transcoding on this machine or share it with anyone at another location that would require transcoding. The current transcode location is /tmp

I'll change it to a location on the SSD cache drive and see if that makes things work better. I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible.

Quote

May 14, 20188 yr

16 minutes ago, jude said:

I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible.

Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal.

So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result.

# df
Filesystem      Size  Used Avail Use% Mounted on
rootfs          7.8G  655M  7.2G   9% /
tmpfs           7.9G     0  7.9G   0% /dev/shm

Edited May 14, 20188 yr by bonienl

Quote

May 14, 20188 yr

Author

1 minute ago, bonienl said:
Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal.

So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result.
# df
Filesystem        1K-blocks        Used   Available Use% Mounted on
rootfs             65870568      507928    65362640   1% /
tmpfs              65988212           0    65988212   0% /dev/shm

Thats really good to know. I'll keep an eye on that too.

The Xeon system i've just migrated from had 128GB of ram so I never even thought about it. Having 16GB now is a bit of an adjustment.

I'll monitor and report back. Thanks for the help

Quote

May 14, 20188 yr

Author

With one Win10 VM (4GB RAM) and a Plex Server docker running this is how the memory allocation looks.

Does it look normal/OK?

root@Tower:~# free -m
              total        used        free      shared  buff/cache   available
Mem:          15979        5651         252        2162       10075        7575
Swap:             0           0           0
root@Tower:~#

root@Tower:~# df
Filesystem         1K-blocks        Used     Available Use% Mounted on
rootfs               8138444     2211552       5926892  28% /
tmpfs                  32768         680         32088   3% /run
devtmpfs             8138456           0       8138456   0% /dev
tmpfs                8181420           0       8181420   0% /dev/shm
cgroup_root             8192           0          8192   0% /sys/fs/cgroup
tmpfs                 131072         836        130236   1% /var/log

root@Tower:~# ps aux  | awk '{print $6/1024 " MB\t\t" $11}'  | sort -n
0 MB		COMMAND
0 MB		[amd_iommu_v2]
0 MB		[ata_sff]
0 MB		[btrfs-cache]
0 MB		[btrfs-cache]
0 MB		[btrfs-cleaner]
0 MB		[btrfs-cleaner]
0 MB		[btrfs-delalloc]
0 MB		[btrfs-delalloc]
0 MB		[btrfs-delayed-m]
0 MB		[btrfs-delayed-m]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-rai]
0 MB		[btrfs-endio-rai]
0 MB		[btrfs-endio-rep]
0 MB		[btrfs-endio-rep]
0 MB		[btrfs-endio-wri]
0 MB		[btrfs-endio-wri]
0 MB		[btrfs-endio]
0 MB		[btrfs-endio]
0 MB		[btrfs-extent-re]
0 MB		[btrfs-extent-re]
0 MB		[btrfs-fixup]
0 MB		[btrfs-fixup]
0 MB		[btrfs-flush_del]
0 MB		[btrfs-flush_del]
0 MB		[btrfs-freespace]
0 MB		[btrfs-freespace]
0 MB		[btrfs-qgroup-re]
0 MB		[btrfs-qgroup-re]
0 MB		[btrfs-readahead]
0 MB		[btrfs-readahead]
0 MB		[btrfs-rmw]
0 MB		[btrfs-rmw]
0 MB		[btrfs-submit]
0 MB		[btrfs-submit]
0 MB		[btrfs-transacti]
0 MB		[btrfs-transacti]
0 MB		[btrfs-worker-hi]
0 MB		[btrfs-worker-hi]
0 MB		[btrfs-worker]
0 MB		[btrfs-worker]
0 MB		[ccp-1-q2]
0 MB		[ccp-1-q3]
0 MB		[ccp-1-q4]
0 MB		[cpuhp/0]
0 MB		[cpuhp/10]
0 MB		[cpuhp/11]
0 MB		[cpuhp/12]
0 MB		[cpuhp/13]
0 MB		[cpuhp/14]
0 MB		[cpuhp/15]
0 MB		[cpuhp/1]
0 MB		[cpuhp/2]
0 MB		[cpuhp/3]
0 MB		[cpuhp/4]
0 MB		[cpuhp/5]
0 MB		[cpuhp/6]
0 MB		[cpuhp/7]
0 MB		[cpuhp/8]
0 MB		[cpuhp/9]
0 MB		[crypto]
0 MB		[devfreq_wq]
0 MB		[edac-poller]
0 MB		[fw_event_mpt2sa]
0 MB		[ipv6_addrconf]
0 MB		[irq/27-AMD-Vi]
0 MB		[kblockd]
0 MB		[kcompactd0]
0 MB		[kdevtmpfs]
0 MB		[khugepaged]
0 MB		[kintegrityd]
0 MB		[ksmd]
0 MB		[ksoftirqd/0]
0 MB		[ksoftirqd/10]
0 MB		[ksoftirqd/11]
0 MB		[ksoftirqd/12]
0 MB		[ksoftirqd/13]
0 MB		[ksoftirqd/14]
0 MB		[ksoftirqd/15]
0 MB		[ksoftirqd/1]
0 MB		[ksoftirqd/2]
0 MB		[ksoftirqd/3]
0 MB		[ksoftirqd/4]
0 MB		[ksoftirqd/5]
0 MB		[ksoftirqd/6]
0 MB		[ksoftirqd/7]
0 MB		[ksoftirqd/8]
0 MB		[ksoftirqd/9]
0 MB		[kswapd0]
0 MB		[kthreadd]
0 MB		[kthrotld]
0 MB		[kvm-pit/3772]
0 MB		[kworker/0:0H]
0 MB		[kworker/0:0]
0 MB		[kworker/0:1H]
0 MB		[kworker/0:2]
0 MB		[kworker/10:0H]
0 MB		[kworker/10:0]
0 MB		[kworker/10:1H]
0 MB		[kworker/10:1]
0 MB		[kworker/11:0H]
0 MB		[kworker/11:1H]
0 MB		[kworker/11:1]
0 MB		[kworker/11:2]
0 MB		[kworker/12:0H]
0 MB		[kworker/12:0]
0 MB		[kworker/12:1H]
0 MB		[kworker/12:2]
0 MB		[kworker/13:0H]
0 MB		[kworker/13:0]
0 MB		[kworker/13:1H]
0 MB		[kworker/13:1]
0 MB		[kworker/14:0H]
0 MB		[kworker/14:1H]
0 MB		[kworker/14:1]
0 MB		[kworker/14:2]
0 MB		[kworker/15:0H]
0 MB		[kworker/15:0]
0 MB		[kworker/15:1H]
0 MB		[kworker/15:1]
0 MB		[kworker/1:0H]
0 MB		[kworker/1:1H]
0 MB		[kworker/1:1]
0 MB		[kworker/1:2]
0 MB		[kworker/2:0H]
0 MB		[kworker/2:1H]
0 MB		[kworker/2:1]
0 MB		[kworker/2:2]
0 MB		[kworker/3:0H]
0 MB		[kworker/3:0]
0 MB		[kworker/3:1H]
0 MB		[kworker/3:1]
0 MB		[kworker/4:0H]
0 MB		[kworker/4:1H]
0 MB		[kworker/4:1]
0 MB		[kworker/4:2]
0 MB		[kworker/5:0H]
0 MB		[kworker/5:1H]
0 MB		[kworker/5:1]
0 MB		[kworker/5:2]
0 MB		[kworker/6:0H]
0 MB		[kworker/6:0]
0 MB		[kworker/6:1H]
0 MB		[kworker/6:1]
0 MB		[kworker/7:0H]
0 MB		[kworker/7:1H]
0 MB		[kworker/7:1]
0 MB		[kworker/7:2]
0 MB		[kworker/8:0H]
0 MB		[kworker/8:0]
0 MB		[kworker/8:1H]
0 MB		[kworker/8:1]
0 MB		[kworker/8:2]
0 MB		[kworker/9:0H]
0 MB		[kworker/9:1H]
0 MB		[kworker/9:1]
0 MB		[kworker/9:2]
0 MB		[kworker/u32:0]
0 MB		[kworker/u32:1]
0 MB		[kworker/u32:2]
0 MB		[kworker/u33:0]
0 MB		[lockd]
0 MB		[loop0]
0 MB		[loop1]
0 MB		[loop2]
0 MB		[loop3]
0 MB		[md]
0 MB		[mdrecoveryd]
0 MB		[migration/0]
0 MB		[migration/10]
0 MB		[migration/11]
0 MB		[migration/12]
0 MB		[migration/13]
0 MB		[migration/14]
0 MB		[migration/15]
0 MB		[migration/1]
0 MB		[migration/2]
0 MB		[migration/3]
0 MB		[migration/4]
0 MB		[migration/5]
0 MB		[migration/6]
0 MB		[migration/7]
0 MB		[migration/8]
0 MB		[migration/9]
0 MB		[mm_percpu_wq]
0 MB		[netns]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[oom_reaper]
0 MB		[poll_mpt2sas0_s]
0 MB		[rcu_bh]
0 MB		[rcu_preempt]
0 MB		[rcu_sched]
0 MB		[rcuob/0]
0 MB		[rcuob/1]
0 MB		[rcuob/2]
0 MB		[rcuob/3]
0 MB		[rcuob/4]
0 MB		[rcuob/5]
0 MB		[rcuob/6]
0 MB		[rcuob/7]
0 MB		[rcuop/0]
0 MB		[rcuop/1]
0 MB		[rcuop/2]
0 MB		[rcuop/3]
0 MB		[rcuop/4]
0 MB		[rcuop/5]
0 MB		[rcuop/6]
0 MB		[rcuop/7]
0 MB		[rcuos/0]
0 MB		[rcuos/1]
0 MB		[rcuos/2]
0 MB		[rcuos/3]
0 MB		[rcuos/4]
0 MB		[rcuos/5]
0 MB		[rcuos/6]
0 MB		[rcuos/7]
0 MB		[reiserfs/md1]
0 MB		[reiserfs/md2]
0 MB		[reiserfs/md3]
0 MB		[reiserfs/md4]
0 MB		[reiserfs/md5]
0 MB		[rpciod]
0 MB		[scsi_eh_0]
0 MB		[scsi_eh_10]
0 MB		[scsi_eh_1]
0 MB		[scsi_eh_2]
0 MB		[scsi_eh_3]
0 MB		[scsi_eh_4]
0 MB		[scsi_eh_5]
0 MB		[scsi_eh_6]
0 MB		[scsi_eh_7]
0 MB		[scsi_eh_8]
0 MB		[scsi_eh_9]
0 MB		[scsi_tmf_0]
0 MB		[scsi_tmf_10]
0 MB		[scsi_tmf_1]
0 MB		[scsi_tmf_2]
0 MB		[scsi_tmf_3]
0 MB		[scsi_tmf_4]
0 MB		[scsi_tmf_5]
0 MB		[scsi_tmf_6]
0 MB		[scsi_tmf_7]
0 MB		[scsi_tmf_8]
0 MB		[scsi_tmf_9]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[unraidd]
0 MB		[usb-storage]
0 MB		[vfio-irqfd-clea]
0 MB		[vhost-3772]
0 MB		[writeback]
0 MB		[xfs-buf/md6]
0 MB		[xfs-buf/md7]
0 MB		[xfs-buf/sdb1]
0 MB		[xfs-cil/md6]
0 MB		[xfs-cil/md7]
0 MB		[xfs-cil/sdb1]
0 MB		[xfs-conv/md6]
0 MB		[xfs-conv/md7]
0 MB		[xfs-conv/sdb1]
0 MB		[xfs-data/md6]
0 MB		[xfs-data/md7]
0 MB		[xfs-data/sdb1]
0 MB		[xfs-eofblocks/m]
0 MB		[xfs-eofblocks/m]
0 MB		[xfs-eofblocks/s]
0 MB		[xfs-log/md6]
0 MB		[xfs-log/md7]
0 MB		[xfs-log/sdb1]
0 MB		[xfs-reclaim/md6]
0 MB		[xfs-reclaim/md7]
0 MB		[xfs-reclaim/sdb]
0 MB		[xfs_mru_cache]
0 MB		[xfsaild/md6]
0 MB		[xfsaild/md7]
0 MB		[xfsaild/sdb1]
0 MB		[xfsalloc]
0 MB		[xprtiod]
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.0429688 MB		/usr/bin/runsvdir
0.0859375 MB		/usr/sbin/acpid
0.109375 MB		/usr/sbin/avahi-dnsconfd
0.226562 MB		/usr/sbin/dnsmasq
0.257812 MB		avahi-daemon:
0.558594 MB		/usr/local/sbin/shfs
0.660156 MB		tail
0.753906 MB		sleep
0.78125 MB		/bin/sh
0.792969 MB		/usr/bin/tail
0.800781 MB		init
0.875 MB		/bin/timeout
1.43359 MB		/usr/sbin/atd
1.55469 MB		/usr/sbin/crond
1.62891 MB		/sbin/agetty
1.71484 MB		/sbin/agetty
1.71484 MB		/sbin/agetty
1.71484 MB		/usr/sbin/inetd
1.76562 MB		/sbin/agetty
1.85156 MB		/sbin/agetty
1.86719 MB		/sbin/agetty
2.01172 MB		sort
2.17969 MB		/usr/sbin/rpc.mountd
2.19531 MB		/sbin/apcupsd
2.21484 MB		/sbin/rpcbind
2.24219 MB		/usr/sbin/dnsmasq
2.32422 MB		/usr/bin/dbus-daemon
2.48047 MB		ps
2.66797 MB		/usr/local/sbin/emhttpd
2.75781 MB		find
2.77344 MB		/usr/sbin/sshd
2.78516 MB		/bin/bash
2.78906 MB		/bin/bash
2.78906 MB		/usr/sbin/cron
2.79688 MB		/bin/bash
2.80469 MB		sh
2.85547 MB		/usr/local/sbin/emhttpd
2.91406 MB		/usr/sbin/netatalk
2.93359 MB		/bin/bash
3.24609 MB		docker-containerd-shim
3.25391 MB		/usr/sbin/rsyslogd
3.26172 MB		awk
3.27344 MB		avahi-daemon:
3.49219 MB		/usr/sbin/virtlockd
3.58984 MB		nginx:
3.68359 MB		/bin/bash
3.70703 MB		-bash
3.83594 MB		-bash
3.85547 MB		-bash
3.89844 MB		-bash
3.94141 MB		-bash
3.94141 MB		-bash
3.94141 MB		/sbin/udevd
4.01953 MB		/usr/sbin/virtlogd
4.06641 MB		/usr/sbin/cnid_metad
4.3125 MB		/usr/sbin/smbd
4.48828 MB		Plex
4.68359 MB		/usr/sbin/afpd
4.91797 MB		sshd:
5.21484 MB		/usr/sbin/ntpd
5.29297 MB		ttyd
5.82812 MB		/sbin/rpc.statd
5.85547 MB		/usr/sbin/smbd
5.93359 MB		/usr/sbin/nmbd
6.1875 MB		/usr/local/sbin/shfs
6.59375 MB		/usr/sbin/winbindd
6.61328 MB		syslog-ng
7.52734 MB		nginx:
9.34375 MB		/usr/sbin/winbindd
9.36719 MB		/usr/bin/python3
9.96094 MB		/usr/sbin/winbindd
12.4258 MB		php-fpm:
13.2344 MB		docker-containerd
13.8633 MB		php-fpm:
13.8672 MB		php-fpm:
15.8867 MB		/usr/sbin/smbd
16.457 MB		/usr/lib/plexmediaserver/Plex
16.832 MB		/usr/sbin/smbd
18.4961 MB		/usr/sbin/libvirtd
20.1875 MB		rcloneorig
21.2383 MB		rcloneorig
23.2266 MB		/usr/bin/php
34.5 MB		Plex
43.2773 MB		/usr/bin/dockerd
43.5078 MB		Plex
46.1836 MB		Plex
56.9062 MB		rcloneorig
61.5156 MB		Plex
175.668 MB		./Plex
4160.18 MB		/usr/bin/qemu-system-x86_64
root@Tower:~#

Quote

May 15, 20188 yr

Author

The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.

root@Tower:~# df -h /

Filesystem Size Used Avail Use% Mounted on

rootfs 7.8G 7.5G 282M 97% /

root@Tower:~# df

Filesystem 1K-blocks Used Available Use% Mounted on

rootfs 8138444 7850684 287760 97% /

tmpfs 32768 628 32140 2% /run

devtmpfs 8138456 0 8138456 0% /dev

tmpfs 8181420 0 8181420 0% /dev/shm

cgroup_root 8192 0 8192 0% /sys/fs/cgroup

tmpfs 131072 836 130236 1% /var/log

/dev/sda1 3938272 1341680 2596592 35% /boot

/dev/loop0 7680 7680 0 100% /lib/modules

/dev/loop1 4608 4608 0 100% /lib/firmware

/dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1

/dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2

/dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3

/dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4

/dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5

/dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6

/dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7

/dev/sdb1 499863384 337906828 161956556 68% /mnt/cache

shfs 15625840360 12767995060 2857845300 82% /mnt/user0

shfs 16125703744 13105901888 3019801856 82% /mnt/user

google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google

/dev/loop2 20971520 5332000 13948304 28% /var/lib/docker

encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted

local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted

/dev/loop3 1048576 17380 647164 3% /etc/libvirt

root@Tower:~#

root@Tower:~# free -m

total used free shared buff/cache available

Mem: 15979 944 4286 7668 10748 6773

Swap: 0 0 0

root@Tower:~#

I've taken another diagnostic that I'll attach to this post.

How do I figure out whats filling up Rootfs?

tower-diagnostics-20180515-1343.zip

Quote

May 15, 20188 yr

The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.

root@Tower:~# df -h /
Filesystem Size Used Avail Use% Mounted on
rootfs 7.8G 7.5G 282M 97% /

root@Tower:~# df
Filesystem 1K-blocks Used Available Use% Mounted on
rootfs 8138444 7850684 287760 97% /
tmpfs 32768 628 32140 2% /run
devtmpfs 8138456 0 8138456 0% /dev
tmpfs 8181420 0 8181420 0% /dev/shm
cgroup_root 8192 0 8192 0% /sys/fs/cgroup
tmpfs 131072 836 130236 1% /var/log
/dev/sda1 3938272 1341680 2596592 35% /boot
/dev/loop0 7680 7680 0 100% /lib/modules
/dev/loop1 4608 4608 0 100% /lib/firmware
/dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1
/dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2
/dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3
/dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4
/dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5
/dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6
/dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7
/dev/sdb1 499863384 337906828 161956556 68% /mnt/cache
shfs 15625840360 12767995060 2857845300 82% /mnt/user0
shfs 16125703744 13105901888 3019801856 82% /mnt/user
google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google
/dev/loop2 20971520 5332000 13948304 28% /var/lib/docker
encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted
local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted
/dev/loop3 1048576 17380 647164 3% /etc/libvirt
root@Tower:~#

root@Tower:~# free -m
total used free shared buff/cache available
Mem: 15979 944 4286 7668 10748 6773
Swap: 0 0 0
root@Tower:~#

I've taken another diagnostic that I'll attach to this post.

How do I figure out whats filling up Rootfs?
tower-diagnostics-20180515-1343.zip

Post your docker run command for Plex. My money is going to be on that.

Quote

May 15, 20188 yr

Author

Ho

7 minutes ago, CHBMB said:

9 minutes ago, jude said:

The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.

root@Tower:~# df -h /
Filesystem Size Used Avail Use% Mounted on
rootfs 7.8G 7.5G 282M 97% /

root@Tower:~# df
Filesystem 1K-blocks Used Available Use% Mounted on
rootfs 8138444 7850684 287760 97% /
tmpfs 32768 628 32140 2% /run
devtmpfs 8138456 0 8138456 0% /dev
tmpfs 8181420 0 8181420 0% /dev/shm
cgroup_root 8192 0 8192 0% /sys/fs/cgroup
tmpfs 131072 836 130236 1% /var/log
/dev/sda1 3938272 1341680 2596592 35% /boot
/dev/loop0 7680 7680 0 100% /lib/modules
/dev/loop1 4608 4608 0 100% /lib/firmware
/dev/md1 1953454928 1538138108 415316820 79% /mnt/disk1
/dev/md2 2930177100 2422055472 508121628 83% /mnt/disk2
/dev/md3 2930177100 2384118524 546058576 82% /mnt/disk3
/dev/md4 1953454928 1783368828 170086100 92% /mnt/disk4
/dev/md5 1953454928 1554891196 398563732 80% /mnt/disk5
/dev/md6 1952560688 1573464484 379096204 81% /mnt/disk6
/dev/md7 1952560688 1511958448 440602240 78% /mnt/disk7
/dev/sdb1 499863384 337906828 161956556 68% /mnt/cache
shfs 15625840360 12767995060 2857845300 82% /mnt/user0
shfs 16125703744 13105901888 3019801856 82% /mnt/user
google: 1099511627776 13618686060 1099511627776 2% /mnt/disks/google
/dev/loop2 20971520 5332000 13948304 28% /var/lib/docker
encrypted: 1099511627776 13618686060 1099511627776 2% /mnt/disks/encrypted
local-decrypt: 1099511627776 13618686060 1099511627776 2% /mnt/disks/decrypted
/dev/loop3 1048576 17380 647164 3% /etc/libvirt
root@Tower:~#

root@Tower:~# free -m
total used free shared buff/cache available
Mem: 15979 944 4286 7668 10748 6773
Swap: 0 0 0
root@Tower:~#

I've taken another diagnostic that I'll attach to this post.

How do I figure out whats filling up Rootfs?
tower-diagnostics-20180515-1343.zip

Post your docker run command for Plex. My money is going to be on that.

Sorry, how do I find that?

Quote

May 15, 20188 yr

There's a link in my signature or there's a link in the Docker FAQ sticky.

Quote

May 15, 20188 yr

Author

OK found an explanation of how to get the docker run command here

Here is the docker run command

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='PlexMediaServer-needo' --net='host' --privileged=true -e TZ="America/Chicago" -e HOST_OS="unRAID" -e 'VERSION'='' -v '/mnt/cache/apps/Plex/transcode':'/transcode':'rw' -v '/mnt/cache/apps/Plex/':'/config':'rw' -v '/mnt/':'/mnt':'rw' -v '/mnt/disks/encrypted/movies':'/MoviesArchive':'ro,slave' -v '/mnt/disks/encrypted/tv':'/TVarchive':'ro,slave' --cpuset-cpus=2,3,4,5,6,7 'needo/plex'

fcfd206c0fd16979cc4f3e33a00a11278409daf696593b712a75d965ae55f96d

Edited May 15, 20188 yr by jude

Quote

May 15, 20188 yr

Aside from using needo's extremely old container version of Plex, can't see anything there that is directly mapped to memory.

Quote

May 15, 20188 yr

Author

11 minutes ago, CHBMB said:

Aside from using needo's extremely old container version of Plex, can't see anything there that is directly mapped to memory.

Is there a way of listing the contents of Rootfs to show whats going on?

Quote

May 15, 20188 yr

Why don't you try not running certain add-ons for a while? If your rootfs fills up in 22 hours it should only take a day to eliminate each one once and for all.

Quote

May 16, 20188 yr

Author

I think it all stems from the cache setting for Rclone cache mounts. I've made changes to Rclone cache configuration and i'll monitor to see if this works.

Quote

May 16, 20188 yr

Author

Things are working much better now. I'm going to call it solved. The Cache setting in Rclone was set too high. I have lowered maximum cache to 1GB.

Rootfs is now staying around 21% full.

Quote

uninitialized csrf_token error - Rootfs full (solved)

Featured Replies

Archived

Account

Navigation

Search

Configure browser push notifications

Chrome (Android)

Chrome (Desktop)

Safari (iOS 16.4+)

Safari (macOS)

Edge (Android)

Edge (Desktop)

Firefox (Android)

Firefox (Desktop)