Jump to content
jude

uninitialized csrf_token error - Rootfs full (solved)

30 posts in this topic Last Reply

Recommended Posts

If anyone could help with this I would appreciate it.

 

I have recently moved my unRaid system from dual Xeon hardware to an AMD Ryzen 1700 setup. I have sleep states disabled as well as zen states initialised on boot.

 

The motherboard is an Asus X370-pro and it is on the most recent bios.

 

The only docker i am running is Plex server and I have disabled or updated the plugins.

 

I am able to pass through a GTX1070 to a Win10 VM and everything works as it should.

 

The problem is that within 24-30 hours or a reboot the system becomes unstable and apps or VMs become partially unusable. When the system partially crashes the unRaid GUI is still accessible except that it shows that the array is offline. I am however able to ssh into the system. I can access the array disks as well as the fuse mounts that I have to google drive and I can access files and folder structure. In this state I cannot play anything from the Plex Server but it can be used to browse content. The Win10 VM generally continues to function even after the unRaid GUI partially crashes. No other VM's or dockers can be started as it sees the array as offline. Although this sometimes flickers back and fourth from online and offline.

 

I am attaching the diagnostics file from after the most recent crash and manual reboot.

 

Downloading the diagnostics after parts of the system have crashed gives files with no data. I left the GUI log window open and here are the results that I can see now from the most recent crash

 

May 13 20:32:36 Tower login[16134]: ROOT LOGIN on '/dev/pts/3'

May 13 20:35:36 Tower root: Fix Common Problems Version 2018.04.25

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application CouchPotato has moderator comments listed

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application PlexMediaServer has moderator comments listed

May 13 20:35:43 Tower root: Fix Common Problems: Warning: Docker application plexpy has moderator comments listed

May 13 20:50:43 Tower kernel: mdcmd (44): spindown 2

May 13 20:50:45 Tower kernel: mdcmd (45): spindown 5

May 13 20:51:14 Tower kernel: mdcmd (46): spindown 3

May 13 20:51:15 Tower kernel: mdcmd (47): spindown 4

May 13 20:51:48 Tower kernel: mdcmd (48): spindown 1

May 13 20:52:20 Tower kernel: mdcmd (49): spindown 6

May 13 20:52:21 Tower kernel: mdcmd (50): spindown 0

May 13 20:52:22 Tower kernel: mdcmd (51): spindown 7

May 13 21:30:56 Tower kernel: mdcmd (52): spindown 6

May 13 21:30:57 Tower kernel: mdcmd (53): spindown 7

May 13 21:31:21 Tower kernel: mdcmd (54): spindown 5

May 13 21:31:24 Tower kernel: mdcmd (55): spindown 2

May 13 21:31:25 Tower kernel: mdcmd (56): spindown 1

May 13 21:31:25 Tower kernel: mdcmd (57): spindown 4

May 13 21:31:38 Tower kernel: mdcmd (58): spindown 3

May 13 23:10:13 Tower emhttpd: shcmd (633): /usr/sbin/hdparm -y /dev/sdb

May 13 23:10:13 Tower root: 

May 13 23:10:13 Tower root: /dev/sdb:

May 13 23:10:13 Tower root: issuing standby command

May 13 23:50:30 Tower emhttpd: shcmd (715): /usr/sbin/hdparm -y /dev/sdb

May 13 23:50:31 Tower root: 

May 13 23:50:31 Tower root: /dev/sdb:

May 13 23:50:31 Tower root: issuing standby command

May 14 00:00:01 Tower crond[1943]: exit status 1 from user root /usr/local/emhttp/plugins/ca.update.applications/scripts/updateApplications.php >dev/null 2>&1

May 14 00:00:01 Tower sSMTP[23325]: Creating SSL connection to host

May 14 00:00:01 Tower sSMTP[23325]: SSL connection using ECDHE-RSA-AES128-GCM-SHA256

May 14 00:00:02 Tower sSMTP[23325]: Authorization failed (535 5.7.8 https://support.google.com/mail/?p=BadCredentials e139-v6sm3665146ite.42 - gsmtp)

May 14 00:52:25 Tower emhttpd: shcmd (840): /usr/sbin/hdparm -y /dev/sdb

May 14 00:52:25 Tower root: 

May 14 00:52:25 Tower root: /dev/sdb:

May 14 00:52:25 Tower root: issuing standby command

May 14 02:10:28 Tower emhttpd: shcmd (997): /usr/sbin/hdparm -y /dev/sdb

May 14 02:10:29 Tower root: 

May 14 02:10:29 Tower root: /dev/sdb:

May 14 02:10:29 Tower root: issuing standby command

May 14 02:33:37 Tower emhttpd: shcmd (1044): /usr/sbin/hdparm -y /dev/sdb

May 14 02:33:37 Tower root: 

May 14 02:33:37 Tower root: /dev/sdb:

May 14 02:33:37 Tower root: issuing standby command

May 14 03:10:22 Tower emhttpd: shcmd (1118): /usr/sbin/hdparm -y /dev/sdb

May 14 03:10:22 Tower root: 

May 14 03:10:22 Tower root: /dev/sdb:

May 14 03:10:22 Tower root: issuing standby command

May 14 03:34:01 Tower emhttpd: shcmd (1167): /usr/sbin/hdparm -y /dev/sdb

May 14 03:34:01 Tower root: 

May 14 03:34:01 Tower root: /dev/sdb:

May 14 03:34:01 Tower root: issuing standby command

May 14 03:40:01 Tower crond[1943]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null

May 14 04:10:17 Tower emhttpd: shcmd (1240): /usr/sbin/hdparm -y /dev/sdb

May 14 04:10:17 Tower root: 

May 14 04:10:17 Tower root: /dev/sdb:

May 14 04:10:17 Tower root: issuing standby command

May 14 04:33:57 Tower emhttpd: shcmd (1289): /usr/sbin/hdparm -y /dev/sdb

May 14 04:33:57 Tower root: 

May 14 04:33:57 Tower root: /dev/sdb:

May 14 04:33:57 Tower root: issuing standby command

May 14 04:40:08 Tower root: /mnt/cache: 155.1 GiB (166493286400 bytes) trimmed

May 14 05:13:13 Tower emhttpd: shcmd (1368): /usr/sbin/hdparm -y /dev/sdb

May 14 05:13:14 Tower root: 

May 14 05:13:14 Tower root: /dev/sdb:

May 14 05:13:14 Tower root: issuing standby command

May 14 05:50:28 Tower emhttpd: shcmd (1443): /usr/sbin/hdparm -y /dev/sdb

May 14 05:50:28 Tower root: 

May 14 05:50:28 Tower root: /dev/sdb:

May 14 05:50:28 Tower root: issuing standby command

May 14 07:41:44 Tower emhttpd: shcmd (1667): /usr/sbin/hdparm -y /dev/sdb

May 14 07:41:44 Tower root: 

May 14 07:41:44 Tower root: /dev/sdb:

May 14 07:41:44 Tower root: issuing standby command

May 14 08:42:09 Tower emhttpd: shcmd (1789): /usr/sbin/hdparm -y /dev/sdb

May 14 08:42:09 Tower root: 

May 14 08:42:09 Tower root: /dev/sdb:

May 14 08:42:09 Tower root: issuing standby command

May 14 09:45:42 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token

May 14 09:45:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:46:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:47:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:48:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 14 09:49:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

 

that last error repeats

 

  

tower-diagnostics-20180514-1128.zip

Share this post


Link to post

Here's a screen shot of what the GUI looks like when its in the error state.

 

 

508157743_ScreenShot2018-05-13at7_09_48PM.thumb.png.c0ec9d54831342680ef9275904dd2cbf.png

Share this post


Link to post

The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem.

  • Like 1

Share this post


Link to post
23 minutes ago, CHBMB said:

The csrf errors have been discussed a lot on the forum. Try searching for that, sorting that out and see if it resolves your problem.

 I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.

 

I just did another search and found the following post with this section.

 

unitialized csrf_token - Thus far the community has never onceseen any report of this being logged.  Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running.  EDIT:  There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.

Edited August 20, 2017 by Squid

 

Should I repost my problem in the current release thread?

 

 

 

Share this post


Link to post
 I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.
 
I just did another search and found the following post with this section.
 
unitialized csrf_token - Thus far the community has never onceseen any report of this being logged.  Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running.  EDIT:  There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.
Edited August 20, 2017 by Squid
 
Should I repost my problem in the current release thread?
 
 
 
Run am there scan of fix common problems and see what it says. Also post diagnostics

Share this post


Link to post
1 minute ago, Squid said:
3 minutes ago, jude said:
 I did do some searching on card tokens prior to posting but I couldn't find anything that helpful.
 
I just did another search and found the following post with this section.
 
unitialized csrf_token - Thus far the community has never onceseen any report of this being logged.  Presumably it is an error generated by unRaid itself during Limetech's debugging period (ie: not plugin related), and should you see this you should post your diagnostics in the release thread for the version of unRaid you are running.  EDIT:  There is a possibility that if your rootfs is completely full due to misconfiguration of an application that you may see this particular token error.
Edited August 20, 2017 by Squid
 
Should I repost my problem in the current release thread?
 
 
 

Run am there scan of fix common problems and see what it says. Also post diagnostics

Fix common problems recommend changing my Plex docker from needo to another version as well as two other Dockers that I don't start anymore. The diagnostics that I get after rebooting should be attached to the original post. Please let me know if I should post them again. Thanks

Share this post


Link to post

There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot.

 

Share this post


Link to post
3 minutes ago, bonienl said:

There are no csrf errors in your diagnostics (after a reboot). We need the diagnostics when the error occurs, then obtain them before you decide to reboot.

 

I've taken the diagnostics from command line a couple of times when the error occurs and the text files are all empty

 

the last time I tried this was the message that I received (I attached that zip file to this post, but its empty) 

 

root@Tower:~# diagnostics

Starting diagnostics collection... sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

sh: line 0: echo: write error: No space left on device

done.

ZIP file '/boot/logs/tower-diagnostics-20180512-1232.zip' created.

root@Tower:~# 

tower-diagnostics-20180512-1232.zip

Share this post


Link to post

Here is the error log from the GUI log from the previous time (day before). After this I removed the system temp plugin

 

May 13 10:22:34 Tower kernel: mdcmd (64): spindown 3

May 13 10:22:41 Tower kernel: mdcmd (65): spindown 1

May 13 10:23:20 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:23:20 Tower kernel: device vnet0 entered promiscuous mode

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered blocking state

May 13 10:23:20 Tower kernel: br0: port 2(vnet0) entered forwarding state

May 13 10:23:21 Tower avahi-daemon[6053]: Joining mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e.

May 13 10:23:21 Tower avahi-daemon[6053]: New relevant interface vnet0.IPv6 for mDNS.

May 13 10:23:21 Tower avahi-daemon[6053]: Registering new address record for fe80::fc54:ff:fe5f:d98e on vnet0.*.

May 13 10:23:22 Tower kernel: vfio_ecap_init: 0000:07:00.0 hiding ecap 0x19@0x900

May 13 10:23:22 Tower kernel: vfio-pci 0000:08:00.3: enabling device (0000 -> 0002)

May 13 10:25:34 Tower avahi-daemon[6053]: Interface vnet0.IPv6 no longer relevant for mDNS.

May 13 10:25:34 Tower avahi-daemon[6053]: Leaving mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5f:d98e.

May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:25:34 Tower kernel: device vnet0 left promiscuous mode

May 13 10:25:34 Tower kernel: br0: port 2(vnet0) entered disabled state

May 13 10:25:34 Tower avahi-daemon[6053]: Withdrawing address record for fe80::fc54:ff:fe5f:d98e on vnet0.

May 13 10:25:35 Tower kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem

May 13 10:39:23 Tower kernel: mdcmd (66): spindown 3

May 13 10:39:24 Tower kernel: mdcmd (67): spindown 6

May 13 12:40:14 Tower login[2199]: ROOT LOGIN on '/dev/pts/0'

May 13 12:40:16 Tower login[2295]: ROOT LOGIN on '/dev/pts/1'

May 13 12:40:18 Tower login[2309]: ROOT LOGIN on '/dev/pts/2'

May 13 12:40:18 Tower login[2319]: ROOT LOGIN on '/dev/pts/3'

May 13 13:42:18 Tower emhttpd: shcmd (3106): /usr/sbin/hdparm -y /dev/sdb

May 13 13:42:18 Tower root: 

May 13 13:42:18 Tower root: /dev/sdb:

May 13 13:42:18 Tower root: issuing standby command

May 13 14:41:00 Tower login[13491]: ROOT LOGIN on '/dev/pts/0'

May 13 14:41:02 Tower login[13501]: ROOT LOGIN on '/dev/pts/1'

May 13 14:41:02 Tower login[13511]: ROOT LOGIN on '/dev/pts/2'

May 13 14:41:04 Tower login[13524]: ROOT LOGIN on '/dev/pts/3'

May 13 15:41:37 Tower emhttpd: shcmd (3345): /usr/sbin/hdparm -y /dev/sdb

May 13 15:41:37 Tower root: 

May 13 15:41:37 Tower root: /dev/sdb:

May 13 15:41:37 Tower root: issuing standby command

May 13 16:43:02 Tower emhttpd: shcmd (3469): /usr/sbin/hdparm -y /dev/sdb

May 13 16:43:02 Tower root: 

May 13 16:43:02 Tower root: /dev/sdb:

May 13 16:43:02 Tower root: issuing standby command

May 13 18:05:06 Tower emhttpd: shcmd (3634): /usr/sbin/hdparm -y /dev/sdb

May 13 18:05:06 Tower root: 

May 13 18:05:06 Tower root: /dev/sdb:

May 13 18:05:06 Tower root: issuing standby command

May 13 18:31:03 Tower root: error: /webGui/include/Notify.php: uninitialized csrf_token

May 13 18:31:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:31:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:31:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:32:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:32:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:33:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:33:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:34:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:34:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:35:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:35:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:36:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:36:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:46 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:46 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:37:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:37:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:38:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:48 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:38:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:39:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:50 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:39:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:40:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:52 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:52 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:40:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:41:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:54 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:41:54 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:42:56 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:56 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:42:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:43:58 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:43:58 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:44:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:44:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:00 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:00 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:15 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:45:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:45:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:02 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:46:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:46:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:04 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:47:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:47:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:06 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:48:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:48:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:08 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:19 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:39 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:39 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:46 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:49:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:49:57 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:08 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:10 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:19 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:30 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:50:52 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:50:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:03 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:12 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:14 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:25 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:36 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:43 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:43 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:51:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:51:58 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:09 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:14 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:20 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:31 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:42 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:52:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:52:53 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:04 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:16 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:23 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:47 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:47 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:53:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:53:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:18 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:54:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:54:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:20 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:55:51 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:55:51 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:22 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:56:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:56:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:24 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:27 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:57:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:55 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:57:55 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:26 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:58:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:28 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 18:59:59 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 18:59:59 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:15 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:26 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:30 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:37 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:48 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:00:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:00:59 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:10 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:21 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:31 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:32 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:43 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:01:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:01:54 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:03 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:05 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:16 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:27 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:32 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:38 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:02:49 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:02:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:00 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:11 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:22 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:33 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:44 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:03:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:03:55 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:01 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:06 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:07 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:17 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:17 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:28 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:33 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:34 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:38 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:39 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:04:49 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:04:50 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:01 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:05 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:12 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:21 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:23 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:34 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:35 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:40 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:45 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:05:53 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:05:56 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:07 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:09 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:11 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:18 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:25 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:29 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:36 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:40 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:41 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:42 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:06:51 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:06:57 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:02 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:13 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:24 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:29 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:35 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

May 13 19:07:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:37 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:44 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:45 Tower root: error: /webGui/include/DashUpdate.php: uninitialized csrf_token

May 13 19:07:47 Tower root: error: /plugins/dynamix.system.temp/include/SystemTemp.php: uninitialized csrf_token

 

 

Share this post


Link to post
Posted (edited)

The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)?

 

Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error).

Edited by bonienl

Share this post


Link to post
1 minute ago, bonienl said:

The write error occurs when no space is left in the RAM file system. Do you have any docker containers running which may inadvertably write to memory instead of disk (check disk mappings)?

 

Once no space left, all kinds of unexpected things may happen (including the uninitialized csrf token error).

OK that makes sense. I do have PlexServer setup to use ram for transcoding but I do not use transcoding on this machine or share it with anyone at another location that would require transcoding. The current transcode location is /tmp

I'll change it to a location on the SSD cache drive and see if that makes things work better. I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible. 

Share this post


Link to post
Posted (edited)
16 minutes ago, jude said:

I had been watching the RAM usage and although buff/cache usage was high, there always seemed to be enough free or accessible. 

 

Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal.

So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result.

# df
Filesystem      Size  Used Avail Use% Mounted on
rootfs          7.8G  655M  7.2G   9% /
tmpfs           7.9G     0  7.9G   0% /dev/shm

 

Edited by bonienl

Share this post


Link to post
1 minute ago, bonienl said:

 

Most people don't realize that the rootfs and tmpfs are equally split across the available memory. In your case each file system has max 8GB at its disposal.

So total memory usage may look acceptable, but in reality it may have completely filled the /tmp structure and unforeseen errors as result.


# df
Filesystem        1K-blocks        Used   Available Use% Mounted on
rootfs             65870568      507928    65362640   1% /
tmpfs              65988212           0    65988212   0% /dev/shm

 

 

 

Thats really good to know. I'll keep an eye on that too.

 

The Xeon system i've just migrated from had 128GB of ram so I never even thought about it. Having 16GB now is a bit of an adjustment.

 

I'll monitor and report back. Thanks for the help

Share this post


Link to post

With one Win10 VM (4GB RAM) and a Plex Server docker running this is how the memory allocation looks.

 

Does it look normal/OK?

 

root@Tower:~# free -m
              total        used        free      shared  buff/cache   available
Mem:          15979        5651         252        2162       10075        7575
Swap:             0           0           0
root@Tower:~# 
root@Tower:~# df
Filesystem         1K-blocks        Used     Available Use% Mounted on
rootfs               8138444     2211552       5926892  28% /
tmpfs                  32768         680         32088   3% /run
devtmpfs             8138456           0       8138456   0% /dev
tmpfs                8181420           0       8181420   0% /dev/shm
cgroup_root             8192           0          8192   0% /sys/fs/cgroup
tmpfs                 131072         836        130236   1% /var/log
root@Tower:~# ps aux  | awk '{print $6/1024 " MB\t\t" $11}'  | sort -n
0 MB		COMMAND
0 MB		[amd_iommu_v2]
0 MB		[ata_sff]
0 MB		[btrfs-cache]
0 MB		[btrfs-cache]
0 MB		[btrfs-cleaner]
0 MB		[btrfs-cleaner]
0 MB		[btrfs-delalloc]
0 MB		[btrfs-delalloc]
0 MB		[btrfs-delayed-m]
0 MB		[btrfs-delayed-m]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-met]
0 MB		[btrfs-endio-rai]
0 MB		[btrfs-endio-rai]
0 MB		[btrfs-endio-rep]
0 MB		[btrfs-endio-rep]
0 MB		[btrfs-endio-wri]
0 MB		[btrfs-endio-wri]
0 MB		[btrfs-endio]
0 MB		[btrfs-endio]
0 MB		[btrfs-extent-re]
0 MB		[btrfs-extent-re]
0 MB		[btrfs-fixup]
0 MB		[btrfs-fixup]
0 MB		[btrfs-flush_del]
0 MB		[btrfs-flush_del]
0 MB		[btrfs-freespace]
0 MB		[btrfs-freespace]
0 MB		[btrfs-qgroup-re]
0 MB		[btrfs-qgroup-re]
0 MB		[btrfs-readahead]
0 MB		[btrfs-readahead]
0 MB		[btrfs-rmw]
0 MB		[btrfs-rmw]
0 MB		[btrfs-submit]
0 MB		[btrfs-submit]
0 MB		[btrfs-transacti]
0 MB		[btrfs-transacti]
0 MB		[btrfs-worker-hi]
0 MB		[btrfs-worker-hi]
0 MB		[btrfs-worker]
0 MB		[btrfs-worker]
0 MB		[ccp-1-q2]
0 MB		[ccp-1-q3]
0 MB		[ccp-1-q4]
0 MB		[cpuhp/0]
0 MB		[cpuhp/10]
0 MB		[cpuhp/11]
0 MB		[cpuhp/12]
0 MB		[cpuhp/13]
0 MB		[cpuhp/14]
0 MB		[cpuhp/15]
0 MB		[cpuhp/1]
0 MB		[cpuhp/2]
0 MB		[cpuhp/3]
0 MB		[cpuhp/4]
0 MB		[cpuhp/5]
0 MB		[cpuhp/6]
0 MB		[cpuhp/7]
0 MB		[cpuhp/8]
0 MB		[cpuhp/9]
0 MB		[crypto]
0 MB		[devfreq_wq]
0 MB		[edac-poller]
0 MB		[fw_event_mpt2sa]
0 MB		[ipv6_addrconf]
0 MB		[irq/27-AMD-Vi]
0 MB		[kblockd]
0 MB		[kcompactd0]
0 MB		[kdevtmpfs]
0 MB		[khugepaged]
0 MB		[kintegrityd]
0 MB		[ksmd]
0 MB		[ksoftirqd/0]
0 MB		[ksoftirqd/10]
0 MB		[ksoftirqd/11]
0 MB		[ksoftirqd/12]
0 MB		[ksoftirqd/13]
0 MB		[ksoftirqd/14]
0 MB		[ksoftirqd/15]
0 MB		[ksoftirqd/1]
0 MB		[ksoftirqd/2]
0 MB		[ksoftirqd/3]
0 MB		[ksoftirqd/4]
0 MB		[ksoftirqd/5]
0 MB		[ksoftirqd/6]
0 MB		[ksoftirqd/7]
0 MB		[ksoftirqd/8]
0 MB		[ksoftirqd/9]
0 MB		[kswapd0]
0 MB		[kthreadd]
0 MB		[kthrotld]
0 MB		[kvm-pit/3772]
0 MB		[kworker/0:0H]
0 MB		[kworker/0:0]
0 MB		[kworker/0:1H]
0 MB		[kworker/0:2]
0 MB		[kworker/10:0H]
0 MB		[kworker/10:0]
0 MB		[kworker/10:1H]
0 MB		[kworker/10:1]
0 MB		[kworker/11:0H]
0 MB		[kworker/11:1H]
0 MB		[kworker/11:1]
0 MB		[kworker/11:2]
0 MB		[kworker/12:0H]
0 MB		[kworker/12:0]
0 MB		[kworker/12:1H]
0 MB		[kworker/12:2]
0 MB		[kworker/13:0H]
0 MB		[kworker/13:0]
0 MB		[kworker/13:1H]
0 MB		[kworker/13:1]
0 MB		[kworker/14:0H]
0 MB		[kworker/14:1H]
0 MB		[kworker/14:1]
0 MB		[kworker/14:2]
0 MB		[kworker/15:0H]
0 MB		[kworker/15:0]
0 MB		[kworker/15:1H]
0 MB		[kworker/15:1]
0 MB		[kworker/1:0H]
0 MB		[kworker/1:1H]
0 MB		[kworker/1:1]
0 MB		[kworker/1:2]
0 MB		[kworker/2:0H]
0 MB		[kworker/2:1H]
0 MB		[kworker/2:1]
0 MB		[kworker/2:2]
0 MB		[kworker/3:0H]
0 MB		[kworker/3:0]
0 MB		[kworker/3:1H]
0 MB		[kworker/3:1]
0 MB		[kworker/4:0H]
0 MB		[kworker/4:1H]
0 MB		[kworker/4:1]
0 MB		[kworker/4:2]
0 MB		[kworker/5:0H]
0 MB		[kworker/5:1H]
0 MB		[kworker/5:1]
0 MB		[kworker/5:2]
0 MB		[kworker/6:0H]
0 MB		[kworker/6:0]
0 MB		[kworker/6:1H]
0 MB		[kworker/6:1]
0 MB		[kworker/7:0H]
0 MB		[kworker/7:1H]
0 MB		[kworker/7:1]
0 MB		[kworker/7:2]
0 MB		[kworker/8:0H]
0 MB		[kworker/8:0]
0 MB		[kworker/8:1H]
0 MB		[kworker/8:1]
0 MB		[kworker/8:2]
0 MB		[kworker/9:0H]
0 MB		[kworker/9:1H]
0 MB		[kworker/9:1]
0 MB		[kworker/9:2]
0 MB		[kworker/u32:0]
0 MB		[kworker/u32:1]
0 MB		[kworker/u32:2]
0 MB		[kworker/u33:0]
0 MB		[lockd]
0 MB		[loop0]
0 MB		[loop1]
0 MB		[loop2]
0 MB		[loop3]
0 MB		[md]
0 MB		[mdrecoveryd]
0 MB		[migration/0]
0 MB		[migration/10]
0 MB		[migration/11]
0 MB		[migration/12]
0 MB		[migration/13]
0 MB		[migration/14]
0 MB		[migration/15]
0 MB		[migration/1]
0 MB		[migration/2]
0 MB		[migration/3]
0 MB		[migration/4]
0 MB		[migration/5]
0 MB		[migration/6]
0 MB		[migration/7]
0 MB		[migration/8]
0 MB		[migration/9]
0 MB		[mm_percpu_wq]
0 MB		[netns]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[nfsd]
0 MB		[oom_reaper]
0 MB		[poll_mpt2sas0_s]
0 MB		[rcu_bh]
0 MB		[rcu_preempt]
0 MB		[rcu_sched]
0 MB		[rcuob/0]
0 MB		[rcuob/1]
0 MB		[rcuob/2]
0 MB		[rcuob/3]
0 MB		[rcuob/4]
0 MB		[rcuob/5]
0 MB		[rcuob/6]
0 MB		[rcuob/7]
0 MB		[rcuop/0]
0 MB		[rcuop/1]
0 MB		[rcuop/2]
0 MB		[rcuop/3]
0 MB		[rcuop/4]
0 MB		[rcuop/5]
0 MB		[rcuop/6]
0 MB		[rcuop/7]
0 MB		[rcuos/0]
0 MB		[rcuos/1]
0 MB		[rcuos/2]
0 MB		[rcuos/3]
0 MB		[rcuos/4]
0 MB		[rcuos/5]
0 MB		[rcuos/6]
0 MB		[rcuos/7]
0 MB		[reiserfs/md1]
0 MB		[reiserfs/md2]
0 MB		[reiserfs/md3]
0 MB		[reiserfs/md4]
0 MB		[reiserfs/md5]
0 MB		[rpciod]
0 MB		[scsi_eh_0]
0 MB		[scsi_eh_10]
0 MB		[scsi_eh_1]
0 MB		[scsi_eh_2]
0 MB		[scsi_eh_3]
0 MB		[scsi_eh_4]
0 MB		[scsi_eh_5]
0 MB		[scsi_eh_6]
0 MB		[scsi_eh_7]
0 MB		[scsi_eh_8]
0 MB		[scsi_eh_9]
0 MB		[scsi_tmf_0]
0 MB		[scsi_tmf_10]
0 MB		[scsi_tmf_1]
0 MB		[scsi_tmf_2]
0 MB		[scsi_tmf_3]
0 MB		[scsi_tmf_4]
0 MB		[scsi_tmf_5]
0 MB		[scsi_tmf_6]
0 MB		[scsi_tmf_7]
0 MB		[scsi_tmf_8]
0 MB		[scsi_tmf_9]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[spinupd]
0 MB		[unraidd]
0 MB		[usb-storage]
0 MB		[vfio-irqfd-clea]
0 MB		[vhost-3772]
0 MB		[writeback]
0 MB		[xfs-buf/md6]
0 MB		[xfs-buf/md7]
0 MB		[xfs-buf/sdb1]
0 MB		[xfs-cil/md6]
0 MB		[xfs-cil/md7]
0 MB		[xfs-cil/sdb1]
0 MB		[xfs-conv/md6]
0 MB		[xfs-conv/md7]
0 MB		[xfs-conv/sdb1]
0 MB		[xfs-data/md6]
0 MB		[xfs-data/md7]
0 MB		[xfs-data/sdb1]
0 MB		[xfs-eofblocks/m]
0 MB		[xfs-eofblocks/m]
0 MB		[xfs-eofblocks/s]
0 MB		[xfs-log/md6]
0 MB		[xfs-log/md7]
0 MB		[xfs-log/sdb1]
0 MB		[xfs-reclaim/md6]
0 MB		[xfs-reclaim/md7]
0 MB		[xfs-reclaim/sdb]
0 MB		[xfs_mru_cache]
0 MB		[xfsaild/md6]
0 MB		[xfsaild/md7]
0 MB		[xfsaild/sdb1]
0 MB		[xfsalloc]
0 MB		[xprtiod]
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.00390625 MB		runsv
0.0429688 MB		/usr/bin/runsvdir
0.0859375 MB		/usr/sbin/acpid
0.109375 MB		/usr/sbin/avahi-dnsconfd
0.226562 MB		/usr/sbin/dnsmasq
0.257812 MB		avahi-daemon:
0.558594 MB		/usr/local/sbin/shfs
0.660156 MB		tail
0.753906 MB		sleep
0.78125 MB		/bin/sh
0.792969 MB		/usr/bin/tail
0.800781 MB		init
0.875 MB		/bin/timeout
1.43359 MB		/usr/sbin/atd
1.55469 MB		/usr/sbin/crond
1.62891 MB		/sbin/agetty
1.71484 MB		/sbin/agetty
1.71484 MB		/sbin/agetty
1.71484 MB		/usr/sbin/inetd
1.76562 MB		/sbin/agetty
1.85156 MB		/sbin/agetty
1.86719 MB		/sbin/agetty
2.01172 MB		sort
2.17969 MB		/usr/sbin/rpc.mountd
2.19531 MB		/sbin/apcupsd
2.21484 MB		/sbin/rpcbind
2.24219 MB		/usr/sbin/dnsmasq
2.32422 MB		/usr/bin/dbus-daemon
2.48047 MB		ps
2.66797 MB		/usr/local/sbin/emhttpd
2.75781 MB		find
2.77344 MB		/usr/sbin/sshd
2.78516 MB		/bin/bash
2.78906 MB		/bin/bash
2.78906 MB		/usr/sbin/cron
2.79688 MB		/bin/bash
2.80469 MB		sh
2.85547 MB		/usr/local/sbin/emhttpd
2.91406 MB		/usr/sbin/netatalk
2.93359 MB		/bin/bash
3.24609 MB		docker-containerd-shim
3.25391 MB		/usr/sbin/rsyslogd
3.26172 MB		awk
3.27344 MB		avahi-daemon:
3.49219 MB		/usr/sbin/virtlockd
3.58984 MB		nginx:
3.68359 MB		/bin/bash
3.70703 MB		-bash
3.83594 MB		-bash
3.85547 MB		-bash
3.89844 MB		-bash
3.94141 MB		-bash
3.94141 MB		-bash
3.94141 MB		/sbin/udevd
4.01953 MB		/usr/sbin/virtlogd
4.06641 MB		/usr/sbin/cnid_metad
4.3125 MB		/usr/sbin/smbd
4.48828 MB		Plex
4.68359 MB		/usr/sbin/afpd
4.91797 MB		sshd:
5.21484 MB		/usr/sbin/ntpd
5.29297 MB		ttyd
5.82812 MB		/sbin/rpc.statd
5.85547 MB		/usr/sbin/smbd
5.93359 MB		/usr/sbin/nmbd
6.1875 MB		/usr/local/sbin/shfs
6.59375 MB		/usr/sbin/winbindd
6.61328 MB		syslog-ng
7.52734 MB		nginx:
9.34375 MB		/usr/sbin/winbindd
9.36719 MB		/usr/bin/python3
9.96094 MB		/usr/sbin/winbindd
12.4258 MB		php-fpm:
13.2344 MB		docker-containerd
13.8633 MB		php-fpm:
13.8672 MB		php-fpm:
15.8867 MB		/usr/sbin/smbd
16.457 MB		/usr/lib/plexmediaserver/Plex
16.832 MB		/usr/sbin/smbd
18.4961 MB		/usr/sbin/libvirtd
20.1875 MB		rcloneorig
21.2383 MB		rcloneorig
23.2266 MB		/usr/bin/php
34.5 MB		Plex
43.2773 MB		/usr/bin/dockerd
43.5078 MB		Plex
46.1836 MB		Plex
56.9062 MB		rcloneorig
61.5156 MB		Plex
175.668 MB		./Plex
4160.18 MB		/usr/bin/qemu-system-x86_64
root@Tower:~# 

 

Share this post


Link to post

The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.

 

root@Tower:~# df -h /

Filesystem      Size  Used Avail Use% Mounted on

rootfs          7.8G  7.5G  282M  97% /

 

 

root@Tower:~# df

Filesystem         1K-blocks        Used     Available Use% Mounted on

rootfs               8138444     7850684        287760  97% /

tmpfs                  32768         628         32140   2% /run

devtmpfs             8138456           0       8138456   0% /dev

tmpfs                8181420           0       8181420   0% /dev/shm

cgroup_root             8192           0          8192   0% /sys/fs/cgroup

tmpfs                 131072         836        130236   1% /var/log

/dev/sda1            3938272     1341680       2596592  35% /boot

/dev/loop0              7680        7680             0 100% /lib/modules

/dev/loop1              4608        4608             0 100% /lib/firmware

/dev/md1          1953454928  1538138108     415316820  79% /mnt/disk1

/dev/md2          2930177100  2422055472     508121628  83% /mnt/disk2

/dev/md3          2930177100  2384118524     546058576  82% /mnt/disk3

/dev/md4          1953454928  1783368828     170086100  92% /mnt/disk4

/dev/md5          1953454928  1554891196     398563732  80% /mnt/disk5

/dev/md6          1952560688  1573464484     379096204  81% /mnt/disk6

/dev/md7          1952560688  1511958448     440602240  78% /mnt/disk7

/dev/sdb1          499863384   337906828     161956556  68% /mnt/cache

shfs             15625840360 12767995060    2857845300  82% /mnt/user0

shfs             16125703744 13105901888    3019801856  82% /mnt/user

google:        1099511627776 13618686060 1099511627776   2% /mnt/disks/google

/dev/loop2          20971520     5332000      13948304  28% /var/lib/docker

encrypted:     1099511627776 13618686060 1099511627776   2% /mnt/disks/encrypted

local-decrypt: 1099511627776 13618686060 1099511627776   2% /mnt/disks/decrypted

/dev/loop3           1048576       17380        647164   3% /etc/libvirt

root@Tower:~# 

 

root@Tower:~# free -m

              total        used        free      shared  buff/cache   available

Mem:          15979         944        4286        7668       10748        6773

Swap:             0           0           0

root@Tower:~# 

 

I've taken another diagnostic that I'll attach to this post.

 

How do I figure out whats filling up Rootfs?

tower-diagnostics-20180515-1343.zip

Share this post


Link to post
The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.
 
root@Tower:~# df -h /
Filesystem      Size  Used Avail Use% Mounted on
rootfs          7.8G  7.5G  282M  97% /
 
 
root@Tower:~# df
Filesystem         1K-blocks        Used     Available Use% Mounted on
rootfs               8138444     7850684        287760  97% /
tmpfs                  32768         628         32140   2% /run
devtmpfs             8138456           0       8138456   0% /dev
tmpfs                8181420           0       8181420   0% /dev/shm
cgroup_root             8192           0          8192   0% /sys/fs/cgroup
tmpfs                 131072         836        130236   1% /var/log
/dev/sda1            3938272     1341680       2596592  35% /boot
/dev/loop0              7680        7680             0 100% /lib/modules
/dev/loop1              4608        4608             0 100% /lib/firmware
/dev/md1          1953454928  1538138108     415316820  79% /mnt/disk1
/dev/md2          2930177100  2422055472     508121628  83% /mnt/disk2
/dev/md3          2930177100  2384118524     546058576  82% /mnt/disk3
/dev/md4          1953454928  1783368828     170086100  92% /mnt/disk4
/dev/md5          1953454928  1554891196     398563732  80% /mnt/disk5
/dev/md6          1952560688  1573464484     379096204  81% /mnt/disk6
/dev/md7          1952560688  1511958448     440602240  78% /mnt/disk7
/dev/sdb1          499863384   337906828     161956556  68% /mnt/cache
shfs             15625840360 12767995060    2857845300  82% /mnt/user0
shfs             16125703744 13105901888    3019801856  82% /mnt/user
google:        1099511627776 13618686060 1099511627776   2% /mnt/disks/google
/dev/loop2          20971520     5332000      13948304  28% /var/lib/docker
encrypted:     1099511627776 13618686060 1099511627776   2% /mnt/disks/encrypted
local-decrypt: 1099511627776 13618686060 1099511627776   2% /mnt/disks/decrypted
/dev/loop3           1048576       17380        647164   3% /etc/libvirt
root@Tower:~
 
root@Tower:~# free -m
              total        used        free      shared  buff/cache   available
Mem:          15979         944        4286        7668       10748        6773
Swap:             0           0           0
root@Tower:~
 
I've taken another diagnostic that I'll attach to this post.
 
How do I figure out whats filling up Rootfs?
tower-diagnostics-20180515-1343.zip
Post your docker run command for Plex. My money is going to be on that.

Share this post


Link to post

Ho

7 minutes ago, CHBMB said:
9 minutes ago, jude said:
The server has been up for 22 hours and I am getting warnings from Fix Common Problems that Rootfs is getting full (97%). I shutdown the Plex Server docker and my Windows 10 VM and its still sitting at 97%.
 
root@Tower:~# df -h /
Filesystem      Size  Used Avail Use% Mounted on
rootfs          7.8G  7.5G  282M  97% /
 
 
root@Tower:~# df
Filesystem         1K-blocks        Used     Available Use% Mounted on
rootfs               8138444     7850684        287760  97% /
tmpfs                  32768         628         32140   2% /run
devtmpfs             8138456           0       8138456   0% /dev
tmpfs                8181420           0       8181420   0% /dev/shm
cgroup_root             8192           0          8192   0% /sys/fs/cgroup
tmpfs                 131072         836        130236   1% /var/log
/dev/sda1            3938272     1341680       2596592  35% /boot
/dev/loop0              7680        7680             0 100% /lib/modules
/dev/loop1              4608        4608             0 100% /lib/firmware
/dev/md1          1953454928  1538138108     415316820  79% /mnt/disk1
/dev/md2          2930177100  2422055472     508121628  83% /mnt/disk2
/dev/md3          2930177100  2384118524     546058576  82% /mnt/disk3
/dev/md4          1953454928  1783368828     170086100  92% /mnt/disk4
/dev/md5          1953454928  1554891196     398563732  80% /mnt/disk5
/dev/md6          1952560688  1573464484     379096204  81% /mnt/disk6
/dev/md7          1952560688  1511958448     440602240  78% /mnt/disk7
/dev/sdb1          499863384   337906828     161956556  68% /mnt/cache
shfs             15625840360 12767995060    2857845300  82% /mnt/user0
shfs             16125703744 13105901888    3019801856  82% /mnt/user
google:        1099511627776 13618686060 1099511627776   2% /mnt/disks/google
/dev/loop2          20971520     5332000      13948304  28% /var/lib/docker
encrypted:     1099511627776 13618686060 1099511627776   2% /mnt/disks/encrypted
local-decrypt: 1099511627776 13618686060 1099511627776   2% /mnt/disks/decrypted
/dev/loop3           1048576       17380        647164   3% /etc/libvirt
root@Tower:~
 
root@Tower:~# free -m
              total        used        free      shared  buff/cache   available
Mem:          15979         944        4286        7668       10748        6773
Swap:             0           0           0
root@Tower:~
 
I've taken another diagnostic that I'll attach to this post.
 
How do I figure out whats filling up Rootfs?
tower-diagnostics-20180515-1343.zip

Post your docker run command for Plex. My money is going to be on that.

Sorry, how do I find that?

Share this post


Link to post

There's a link in my signature or there's a link in the Docker FAQ sticky.

Share this post


Link to post
Posted (edited)

OK found an explanation of how to get the docker run command here

 

Here is the docker run command

 

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='PlexMediaServer-needo' --net='host' --privileged=true -e TZ="America/Chicago" -e HOST_OS="unRAID" -e 'VERSION'='' -v '/mnt/cache/apps/Plex/transcode':'/transcode':'rw' -v '/mnt/cache/apps/Plex/':'/config':'rw' -v '/mnt/':'/mnt':'rw' -v '/mnt/disks/encrypted/movies':'/MoviesArchive':'ro,slave' -v '/mnt/disks/encrypted/tv':'/TVarchive':'ro,slave' --cpuset-cpus=2,3,4,5,6,7 'needo/plex' 

fcfd206c0fd16979cc4f3e33a00a11278409daf696593b712a75d965ae55f96d

Edited by jude

Share this post


Link to post

Aside from using needo's  extremely old container version of Plex, can't see anything there that is directly mapped to memory.

Share this post


Link to post
11 minutes ago, CHBMB said:

Aside from using needo's  extremely old container version of Plex, can't see anything there that is directly mapped to memory.

Is there a way of listing the contents of Rootfs to show whats going on?

Share this post


Link to post

Why don't you try not running certain add-ons for a while? If your rootfs fills up in 22 hours it should only take a day to eliminate each one once and for all.

Share this post


Link to post

I think it all stems from the cache setting for Rclone cache mounts. I've made changes to Rclone cache configuration and i'll monitor to see if this works.

Share this post


Link to post

Things are working much better now. I'm going to call it solved. The Cache setting in Rclone was set too high. I have lowered maximum cache to 1GB.

 

Rootfs is now staying around 21% full.

Share this post


Link to post

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now