I'm currently running 6.1-rc2, but I think I already experienced the issue before...

 

I first noticed the problem, when I try to install a new plugin but get several errors "No space left on device"

 

Verifying package dynamix.apcupsd.status-2015.08.05.txz.
expr: syntax error
/sbin/installpkg: line 432: [: -lt: unary operator expected
/sbin/installpkg: line 434: [: -lt: unary operator expected
expr: syntax error
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 466: echo: write error: No space left on device
/sbin/installpkg: line 469: echo: write error: No space left on device
cat: write error: No space left on device
Installing package dynamix.apcupsd.status-2015.08.05.txz:
PACKAGE DESCRIPTION:
/sbin/installpkg: line 537: echo: write error: No space left on device
/sbin/installpkg: line 538: echo: write error: No space left on device
/sbin/installpkg: line 539: echo: write error: No space left on device
/sbin/installpkg: line 540: echo: write error: No space left on device
/sbin/installpkg: line 545: echo: write error: No space left on device
/sbin/installpkg: line 550: echo: write error: No space left on device
WARNING: Package has not been created with 'makepkg'
/sbin/installpkg: line 559: echo: write error: No space left on device
Package dynamix.apcupsd.status-2015.08.05.txz installed.


chmod: missing operand after '644'
Try 'chmod --help' for more information.

 

I then checked via telnet the free space (df -h):

Filesystem      Size  Used Avail Use% Mounted on
tmpfs           128M  128M     0 100% /var/log
/dev/sda1       7.5G  318M  7.2G   5% /boot
/dev/md1        1.9T  1.1T  799G  58% /mnt/disk1
/dev/md2        1.9T  1.9T   19G 100% /mnt/disk2
/dev/md3        2.8T  2.2T  571G  80% /mnt/disk3
/dev/md4        1.9T  1.8T   44G  98% /mnt/disk4
/dev/md5        2.8T  1.7T  1.2T  60% /mnt/disk5
/dev/md6        2.8T  2.2T  549G  81% /mnt/disk6
/dev/md7        2.8T  2.4T  398G  86% /mnt/disk7
/dev/md8        1.9T  1.8T   36G  99% /mnt/disk8
/dev/md9        1.9T  1.7T  173G  91% /mnt/disk9
/dev/md10       2.8T  2.5T  234G  92% /mnt/disk10
/dev/md11       1.9T  1.9T   17G 100% /mnt/disk11
/dev/sdd1       932G  165G  767G  18% /mnt/cache
shfs             25T   21T  3.9T  85% /mnt/user0
shfs             26T   21T  4.7T  82% /mnt/user
/dev/loop0       25G  7.0G   17G  30% /var/lib/docker
/dev/loop1      1.8M   80K  1.6M   5% /etc/libvirt

 

I noticed, tempfs is mounted to /var/log and is filled up. So I checked the folder and found several folders and files I don't think belong there...

 

root@Tower:/var/log# ls -la
total 41432
drwxr-xr-x 12 root root      600 Aug  2 04:40 ./
drwxr-xr-x 12 root root      280 Jun  5  2013 ../
-rw-r--r--  1 root root      216 Aug  3 01:34 apcupsd.events
-rw-r--r--  1 root root      198 Aug  2 04:40 apcupsd.events.1
-rw-------  1 root root        0 Aug  1 04:40 btmp
-rw-------  1 root root        0 Jul 26 11:03 btmp.1
-rw-r--r--  1 root root        0 Dec 12  2014 cron
-rw-r--r--  1 root root        0 Dec 12  2014 debug
-rw-rw-rw-  1 root root    49943 Jul 27 14:33 dmesg
-rw-rw-rw-  1 root root     1964 Jul 31 11:23 docker.log
-rw-r--r--  1 root root        0 Feb 14  2014 faillog
-rw-r--r--  1 root root      292 Jul 31 16:22 lastlog
drwxr-xr-x  5 root root      120 Jul 27 14:33 libvirt/
-rw-r--r--  1 root root        0 Dec 12  2014 maillog
-rw-r--r--  1 root root        0 Dec 12  2014 messages
drwxr-xr-x  2 root root       40 May 16  2001 nfsd/
drwxr-xr-x  2 root root     3800 Aug  6 10:02 packages/
drwxr-xr-x  2 root root      380 Aug  6 10:02 plugins/
drwxr-xr-x  2 root root       40 Oct 27  1998 removed_packages/
drwxr-xr-x  2 root root       40 Oct 27  1998 removed_scripts/
drwxrwxrwx  2 root root      260 Aug  6 00:00 sa/
drwxr-xr-x  3 root root      100 Jul 27 14:33 samba/
drwxr-xr-x  2 root root      540 Aug  3 12:48 scripts/
-rw-r--r--  1 root root        0 Dec 12  2014 secure
drwxr-xr-x  3 root root       80 Aug 21  2012 setup/
-rw-rw-rw-  1 root root 40353792 Aug  6 10:00 snmpd.log
-rw-r--r--  1 root root        0 Dec 12  2014 spooler
-rw-r--r--  1 root root   315392 Aug  6 10:04 syslog
-rw-r--r--  1 root root  1671751 Aug  1 04:39 syslog.1
-rw-rw-r--  1 root utmp    11904 Jul 31 16:22 wtmp

 

so now the question is, what caused this error. is the filesystem mounted wrongly, does the plugin installation do something wrong?

 

I've attached a disgnostics zip to help figure this out...

tower-diagnostics-20150806-1011.zip

It looks as if you have installed an SNMP plugin that is generating an excessively large log file.  Maybe it needs configuring differently to avoid this?

right, didn't notice that one big file 

since I currently don't actively use snmp, I'll uninstall it und see, if /var/log gives me trouble again...

 

took a look at the log and aparently every single connection is logged. observium checks every few seconds, so there are a lot of connections...

 

thanks

See here