April 9, 20251 yr Hi there! according to common problems my logs are increasing on size way too fast: Quote Either your server has an extremely long uptime, or your syslog could be potentially being spammed with error messages. A reboot of your server will at least temporarily solve this problem, but ideally you should seek assistance in the forums and post your diagnostics. so here i am, with diagnostics attached! i've had this some time ago but i didn't have diagnotics that time (becaue i had to reboot). any help appreciated! best regards datatower-diagnostics-20250409-1212.zip
April 9, 20251 yr Community Expert The output from running the following commands might help pin down what is taking up the space du -h /var/log/ ls -l /var/log
April 9, 20251 yr Author looks like syslogs take up all the space: root@DataTower:~# du -h /var/log/ 0 /var/log/libvirt/ch 0 /var/log/libvirt/qemu 0 /var/log/libvirt 0 /var/log/nfsd 4.0K /var/log/nginx 28K /var/log/pkgtools/removed_packages 16K /var/log/pkgtools/removed_scripts 0 /var/log/pkgtools/removed_uninstall_scripts 44K /var/log/pkgtools 0 /var/log/plugins 0 /var/log/sa 0 /var/log/samba/cores/smbd 0 /var/log/samba/cores/nmbd 0 /var/log/samba/cores/winbindd 0 /var/log/samba/cores/samba-dcerpcd 0 /var/log/samba/cores/rpcd_lsad 0 /var/log/samba/cores/rpcd_classic 0 /var/log/samba/cores/rpcd_winreg 0 /var/log/samba/cores 4.0K /var/log/samba 0 /var/log/swtpm/libvirt/qemu 0 /var/log/swtpm/libvirt 0 /var/log/swtpm 0 /var/log/preclear 0 /var/log/pwfail 88M /var/log/ root@DataTower:~# ls -l /var/log total 89256 -rw------- 1 root root 0 Jan 9 23:13 btmp -rw-r--r-- 1 root root 0 Apr 28 2021 cron -rw-r--r-- 1 root root 0 Apr 28 2021 debug -rw-r--r-- 1 root root 63273 Feb 3 21:44 dmesg -rw-r--r-- 1 root root 184384 Apr 9 00:03 docker.log -rw-r--r-- 1 root root 0 Dec 5 22:48 faillog -rw-r--r-- 1 root root 292 Apr 9 17:31 lastlog drwxr-xr-x 4 root root 80 Sep 28 2024 libvirt/ -rw-r--r-- 1 root root 0 Apr 28 2021 maillog -rw-r--r-- 1 root root 0 Apr 28 2021 messages drwxr-xr-x 2 root root 40 Dec 11 19:44 nfsd/ drwxr-x--- 2 nobody root 60 Feb 3 21:45 nginx/ lrwxrwxrwx 1 root root 24 Jan 9 23:11 packages -> ../lib/pkgtools/packages/ drwxr-xr-x 5 root root 100 Feb 3 21:45 pkgtools/ drwxr-xr-x 2 root root 400 Mar 28 00:00 plugins/ drwxr-xr-x 2 root root 60 Feb 3 21:45 preclear/ drwxr-xr-x 2 root root 40 Apr 9 12:08 pwfail/ lrwxrwxrwx 1 root root 25 Jan 9 23:13 removed_packages -> pkgtools/removed_packages/ lrwxrwxrwx 1 root root 24 Jan 9 23:13 removed_scripts -> pkgtools/removed_scripts/ lrwxrwxrwx 1 root root 34 Feb 3 21:45 removed_uninstall_scripts -> pkgtools/removed_uninstall_scripts/ drwxr-xr-x 2 root root 40 Jul 3 2024 sa/ drwxr-xr-x 3 root root 320 Feb 3 21:44 samba/ lrwxrwxrwx 1 root root 23 Jan 9 23:11 scripts -> ../lib/pkgtools/scripts/ -rw-r--r-- 1 root root 0 Apr 28 2021 secure lrwxrwxrwx 1 root root 21 Jan 9 23:11 setup -> ../lib/pkgtools/setup/ -rw-r--r-- 1 root root 0 Apr 28 2021 spooler drwxr-xr-x 3 root root 60 Sep 28 2024 swtpm/ -rw-r--r-- 1 root root 169975 Apr 9 17:31 syslog -rw-r--r-- 1 root root 89829376 Apr 5 04:40 syslog.1 -rw-r--r-- 1 root root 1117857 Mar 26 04:40 syslog.2 -rw------- 1 root root 941 Feb 26 00:00 unbalanced.log -rw-r--r-- 1 root root 0 Feb 3 21:44 vfio-pci -rw-r--r-- 1 root root 0 Feb 3 21:44 vfio-pci-errors -rw-r--r-- 1 root root 670 Feb 3 21:44 wg-quick.log -rw-rw-r-- 1 root utmp 8832 Apr 9 17:31 wtmp best regards
April 9, 20251 yr Community Expert That is strange as the syslog.1 file in the diagnostics is only 65KB. You might get a clue by looking at the contents of that file to see what is being reported in it.
April 9, 20251 yr Author syslog.1 has 1832696 lines, 1831923 say [Timestamp] DataTower shfs: share cache full all between Apr 4 08:26:34 and Apr 4 13:21:44 from what i can see this is caused by downloads. but my dl share is set to primary > cache and secondary > array, so when cache is full it should write directly to array, no? Edited April 9, 20251 yr by pika
April 9, 20251 yr Community Expert Solution Doesn't look like any share has Minimum less than available cache space currently. Did cache get below 100G free during that time?
April 10, 20251 yr Community Expert 9 hours ago, pika said: share cache full This means a share floor his being hit, and new writes are bypassing the pool.
April 10, 20251 yr Author 9 hours ago, trurl said: Did cache get below 100G free during that time? is there a way to verify? 12 minutes ago, JorgeB said: This means a share floor his being hit, and new writes are bypassing the pool. what is the share floor? the "Minimum free space" in the share settings? this is set to 97.7 GB for downloads share. at this moment there's more then enough space: i doubt that on april 4 chache was filled up to 900gb (again: can i verify that?).
April 10, 20251 yr Community Expert 2 hours ago, pika said: this is set to 97.7 GB for downloads share. at this moment there's more then enough space: Yes, but at some points in the past there wasn't, here are a couple of TRIM logs showing the pool close to the floor (only the free space is trimmed): Mar 6 03:01:09 DataTower root: /mnt/cache: 129 GiB (138511339520 bytes) trimmed on /dev/nvme0n1p1 Apr 6 03:02:22 DataTower root: /mnt/cache: 180.2 GiB (193513717760 bytes) trimmed on /dev/nvme0n1p1 Other than the spam, that warning is hamless, but to get rid of it, you would need to lower the floor, or make sure the pool doesn't get so full. P.S. also seeing some PCIe error slogged, try this first: https://forums.unraid.net/topic/118286-nvme-drives-throwing-errors-filling-logs-instantly-how-to-resolve/?do=findComment&comment=1165009
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.