June 13, 20215 yr Hey guys, on the Dashboard under Memory then Docker, its a 71% and growing, its normally a very low number. I attached a diagnostic, can anyone tell what's causing it? I also have a notification of "Warning [TOWER] - Docker image disk utilization of 71%". When I look under the Docker tab and advanced view, none of the containers are using a lot of memory. Thanks... tower-diagnostics-20210613-0439.zip Edited June 13, 20215 yr by SPOautos
June 13, 20215 yr Author Also, if it makes a difference, everything is up to date....6.9.2 with all containers and plugins updated. I'm pretty sure this is going to keep getting higher and higher over a couple day period. I'm pretty sure this happened a couple weeks ago and eventually made my server crash (well it crashed and I never found out why and it was running fine when it booted back up, and I just *think* it must have been because of this). I've looked through the log but I don't see anything jumping out at me....but I also don't know enough about what all is going on behind the scenes to know what everything means. I'm not a IT/Computer guy.....We have a children's clothing store and I do construction lol. To be honest I don't even know how I got all this working and being useful except that the forum community is awesome. Edited June 13, 20215 yr by SPOautos
June 13, 20215 yr Author I recently set up a Syslog file that runs and this is what it shows for the 11th, 12th, 13th but I dont think I'm seeing anything in here that would be causing a issue of docker image disk utilization being high. I do have mining running and its been running for months so I doubt that is the cause, it doesn't use much memory, it uses the GPU and half the CPU. I have no idea what all these entries are regarding port numbers and entering blacking/forwarding/disabled states. Jun 11 00:00:32 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 01:01:14 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 02:00:14 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 03:00:11 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 04:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 04:00:47 Tower root: /var/lib/docker: 12.9 GiB (13833793536 bytes) trimmed on /dev/loop2 Jun 11 04:00:47 Tower root: /mnt/cache: 331.4 GiB (355793293312 bytes) trimmed on /dev/nvme0n1p1 Jun 11 04:40:01 Tower root: Fix Common Problems Version 2021.05.03 Jun 11 05:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 06:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 07:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered blocking state Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered disabled state Jun 11 07:44:09 Tower kernel: device veth2de21d8 entered promiscuous mode Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered blocking state Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered forwarding state Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered disabled state Jun 11 07:44:09 Tower kernel: eth0: renamed from veth5f484ab Jun 11 07:44:09 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth2de21d8: link becomes ready Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered blocking state Jun 11 07:44:09 Tower kernel: docker0: port 5(veth2de21d8) entered forwarding state Jun 11 08:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 08:24:45 Tower kernel: docker0: port 6(veth00d4a84) entered blocking state Jun 11 08:24:45 Tower kernel: docker0: port 6(veth00d4a84) entered disabled state Jun 11 08:24:45 Tower kernel: device veth00d4a84 entered promiscuous mode Jun 11 08:24:46 Tower kernel: eth0: renamed from veth164898c Jun 11 08:24:46 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth00d4a84: link becomes ready Jun 11 08:24:46 Tower kernel: docker0: port 6(veth00d4a84) entered blocking state Jun 11 08:24:46 Tower kernel: docker0: port 6(veth00d4a84) entered forwarding state Jun 11 08:53:06 Tower kernel: docker0: port 6(veth00d4a84) entered disabled state Jun 11 08:53:06 Tower kernel: veth164898c: renamed from eth0 Jun 11 08:53:06 Tower kernel: docker0: port 6(veth00d4a84) entered disabled state Jun 11 08:53:06 Tower kernel: device veth00d4a84 left promiscuous mode Jun 11 08:53:06 Tower kernel: docker0: port 6(veth00d4a84) entered disabled state Jun 11 08:53:07 Tower kernel: docker0: port 6(vetha6de89e) entered blocking state Jun 11 08:53:07 Tower kernel: docker0: port 6(vetha6de89e) entered disabled state Jun 11 08:53:07 Tower kernel: device vetha6de89e entered promiscuous mode Jun 11 08:53:07 Tower kernel: docker0: port 6(vetha6de89e) entered blocking state Jun 11 08:53:07 Tower kernel: docker0: port 6(vetha6de89e) entered forwarding state Jun 11 08:53:07 Tower kernel: eth0: renamed from veth61b0ff9 Jun 11 08:53:07 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vetha6de89e: link becomes ready Jun 11 09:00:08 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 09:00:37 Tower kernel: docker0: port 6(vetha6de89e) entered disabled state Jun 11 09:00:37 Tower kernel: veth61b0ff9: renamed from eth0 Jun 11 09:00:37 Tower kernel: docker0: port 6(vetha6de89e) entered disabled state Jun 11 09:00:37 Tower kernel: device vetha6de89e left promiscuous mode Jun 11 09:00:37 Tower kernel: docker0: port 6(vetha6de89e) entered disabled state Jun 11 09:00:37 Tower kernel: docker0: port 6(veth3969633) entered blocking state Jun 11 09:00:37 Tower kernel: docker0: port 6(veth3969633) entered disabled state Jun 11 09:00:37 Tower kernel: device veth3969633 entered promiscuous mode Jun 11 09:00:37 Tower kernel: docker0: port 6(veth3969633) entered blocking state Jun 11 09:00:37 Tower kernel: docker0: port 6(veth3969633) entered forwarding state Jun 11 09:00:38 Tower kernel: eth0: renamed from vethfd855b4 Jun 11 09:00:38 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth3969633: link becomes ready Jun 11 09:11:08 Tower kernel: docker0: port 6(veth3969633) entered disabled state Jun 11 09:11:08 Tower kernel: vethfd855b4: renamed from eth0 Jun 11 09:11:08 Tower kernel: docker0: port 6(veth3969633) entered disabled state Jun 11 09:11:08 Tower kernel: device veth3969633 left promiscuous mode Jun 11 09:11:08 Tower kernel: docker0: port 6(veth3969633) entered disabled state Jun 11 09:11:09 Tower kernel: docker0: port 6(veth3cc4ddf) entered blocking state Jun 11 09:11:09 Tower kernel: docker0: port 6(veth3cc4ddf) entered disabled state Jun 11 09:11:09 Tower kernel: device veth3cc4ddf entered promiscuous mode Jun 11 09:11:09 Tower kernel: docker0: port 6(veth3cc4ddf) entered blocking state Jun 11 09:11:09 Tower kernel: docker0: port 6(veth3cc4ddf) entered forwarding state Jun 11 09:11:09 Tower kernel: eth0: renamed from veth83942c3 Jun 11 09:11:09 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth3cc4ddf: link becomes ready Jun 11 09:19:24 Tower kernel: docker0: port 6(veth3cc4ddf) entered disabled state Jun 11 09:19:24 Tower kernel: veth83942c3: renamed from eth0 Jun 11 09:19:24 Tower kernel: docker0: port 6(veth3cc4ddf) entered disabled state Jun 11 09:19:24 Tower kernel: device veth3cc4ddf left promiscuous mode Jun 11 09:19:24 Tower kernel: docker0: port 6(veth3cc4ddf) entered disabled state Jun 11 09:19:25 Tower kernel: docker0: port 6(veth6bc6288) entered blocking state Jun 11 09:19:25 Tower kernel: docker0: port 6(veth6bc6288) entered disabled state Jun 11 09:19:25 Tower kernel: device veth6bc6288 entered promiscuous mode Jun 11 09:19:25 Tower kernel: docker0: port 6(veth6bc6288) entered blocking state Jun 11 09:19:25 Tower kernel: docker0: port 6(veth6bc6288) entered forwarding state Jun 11 09:19:25 Tower kernel: eth0: renamed from vethfac2dbd Jun 11 09:19:25 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth6bc6288: link becomes ready Jun 11 09:22:54 Tower kernel: docker0: port 6(veth6bc6288) entered disabled state Jun 11 09:22:54 Tower kernel: vethfac2dbd: renamed from eth0 Jun 11 09:22:54 Tower kernel: docker0: port 6(veth6bc6288) entered disabled state Jun 11 09:22:54 Tower kernel: device veth6bc6288 left promiscuous mode Jun 11 09:22:54 Tower kernel: docker0: port 6(veth6bc6288) entered disabled state Jun 11 09:22:55 Tower kernel: docker0: port 6(vethb4fba36) entered blocking state Jun 11 09:22:55 Tower kernel: docker0: port 6(vethb4fba36) entered disabled state Jun 11 09:22:55 Tower kernel: device vethb4fba36 entered promiscuous mode Jun 11 09:22:55 Tower kernel: docker0: port 6(vethb4fba36) entered blocking state Jun 11 09:22:55 Tower kernel: docker0: port 6(vethb4fba36) entered forwarding state Jun 11 09:22:55 Tower kernel: eth0: renamed from vethcd82465 Jun 11 09:22:55 Tower kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethb4fba36: link becomes ready Jun 11 10:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 11:00:08 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 12:00:09 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 13:00:01 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 14:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 15:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 16:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 17:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 18:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 19:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 20:00:09 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 21:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 22:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 11 23:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 00:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 01:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 02:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 03:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 04:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 04:00:43 Tower root: /var/lib/docker: 3.1 GiB (3280904192 bytes) trimmed on /dev/loop2 Jun 12 04:00:43 Tower root: /mnt/cache: 326.5 GiB (350595309568 bytes) trimmed on /dev/nvme0n1p1 Jun 12 04:40:01 Tower root: Fix Common Problems Version 2021.05.03 Jun 12 04:40:15 Tower root: FCP Debug Log: root 25980 1198 0.8 3598248 274764 ? Sl Jun11 13867:55 ./xmrig --url=xmr-us-east1.nanopool.org:14433 --coin=monero --user= *I removed the user data from the copy/paste* Jun 12 04:40:15 Tower root: Fix Common Problems: Warning: Possible mining software running ** Ignored Jun 12 05:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 06:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 07:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 08:00:25 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 09:00:23 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 10:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 11:00:09 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 12:00:09 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 13:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 14:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 15:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 16:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 17:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 18:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 19:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 20:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 21:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 22:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 12 23:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 00:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 01:00:09 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 02:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 03:00:07 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 04:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 04:00:42 Tower root: /var/lib/docker: 3 GiB (3194228736 bytes) trimmed on /dev/loop2 Jun 13 04:00:42 Tower root: /mnt/cache: 326.7 GiB (350819770368 bytes) trimmed on /dev/nvme0n1p1 Jun 13 04:40:01 Tower root: Fix Common Problems Version 2021.05.03 Jun 13 04:40:14 Tower root: FCP Debug Log: root 25980 1198 0.8 3596196 277248 ? Sl Jun11 31122:13 ./xmrig --url=xmr-us-east1.nanopool.org:14433 --coin=monero --user= *I removed the user data from the copy/paste* Jun 13 04:40:14 Tower root: Fix Common Problems: Warning: Possible mining software running ** Ignored Jun 13 04:40:15 Tower apcupsd[6677]: apcupsd exiting, signal 15 Jun 13 04:40:15 Tower apcupsd[6677]: apcupsd shutdown succeeded Jun 13 04:40:18 Tower apcupsd[11753]: apcupsd 3.14.14 (31 May 2016) slackware startup succeeded Jun 13 04:40:18 Tower apcupsd[11753]: NIS server startup succeeded Jun 13 05:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 06:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 07:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 08:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 08:56:11 Tower emhttpd: cmd: /usr/local/emhttp/plugins/dynamix.plugin.manager/scripts/plugin update unassigned.devices.plg Jun 13 08:56:11 Tower root: plugin: running: anonymous Jun 13 08:56:11 Tower root: plugin: creating: /boot/config/plugins/unassigned.devices/unassigned.devices-2021.06.11.tgz - downloading from URL https://github.com/dlandon/unassigned.devices/raw/master/unassigned.devices-2021.06.11.tgz Jun 13 08:56:12 Tower root: plugin: checking: /boot/config/plugins/unassigned.devices/unassigned.devices-2021.06.11.tgz - MD5 Jun 13 08:56:12 Tower root: plugin: creating: /tmp/start_unassigned_devices - from INLINE content Jun 13 08:56:12 Tower root: plugin: setting: /tmp/start_unassigned_devices - mode to 0770 Jun 13 08:56:12 Tower root: plugin: skipping: /boot/config/plugins/unassigned.devices/unassigned.devices.cfg already exists Jun 13 08:56:12 Tower root: plugin: skipping: /boot/config/plugins/unassigned.devices/samba_mount.cfg already exists Jun 13 08:56:12 Tower root: plugin: skipping: /boot/config/plugins/unassigned.devices/iso_mount.cfg already exists Jun 13 08:56:12 Tower root: plugin: skipping: /tmp/unassigned.devices/smb-settings.conf already exists Jun 13 08:56:12 Tower root: plugin: skipping: /tmp/unassigned.devices/config/smb-extra.conf already exists Jun 13 08:56:12 Tower root: plugin: skipping: /tmp/unassigned.devices/add-smb-extra already exists Jun 13 08:56:12 Tower root: plugin: setting: /tmp/unassigned.devices/add-smb-extra - mode to 0770 Jun 13 08:56:12 Tower root: plugin: skipping: /tmp/unassigned.devices/remove-smb-extra already exists Jun 13 08:56:12 Tower root: plugin: setting: /tmp/unassigned.devices/remove-smb-extra - mode to 0770 Jun 13 08:56:12 Tower root: plugin: running: anonymous Jun 13 09:00:45 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null Jun 13 10:00:16 Tower crond[2908]: exit status 1 from user root /usr/local/sbin/mover &> /dev/null </pre> </body> </html> Edited June 13, 20215 yr by SPOautos
June 13, 20215 yr 24 minutes ago, SPOautos said: When I look under the Docker tab and advanced view, none of the containers are using a lot of memory. Post a screenshot of Container Size. The dashboard is referring to the image utilization, not memory.
June 13, 20215 yr Author 13 minutes ago, Squid said: Post a screenshot of Container Size. The dashboard is referring to the image utilization, not memory. Edited June 13, 20215 yr by SPOautos
June 13, 20215 yr It's the mining containers taking up the space. I don't know how they work well enough to be able to advise if it's possible to store the data outside of the container, etc. Ask in the respective support threads for them.
June 13, 20215 yr Author 3 hours ago, Squid said: It's the mining containers taking up the space. I don't know how they work well enough to be able to advise if it's possible to store the data outside of the container, etc. Ask in the respective support threads for them. But all of my containers added together are only 19.9GB disk utilization, right? How is that so high? Is this just based on a setting somewhere that I'm only allowing a certain amount of space dedicated to containers?
Archived
This topic is now archived and is closed to further replies.