Docker Image & Critical DIsk Utilization

[helpermonkey]

So I am getting errors like this:

 

04-06-2021 00:54    Docker critical image disk utilization    Alert [BUDDHA] - Docker image disk utilization of 100%    Docker utilization of image file /mnt/cache/docker.img    alert

 

However, I have a 1TB cache drive so i'm not sure why this is happening.

Of note it says in the explorer that i have 54.5gb used - which seems high to me. The docker img itself displays as 21.5 gb. and the drive shows 945gb free.

No idea why this is happening - the only thing i can think of is it has to do with my SAB installation perhaps? But i map those downloads to /data/Incomplete and /data/Complete which resides under my downloads share (also on the cache).

 

Happy to share other information but wasn't sure what would be useful.

[trurl]

If possible before rebooting and preferably with the array started
Go to Tools - Diagnostics and attach the complete Diagnostics ZIP file to your NEXT post in this thread.

[helpermonkey]

Thanks - so I had already restarted by the time i saw this but i did run fix common problems and i guess i do have something misconfigured as you will see in the screenshot. that said, i'm not sure where exact;y the problem is.

 

Attached is the diagnostics per the request - i hope it has sufficient information but just in case ... here's what i'm trying to accomplish:

 

- My cache drive has an appdata share and a downloads share created on it. The appdata share is set to only for cache and the downloads is set to yes.

The idea is that my appdata share houses all of my docker configurations and then the downloads share is where anything is downloaded to first before being moved to my data drives.

 

Will post anything else you need. Thanks!

 

buddha-diagnostics-20210407-1454.zip

Edited April 7, 2021 by helpermonkey

[trurl]

The 20G you have configured should be plenty for docker.img

 

You must have an application writing into it. The usual cause for filling docker.img is an application writing to a path that isn't mapped. Any setting within the application that specifies a path to write must match a container path in the mappings. Linux is case-sensitive, so upper/lower case must match.

[trurl]

And I notice you saying

31 minutes ago, helpermonkey said:

downloads share

but looks like that share is actually named Downloads, so I suspect you have made some mistake like that in one of your downloading applications.

[trurl]

Is SAB the only downloader you use?

 

Post your docker run for SAB as explained at the very first link in the Docker FAQ.

[helpermonkey]

9 minutes ago, trurl said:

Is SAB the only downloader you use?

 

Post your docker run for SAB as explained at the very first link in the Docker FAQ.

Here is my docker run for Deluge:

 

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='binhex-delugevpn' --net='bridge' --privileged=true -e TZ="America/New_York" -e HOST_OS="Unraid" -e 'VPN_ENABLED'='yes' -e 'VPN_USER'=REMOVED' -e 'VPN_PASS'='REMOVED' -e 'VPN_PROV'='pia' -e 'VPN_OPTIONS'='' -e 'STRICT_PORT_FORWARD'='yes' -e 'ENABLE_PRIVOXY'='yes' -e 'LAN_NETWORK'='192.168.1.0/24' -e 'NAME_SERVERS'='209.222.18.222,84.200.69.80,37.235.1.174,1.1.1.1,209.222.18.218,37.235.1.177,84.200.70.40,1.0.0.1' -e 'DELUGE_DAEMON_LOG_LEVEL'='info' -e 'DELUGE_WEB_LOG_LEVEL'='info' -e 'DEBUG'='false' -e 'UMASK'='000' -e 'PUID'='99' -e 'PGID'='100' -e 'ADDITIONAL_PORTS'='7878,8080,8989,8090,9117' -e 'VPN_CLIENT'='wireguard' -p '8112:8112/tcp' -p '58846:58846/tcp' -p '58946:58946/tcp' -p '58946:58946/udp' -p '8118:8118/tcp' -p '7878:7878/tcp' -p '8080:8080/tcp' -p '8989:8989/tcp' -p '9117:9117/tcp' -p '8083:8083/tcp' -v '/mnt/user/Downloads/':'/data':'rw' -v '/mnt/user/appdata/binhex-delugevpn':'/config':'rw' --sysctl="net.ipv4.conf.all.src_valid_mark=1" 'binhex/arch-delugevpn'

d976542d729d15115b01223b4e7ebf0ef2808e27c3166100aff6d157e8667580

The command finished successfully!

And here it is for SAB:
 

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='binhex-sabnzbd' -e TZ="America/New_York" -e HOST_OS="Unraid" -e 'UMASK'='000' -e 'PUID'='99' -e 'PGID'='100' -v '/mnt/user/Downloads/':'/data':'rw' -v '/mnt/user/appdata/binhex-sabnzbd':'/config':'rw' --net=container:binhex-delugevpn 'binhex/arch-sabnzbd'

3705fbd979cd8e0906af3032ed41fa19b3bd1b62b2acd046308f009567b2128e

The command finished successfully!

 

[trurl]

Looks like you have been using Unraid for a while, but are you new to using dockers?

 

57 minutes ago, helpermonkey said:

my docker run

 

And if you go into each of those applications, where do you have them set to download?

[helpermonkey]

4 minutes ago, trurl said:

Looks like you have been using Unraid for a while, but are you new to using dockers?

 

 

And if you go into each of those applications, where do you have them set to download?

i've been using unraid and docker for the same amount of time ... i'm just dangerous enough to be able to screw stuff up. 🙂

 

attached is the SAB config for downloading and the deluge settings - as well as a screenshot of my Downloads/Incomplete share where incomplete files seem to be stored.

[Squid]

What does it show when you hit Container Size on the Docker Tab

[trurl]

15 minutes ago, helpermonkey said:

been using unraid and docker for the same amount of time

You joined the forum years before docker was part of Unraid.

 

That all looks OK, but I don't use those (NZBGet and transmission instead) so I don't know if there are other path settings you aren't showing.

 

1 minute ago, Squid said:

What does it show when you hit Container Size on the Docker Tab

What he said

 

 

 

[helpermonkey]

25 minutes ago, trurl said:

You joined the forum years before docker was part of Unraid.

 

That all looks OK, but I don't use those (NZBGet and transmission instead) so I don't know if there are other path settings you aren't showing.

 

What he said

 

 

 

I'm pretty sure i signed up well before i started actually using unraid - it's entirely possible that i've been using one longer than the other but to the best of my memory i didn't actually start playing with this until docker was incorporated. Then again, I can forget my own cell phone while i'm holding it so i wouldn't be surprised if that wasn't the case. the only other path settings that take place inside sab are on the categories page - which i've included a screenshot of now.

 

27 minutes ago, Squid said:

What does it show when you hit Container Size on the Docker Tab

Here ya go:

 

FWIW i do have approximately 30 orphaned images listed in the advanced view - i've seen them before through the years but since it doesn't tell you waht they are specifically i have always just left them alone.

 

Here's another screenshot that shows my shares and their sizes ....

 

Edited April 7, 2021 by helpermonkey

[trurl]

17 hours ago, helpermonkey said:

FWIW i do have approximately 30 orphaned images listed in the advanced view - i've seen them before through the years but since it doesn't tell you waht they are specifically i have always just left them alone.

Remove them. Never any point in keeping them and they are taking up space.

[helpermonkey]

Just now, trurl said:

Remove them. Never any point in keeping them and they are taking up space.

will do - good to know. If you need any other information to perhaps get an idea of what's going on - please let me know. I'm happy to provide you with whatever information I can and I appreciate your help to this point.

[trurl]

Post new diagnostics after you remove the orphans.

[helpermonkey]

1 minute ago, trurl said:

Post new diagnostics after you remove the orphans.

here ya go.

buddha-diagnostics-20210408-1133.zip

[trurl]

Docker only 52% now as you should be able to see on Dashboard.

[helpermonkey]

2 minutes ago, trurl said:

Docker only 52% now as you should be able to see on Dashboard.

yup - i'm guessing that removing those fixed the problem. Thanks much.

[helpermonkey]

@trurlhey there - decided to resurrect this thread as the utilization issue has returned. Attached is a current diagnostic and i've noticed that 16 orphaned dockers exist now. Didn't want to make any changes or try to fix anything until i got people like you a chance to look at things. Any ideas what's going on here?

buddha-diagnostics-20210417-1225.zip

[trurl]

Post a screenshot of the Advanced View of the Docker page.

[helpermonkey]

1 hour ago, trurl said:

Post a screenshot of the Advanced View of the Docker page.

Here ya go

[Squid]

Delete all the orphan images by clicking on them

[helpermonkey]

2 minutes ago, Squid said:

Delete all the orphan images by clicking on them

roger - that's what i did last time this was a problem - what exactly are orphan images and how do i keep them from sticking around?

[Squid]

They are the images that are created when the docker run command produces an error (ie: you had an error in the template and the app couldn't run)

[helpermonkey]

4 minutes ago, Squid said:

They are the images that are created when the docker run command produces an error (ie: you had an error in the template and the app couldn't run)

roger - so should i just check in on the advanced view from time to time? I am guessing these errors aren't big deals?