Docker filling up fast

[Honest Abe]

Hi new here. My docker image file is getting full. I check my container sizes and it seems to be my mineos filling it not sure how to fix the issue 

tower-diagnostics-20230214-2008.zip

[trurl]

I don't use that container. The usual cause of filling docker.img is an application writing to a path that isn't mapped. Other than the mapping for appdata, the only mapped container path is /mnt/data. Is the application writing to a different path?

[Honest Abe]

Thanks. It was and easy fix /mnt/data was mapped wrong. Once I mapped it correctly docker now at 30% and all is good. Thanks again @trurl

[Jwoff11]

I have this exact same issue, but I am not sure how you fixed it exactly? I see my container path is set to mnt/data but I am not sure where I need to change it to? What did you change yours to?? I can post some pictures if that would help, but the ones you have posted are very similar

[trurl]

14 minutes ago, Jwoff11 said:

exact same issue

attach diagnostics to your NEXT post in this thread, and also docker run for that container

[Jwoff11]

I figured out my issue. It was the default value was set to a share not on the server so it was all going to the docker image. As soon as I swapped it to the correct folder share, it uninstalled and reinstalled then the docker image cleared instantly. Hope this helps someone.

[Jwoff11]

Posting back here because it's back full again. Not sure why at this point. I attached the stuff you asked for I think

tezorith-diagnostics-20230226-1527.zip

[trurl]

12 minutes ago, Jwoff11 said:

I attached the stuff you asked for I think

One of the things

On 2/22/2023 at 4:36 PM, trurl said:

docker run for that container

 

[trurl]

It's not really full, maybe just full enough to give a warning.

 

Go to Docker page, click Container Size button at bottom, and post results.

[Jwoff11]

It's still MineOS taking up the space but I have no idea why it keeps filling up if I have the data stored on a dedicated cache drive...

[Jwoff11]

Here is this. Dunno if it will help or not.

[Jwoff11]

Also wanted to add this. It's a script from a SpaceInvaderOne video that checks for volumes on the docker image. Right now, the only thing I see is the container itself is filling up. But I am not sure why?

[trurl]

31 minutes ago, Jwoff11 said:

Here is this. Dunno if it will help or not.

More useful would be docker run for that container

[Jwoff11]

Well I tried updated a Port Range, which caused the docker run command to fail and delete the container. Currently at work so I am not sure of the damage, but when I was remotely installing the container back, I realized that the user folder that was inside the mnt folder wasn't on the cache drive I had selected. Once I went back up and was able to select my cache drive, I believe that fixed it, but I am not sure at what cost. I have backups of my world so it should be ok. I'll report back later tonight.

[Jwoff11]

So I got home and the server won't start. It's odd. If I pull a backup from yesterday at 2 am, it runs. But not the files from right before I accidently deleted the container.

I am currently making a new MineOS server to run over night to confirm the docker image does not begin filling up

 

[Jwoff11]

Was able to get it back up and running. If anyone accidently deletes their MineOS UnRAID container, just copy paste over the files from your old server to a new instance and that should work. Feel free to ask me about this if this doesn't make sense.

As far as my docker image goes, I will continue to monitor and report back.

 

[newmember]

I am running into this issue,  any thoughts, anything I should try?



Update
I am updating my Jupypter hub with a 4GB image, which downloads fine and then fails.

Notification pops up

Docker critical image disk utilization: 06-03-2023 15:26

Alert [TOWER] - Docker image disk utilization of 90%
Docker utilization of image file /mnt/user/system/docker/docker.img

 

Docker critical image disk utilization: 06-03-2023 15:27

Alert [TOWER] - Docker image disk utilization of 99%
Docker utilization of image file /mnt/user/system/docker/docker.img

root@Tower:/mnt/user/system/docker# ls -altr
total 20971520
drwxrwxrwx 1 root   root            0 Aug  7  2019 ./
drwxrwxrwx 1 nobody users          48 Dec 18  2020 ../
-rw-rw-rw- 1 nobody users 21474836480 Mar  6 15:57 docker.img

Space

Name                                              Container                Writable                 Log

Backblaze_Personal_Backup                         2.66 GB                  0 B                      32.2 MB
MS-SQL-Server                                     1.47 GB                  89.0 kB                  371 kB
jupyterlab                                        1.41 GB                  153 kB                   68.9 kB
ApacheGuacamole                                   1.31 GB                  182 MB                   8.58 kB
binhex-sabnzbd                                    1.27 GB                  131 MB                   51.3 kB
binhex-sonarr                                     1.17 GB                  40.5 MB                  1.91 MB
binhex-radarr                                     1.03 GB                  158 MB                   480 kB
pihole_1                                          379 MB                   57.1 MB                  11.1 kB
pihole_2                                          346 MB                   23.9 MB                  11.1 kB
Portainer-CE                                      272 MB                   0 B                      61.6 kB
vm_custom_icons                                   33.3 MB                  0 B                      439 B
Total size                                        11.4 GB                  593 MB                   35.2 MB

    
Mapped Folders
/data/mnt/user/appdata/data
/media/mnt/user
/config/mnt/user/appdata/binhex-radarr

/data/mnt/user/Downloads/TVShows/
/config/mnt/user/appdata/binhex-sabnzbd
    
/data/mnt/user/Downloads/TVShows/
/media/mnt/user
/config/mnt/user/appdata/binhex-sonarr

/config/mnt/user/appdata/ApacheGuacamole

/drive_d//mnt/user/
/config/mnt/user/appdata/Backblaze_Personal_Backup
    
/var/opt/mssql/data/mnt/user/appdata/mssql/data/
/var/opt/mssql/log/mnt/user/appdata/mssql/log/
/var/opt/mssql/secrets/mnt/user/appdata/mssql/secrets/

/var/run/docker.sock/var/run/docker.sock
/data/mnt/user/appdata/portainer-ce
    
/opt/app/data/mnt/user/appdata/jupyterlab/notebooks
/appdata/mnt/user/appdata/jupyterlab/config

/unraid_vm_icons/usr/local/emhttp/plugins/dynamix.vm.manager/templates/images
/config/mnt/user/appdata/vm_custom_icons

/etc/pihole//mnt/user/appdata/pihole/pihole1/
/etc/dnsmasq.d//mnt/user/appdata/pihole/dnsmasq.d/

/etc/pihole//mnt/user/appdata/pihole/pihole2/
/etc/dnsmasq.d//mnt/user/appdata/pihole/dnsmasq.d/

Edited March 6, 2023 by newmember

[Jwoff11]

Ok so the docker image is still filling up after a fresh install and correctly mapping the locations. I was able to do a Docker Run like you asked @trurl and I have attached it here. Any chance it's still something I have configured wrong? Any time I update the docker container, it dumps the image. If that helps you at all.

[trurl]

On 2/26/2023 at 5:02 PM, trurl said:

not really full, maybe just full enough to give a warning

Maybe just increase the size of docker.img another 10G

[Squid]

Or switch to using a docker folder instead of image

[Jwoff11]

On 3/8/2023 at 11:05 AM, trurl said:

Maybe just increase the size of docker.img another 10G

wouldn't that still be an issue thou? I mean I guess I could setup a cron job to restart docker to empty the image. Not sure if it's possible to do that or not.....

[Jwoff11]

On 3/8/2023 at 11:36 AM, Squid said:

Or switch to using a docker folder instead of image

I can google this, but if you had a guide or reference material on how to do this it would be greatly appreciated.

[trurl]

On 2/26/2023 at 5:02 PM, trurl said:

It's not really full, maybe just full enough to give a warning.

Does it ever actually fill completely?

On 3/8/2023 at 12:05 PM, trurl said:

Maybe just increase the size of docker.img another 10G

This suggestion was just to give you enough extra space so it doesn't give a warning. Maybe even make it 20G larger. If it really does fill up completely then you need to figure out which application is writing to a path that isn't mapped.

[Jwoff11]

8 hours ago, trurl said:

Does it ever actually fill completely?

This suggestion was just to give you enough extra space so it doesn't give a warning. Maybe even make it 20G larger. If it really does fill up completely then you need to figure out which application is writing to a path that isn't mapped.

It does fill completely and I have to restart or move the data location for the image to empty.