Server almost unusable due to full cache drive

[majbom]

Hi.

Apparently I have something installed or setup so my cache drive is filled to the limit; 0 bytes left 😞

Now I'm not able to start the Docker service and my VMs seems gone 😢

I have tried to move all shares away from the cache drive, but it doesn't help. I would've liked to run QDirStats (to help me solve what is going on and clean up), but as my Docker service is down, that's not possible.

 

Where do I go from here?

Please tell me what info you need to give a hint.

 

Thanks

[trurl]

attach diagnostics to your NEXT post in this thread

[majbom]

Of course, thanks!

tower-diagnostics-20211111-2015.zip

[trurl]

Mover ignores cache-no and cache-only shares, and moves cache-prefer share from array to cache, and cache-yes shares from cache to array. You can toggle Help for the whole webUI from the Help (?) button on the main menu, and toggle help for a specific setting by clicking its label. Take a look at the Use cache setting.

 

Set appdata, domains, system shares to cache-prefer or cache-only, these shares are already all on cache as they should be so cache-only is OK. You want these on cache so dockers/VMs will perform better and not keep array disks spunup.

 

All of your other shares should be cache-no or cache-yes. Any shares that have files on cache (video, www) will have to be set to cache-yes to get them moved to the array.

 

Your docker.img and libvirt.img are corrupt due to full cache.

 

After you get room on cache you will have to recreate your docker.img

 

https://wiki.unraid.net/Manual/Docker_Management#Re-Create_the_Docker_image_file

 

and reinstall your dockers

 

https://wiki.unraid.net/Manual/Docker_Management#Re-Installing_Docker_Applications

 

 

[majbom]

Thanks a lot @trurl !

So my dockers are lost, is that correct understood?

[majbom]

@trurl Can you see anything regarding my VMs? Unraid says "No Virtual Machines installed". Are they corrupt maybe?

[trurl]

23 minutes ago, majbom said:

So my dockers are lost, is that correct understood?

Guess you didn't read the wiki links I gave above.

[majbom]

2 minutes ago, trurl said:

Guess you didn't read the wiki links I gave above.

Yeah, I was a bit to fast there.

 

I have now set the cache settings as you described. That only free'd 45 MB. So when I try to install QDirStat, it fails. I have tried to make the docker image file 10GB instead of 20, but it makes no difference.

[trurl]

Go to User Shares, click Compute All button, wait for the result, post a screenshot

[majbom]

I just tried to delete some of the appdata - that was enough so I'm running QDirStat to see what's piling up.

 

Thanks a lot so far! 🙏

[trurl]

3 minutes ago, majbom said:

delete some of the appdata

Which dockers do you run? Maybe you have some app downloading into appdata instead of some share on the array.

[majbom]

I have these

 

I've just found out that unifi.controller produces a lot of 100MB "WiredTigerLog" files every minute 😲

 

Edited November 11, 2021 by majbom

[trurl]

Don't use that one myself and don't remember anyone else having that trouble. Maybe something with the way you have it configured. You can go directly to the correct support thread for any of your dockers by clicking on its icon and selecting Support.

[majbom]

I have been using that for years and updated it the other day - then it all went south

 

Anyway - I have deleted the WiredTigerLog files and I can start my VMs again. Thanks GOD I appreciate your fast and useful help!

Edited November 11, 2021 by majbom