syrys

Hey All, Ive been using unraid with docker apps for years (im still a noob though). Recently (since about few weeks ago) ive been noticing that my docker disk utilization is slowly going up (im not installing anything, and all the apps are set to write to a different drive, as mentioned, ive been using this without much issues for years). Aaanyway, ive been getting warning emails saying "Docker image disk utilization X%" where X is now at about 85, and growing a slowly (1-2% every day). So, between July 9th and July 21st, it went from <70% to 95%, then i deleted lot of apps that i dont use very much to get it down well below 70%. Then between August 17th to today (25th) it went from 70% to 85%. This means clearly one of the dockers are doing something strange (something it shouldnt), and possibly writing logs to the docker image or something. So, my question is, how on earth do i find out who the culprit is so i can look further into dealing with it and/or coming up with a solution? FYI, here is a list of 8 apps im actually running: plex: linuxserver/plex radarr: linuxserver/radarr sabnzbd: linuxserver/sabnzbd Sonarr: linuxserver/sonarr deluge: linuxserver/deluge DuckDNS: coppit/duckdns jackett-public: dreamcat4/jackett cadvisor: google/cadvisor My current allocated space for docker is 20gb. Any help appreciated :)

Sweet, i was actually doing just that right after i posted. When i goto add and select the template, it gets populated with all the existing data. So yup, that solved the problem... i think. All is working for now. i think... Thanks heaps for the advice

Ah i see, that sucks. Yeah i just removed Advanced Buttons. I just saw the thread discussing this and made a quick post asking if there is any solution: So, essentially i have to start from scratch with the dockers that i lost? If anyone has any ideas of getting them up and running again, let me know.

I had Advanced Buttons installed and tried to updated couple of dockers, and these dockers have disappeared from the docker menu/list (this issue was covered in the first page of this thread). I have since uninstalled Advanced Buttons. But, is there any way to get those dockers up and running again, or are they good as gone?

Also note, my other dockers are running just fine, its only when i update them that they disappear. Im using a plugin to update dockers (Advanced Buttons, just adds extra buttons), and i saw a glance of "No such file or directory" error at the end of the update, here is some of my logs from the last 30 mins or so. I think its that "The command failed" line, what is that all about? Feb 13 16:41:08 karie kernel: docker0: port 5(vethbf54628) entered disabled state Feb 13 16:41:08 karie kernel: device vethbf54628 left promiscuous mode Feb 13 16:41:08 karie kernel: docker0: port 5(vethbf54628) entered disabled state Feb 13 16:41:08 karie avahi-daemon[8096]: Withdrawing address record for fe80::e7:21ff:fec9:d396 on vethbf54628. Feb 13 16:41:09 karie [11757]: The command failed. Error: sh: /usr/local/emhttp/usr/bin/docker: No such file or directory<br> Feb 13 16:52:23 karie emhttpd: req (1): cmd=/webGui/scripts/share_size&arg1=appdata&arg2=ssz1&csrf_token=**************** Feb 13 16:52:23 karie emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/share_size appdata ssz1 Feb 13 16:52:28 karie emhttpd: req (2): cmd=/webGui/scripts/share_size&arg1=Docker&arg2=ssz1&csrf_token=**************** Feb 13 16:52:28 karie emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/share_size Docker ssz1 Feb 13 16:59:23 karie [13986]: The command failed. Error: sh: /usr/local/emhttp/usr/bin/docker: No such file or directory<br> Feb 13 17:00:02 karie root: move: file /mnt/disk5/system/libvirt/libvirt.img Feb 13 17:00:02 karie root: move_object: /mnt/disk5/system/libvirt/libvirt.img File exists Feb 13 17:00:02 karie root: move_object: /mnt/disk5/system/libvirt: Directory not empty Feb 13 17:00:02 karie root: move_object: /mnt/disk5/system: Directory not empty

I just did an update on my SABnzbd docker on unraid, and the docker disappeared from my dockers list (i also did the Radarr docker update as well, and that also disappeared). Can anyone give me any advice on this so i can debug? So essentially just 15 mins ago, i clicked the docker to update on SABnzbd. Once the update is finished, the docker no longer is on my dockers list (online or offline). I was going to post in the docker support for linuxserver SABnzbd page, but to make sure its the docker issue, i did an update for Radarr docker as well, and that also disappeared, wtf. I dont know what to do now I also did a server restart too, no change. Also to clarify, these dockers arnt running, the urls i use to access Radarr and SABnzbd are not responding. Unraid 6.4.1.

Hey, thanks so much for the advice. I tried plex addon on kodi, and all works perfectly fine. when i messed around with direct play on plex app, it was hit and miss. with kodi, so far, 100% success (and is perfect). I will bring my queries to the plex forums. Only downside with kodi is the UI is not as good (and i dont see any options like automatic subtitles for things like anime). But maybe ill get used to it, who knows. Thanks again

I have plexpy docker installed (never really used it much), but i have it disabled atm. Ive disabled almost ever docker thats not 100% necessary to get the max performance. But, i use a unraid plugin called "Dynamix System Statistics" (i think) to see the server stats (shows me cpu/network/ram/hdd activity). Alright, ill try out Kodi. I didnt realise kodi had a plex plugin (that sounds strange haha). I did install Kodi just earlier on the shield, but got stuck on some stupid thing, where as soon as you launch the app, it just says "waiting for external storage" and nothing happens (cant do anything besides closing the app). Ill look into that further. As for transcoding, i may be using that work incorrectly. Im just trying to get my 4k content from my plex server playing on my plex client on the shield. Honestly, i have no idea if the server is transcoding/converting this or sending it direct (direct play?). Is there any way i can tell if its being transcoded? As for 10bit, is there a way i can tell if my content is 10bit? Also, i can play some 4k content just fine. Its really weird. So i have some shows, where every episode (4k) works just fine. And i have other shows where none of the episodes (4k) play properly (well, it freezes time to time and says server isnt powerful enough). It seems like there is a connection to certain shows.

Sorry, im really not sure where this thread should be posted, but i will post here for now and hopefully someone can link me to somewhere more suitable if this is not appropriate. ---------------------------------------- I have been using unraid for couple of years now. I use a linuxserver.io docker for plex. I play plex on a Nvidia Shield (Android TV device). My plex server is running a i7 4770 with 16gb ram. So, since recently, my plex client keeps pausing videos, failing to smoothly playback most of my recent 4k videos. Anything from movies or tv shows. Plex has a popup saying my server is not powerful enough to playback the video. Is that really true? an i7 4770 is not powerful enough to transcode 4k videos? I use plugin on unraid to monitor server stats, and most of the time when its skipping, the server CPU usage is nowhere near 100%, sometimes barely hitting 30+%. So, what on earth is going on? Can anyone shead some light on this, and maybe point me in the right direction? Im not sure if the cause is the plex docker/server, plex client (unlikely, i've tried multiple clients), unraid (somehow not allowing full cpu access to the docker?), 4770 really isnt powerful enough (if so, what is?), something to do with media type (some specific encoding?), or something else entirely? TY in advance.

Yeah i did, but to do so, you had to turn off docker. I simply just followed squid's instructions: For those that know about docker, is there really no way for one to browse into a docker containers file system and inspect/delete a file? Say you want to locate and delete a log fine manually, and you are sure its just being saved inside the docker, is there really no way to browse into the docker's file system and try locate and remove said file(s)? This would solve most of our problems (although hackey, its still a viable solution).

Haha i dont mind. Maybe suggestions you get might help me with my issue too (fingers crossed)

This is my output: > du -h -d 1 /var/lib/docker/ 0 /var/lib/docker/tmp 9.6G /var/lib/docker/containers 22G /var/lib/docker/btrfs 12M /var/lib/docker/image 68K /var/lib/docker/volumes 0 /var/lib/docker/trust 84K /var/lib/docker/network 2.4M /var/lib/docker/unraid 0 /var/lib/docker/swarm 32G /var/lib/docker/ Not really sure what this is actually telling me though

Tried this, but the numbers of this doesnt add up at all. The size column adds upto maybe 3GB at max (3gb virtual, <500mb normal). But my docker usage is well over 18gb. So yeah... CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES SIZE d43779fb64f6 linuxserver/plex "/init" 10 days ago Up 8 days plex 307.9 kB (virtual 432.1 MB) d6dca3fe11f5 linuxserver/sonarr "/init" 3 weeks ago Up 8 days 0.0.0.0:8989->8989/tcp Sonarr 137.1 MB (virtual 643.4 MB) eed3a5e07642 linuxserver/radarr "/init" 6 weeks ago Up 8 days 0.0.0.0:7878->7878/tcp radarr 27.62 MB (virtual 535.3 MB) 2731688ca5f1 linuxserver/sabnzbd "/init" 6 weeks ago Up 8 days 0.0.0.0:8080->8080/tcp, 0.0.0.0:9090->9090/tcp sabnzbd 339.6 kB (virtual 271.3 MB) 61c0ac7c92c6 linuxserver/deluge "/init" 9 weeks ago Up 8 days deluge 589.8 kB (virtual 172.3 MB) 0cbc1ab01f86 google/cadvisor:latest "/usr/bin/cadvisor -l" 3 months ago Up 8 days 0.0.0.0:8081->8080/tcp cadvisor 0 B (virtual 57.32 MB) cd9f8971ca71 dreamcat4/jackett "/init" 10 months ago Up 8 days 0.0.0.0:9117-9118->9117-9118/tcp jackett-public 18.92 MB (virtual 355.4 MB) e010e90c85bd linuxserver/plexpy "/init" 11 months ago Up 8 days 0.0.0.0:8181->8181/tcp plexpy 128.1 MB (virtual 243 MB) 2386dbb08d28 coppit/duckdns "/bin/sh -c /root/duc" 11 months ago Up 8 days DuckDNS 144 B (virtual 237.6 MB) b6471e1de692 linuxserver/htpcmanager "/init" 11 months ago Up 8 days 0.0.0.0:8085->8085/tcp htpcmanager 31.39 MB (virtual 148.7 MB)

Unfortunately i still havent found a solution for this original issue. Im glad that you atleast have a good idea what app is causing your issue. In my case, i have no idea still (and i dont have a clone system to test it out) For starters, it would be super helpful if there was a way to find out the actual HDD usage of every docker running on the system (so we can nail down the culprit). And once we nail down the culprit, atleast you can dive into try solve the problem or go complain to the docker developer about the issue. Ah well, for the time being, im just increasing the docker space allocation. I hope the usage increase is slower than the consumer SSD size improvements haha

Hey guys, Im having the exact same issue: I was also using resilio sync docker (although i have not done anything since actually installing it, so not connected to anything). But deleting said docker did not improve my space usage, it freed up couple of hundred MB. Any other suggestions as to how i can debug and find the culprit? I have double and tripple checked every docker and all the download directories etc.

Can anyone help me with this? My docker image is now at 85% I have not installed or done any changes since my earlier post. The links from Squid does not work for me, so i cannot check the issue he is refferings to. Since the last post, i have done few things to debug but with no luck. Using ssh, I tried getting a list of docker containers using docker ps -a Then exported every single docker container one by one into tars using: docker export container_name > container_name.tar #for example docker export plex > plex.tar Looked at the file sizes for the resulting tars, and they barely add upto 3-4gb as expected. But my docker image is 20gb and its hitting 85% usage which is 17gb. What on earth is going on? Is there really no way to accurately look at the size of each container?

first of all, your second link didnt work for me (your first link worked once but not anymore, wtf) maybe server/forum issues? ill try again tomorrow. Anyway, as for telling where my download clients download to (temp/incompletes/completes), ive double/triple checked in settings, both on the settings of the docker as well as settings within the app it self (for example, the SAB UI), and on both SAB and deluge. Both SAB and deluge seems to be configured correctly (im eyeballing here, but all seems correct to me, im using "/" correctly, case sensitive etc). Only outlier i saw was that, sab has the log and admin folders linking within the docker image, and i have no way to check if those directories are the culprit? That being said, if there was a way i could actually have access to the file structure on docker.img, then i could run something like windirstat to get a idea of what directories are using up the space and i can investigate. Any idea how i could do this? Secondly, its possible that the plex transcorder is one of the culprits. there was a post couple of replies below on the first link that addresses that. but i highly doubt that, since i dont see the space fluctuating massively in a short amount of time. and even if that was the case, remapping the transcode directory wouldn't help clear out what ever it was that is currently clogging up the image. =/ any more thoughts?

Thanks for the instructions on expanding, if i dint get a solution for the size issue, i will do this As for sab, deluge, and sync... sync isnt connected to anything at all right now, so it shouldnt actually use up anything. So, on my setup/filesystem, i have a /mnt/user/Docker/AppData/ which contains all the app data for most of the dockers. this folder is like 250+gb thanks to plex app data dir taking up ~250gb (wtf right? this is an issue i had earlier when i had plex server installed on windows too, so its an unrelated issue). Note, this is not the plex media directory, its just the config/cache directory. Then i have a unassigned devices mapped as /mnt/disks/mydrive1/ which contains multiple download directories which are mapped to sab and deluge as download directories. I really cant find anything else in settings that are not either mapped to /mnt/disks/mydrive1/* or Docker/AppData/* note: my docker image is located at /mnt/user/Docker/Docker/docker.img Is there any easy way for me to look inside docker.img to see whats using up all the space?

Hey Guys, So, recently, i have been getting notifications about my docker image/disk getting full (hitting about 81% now). I havent installed anything new for like the last 6 months (besides the auto updates), and the disk utilization is slowly increasing (ie. few weeks ago, it was at 75%). When i first created, i allocated 20gb to my docker disk/image. Currently its using up about 17gb/20gb. If this is normal, i have plenty more hdd space, if someone can tell me how i can expand my allocated 20gb to maybe 30 or 40gb, that would solve the problem for a little while. But in the meantime, i want to know what is going on and why its using up 17gb, and still increasing? Anyway, i just installed the cadvisor docker to see if it gives me any information, and i see this on the docker page of cadvisor, Images Repository Tags ID Virtual Size Creation Time linuxserver/sonarr latest sha256:6aa3c326ea81898a9 328.76 MiB 1/21/2017, 12:33:42 PM linuxserver/sabnzbd latest sha256:183cd9b9813960b1d 257.16 MiB 1/14/2017, 12:41:12 PM linuxserver/plexpy latest sha256:d6dbfe6c4a38f4863 109.64 MiB 10/1/2016, 11:23:52 AM linuxserver/plex latest sha256:699f00c8a8c23307e 404.95 MiB 5/6/2017, 10:44:05 AM linuxserver/htpcmanager latest sha256:879c6373ef5b14f1d 111.90 MiB 10/1/2016, 11:23:30 AM linuxserver/deluge latest sha256:0dd36542df4e3fc7d 157.01 MiB 1/14/2017, 11:38:21 AM linuxserver/couchpotato latest sha256:1416f816197775c9b 111.50 MiB 1/14/2017, 12:33:44 PM limetech/sync latest sha256:54597b6c03906d4f5 300.71 MiB 7/3/2016, 3:37:30 AM google/cadvisor latest sha256:f9ba08bafdeaf8158 54.66 MiB 3/10/2017, 12:30:29 PM dreamcat4/jackett latest sha256:80df299519f91d03e 320.86 MiB 10/11/2016, 4:03:57 PM coppit/duckdns latest sha256:3a52d808122f4b0a4 226.63 MiB 9/2/2015, 3:52:50 PM and as you can see, those sizes doesnt add upto anywhere near the 17gb. Can someone help me debug this further? ps. im on the latest version of unraid, and everything set to auto update.

alright, i can confirm the issue. when i simply click "move now" on the bottom of the main page of the unraid UI (when there are some media on the cache drive to move), my dockers (plex, cp, sonarr) instantly become unresponsive or atleast insanely laggy/slow.

yup, i would assume it the disabling of caching that is the true solution here. but thats not really a solution really. my downloads are all going to a separate unassigned drive (not part of the array), and i still have the issue, so its not related to that part of your solution (although my plex/sonarr/cp dockers are installed in the cache). So, what im suspecting is the mover, when the mover is running, the drives/array bandwidths gets saturated, causing everything to freeze. by disabling caching, mover will trigger less frequently or rather will complete quickly, thus not noticing any issues. Although limiting mover or disabling caching will solve the symptoms, it doesnt actually address the actual issue. maybe the mover needs to be run in sort of low priority mode, or limit the movers moving speeds, if thats even possible. Can a lime tech developer/admin address this issue please? Or atleast look into if what we are saying is correct? Cheers.

please let me know if you ever figure out what it is or how to solve it. i still have the issue, it was happening like 5 minutes ago grr One thing i noticed was that most of the time when this was happening, i noticed that the mover is running. Although, i cant be certain of that, as the UI is frozen obviously. So maybe you are on the right track, maybe it has something to do with sonarr/cp extracting and trying to copy big media files into the cache, or maybe the mover using up all the hdd bandwidth of the cache/array. This is really frustrating, i dont know what to do anymore =/

Can someone clarify/help how to find these duplicate keys and how to go about deleting them? I had a look at the server, at "/boot/config", i see to files with ".key" extension. They were, Trial.key and Plus.key. Is this the right location i should be looking at? Should i be deleting/renaming the "Trial.key" file? Cheers.

Ah I see. I upgraded from trial too. This is silly. Does unraid developers want people's flash drives to be blacklisted? I hope someone sees this and fixes it. If it wasn't for fix common problems plugin, I wouldn't have even know. How was I suppose to know how many key files are there, or where they are even located? Sigh... Sent from my Nexus 6P using Tapatalk

"Fix common problems" plugin started throwing out this warning a little while ago. I have a unraid with unraid plus license (12 drive one). My unraid installation was originally with 6.1.x (about a year back) and has been auto updating since (6.2.4 at the moment). Unsure if this is an actual issue, and how to go about fixing it? Why would this have happened anyway (if its actually an issue).