F0R3STLANE Posted March 5 Share Posted March 5 Hello all! I have been using UnRaid for the past 3 weeks, and it has opened my eyes to a whole new world! I have a 2TB NVMe for my cache. This all started a couple of days ago when I was downloading a lot of stuff overnight. My cache drive was filled up using 1 TB of space. NORMALLY the mover would take it all over to the array. Now it's not. How can I figure out what is causing the cache drive to fill up? I did some research before posting here, and I am running on Unraid 6.12.6. I have set my global settings to "permit exclusive shares" to YES. Furthermore, I changed these settings AFTER I noticed my cache was filling up and not being moved. ANY help would be GREATLY appreciated! Attached is a copy of my APPDATA share and the settings.. i just have a feeling It's something in here that is causing it to fill up... Quote Link to comment
trurl Posted March 5 Share Posted March 5 Attach Diagnostics to your NEXT post in this thread. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 1 minute ago, trurl said: Attach Diagnostics to your NEXT post in this thread. Do i attach the whole zip file? Quote Link to comment
itimpi Posted March 5 Share Posted March 5 For mover to do anything you have to have the array as secondary storage and the mover direction set appropriately. Quote Link to comment
itimpi Posted March 5 Share Posted March 5 1 minute ago, F0R3STLANE said: Do i attach the whole zip file? Yes Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 Yes and before i set the global settings to the exclusive option, I had the 2nd storage set to array... it was moving files BUT. Normally it got down to like 10% on cache.. Which was great! Now, even when I have the 2nd storage set to array and click MOVE, it stops and keeps 1TB on the cache.. Attached is the diag. Thank you Itimpi and Trurl!! bigdaddy-diagnostics-20240305-0850.zip Quote Link to comment
itimpi Posted March 5 Share Posted March 5 appdata shareUseCache="only" # Share exists on cache d--a shareUseCache="yes" # Share exists on cache, disk1, disk2, disk3, disk4 domains shareUseCache="no" # Share exists on cache d-------s shareUseCache="yes" # Share exists on disk1 isos shareUseCache="yes" # Share exists on disk1, disk2 n-------d shareUseCache="no" # Share exists on disk1 system shareUseCache="prefer" # Share exists on cache W---------k shareUseCache="no" # Share exists on disk2 You have the ‘system’’ and ‘appdata’ shares set to always be on the cache, so you have to take that into account. In addition the ‘domains’ share had files on the cache but is not set to transfer its contents to the array. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 4 minutes ago, itimpi said: appdata shareUseCache="only" # Share exists on cache d--a shareUseCache="yes" # Share exists on cache, disk1, disk2, disk3, disk4 domains shareUseCache="no" # Share exists on cache d-------s shareUseCache="yes" # Share exists on disk1 isos shareUseCache="yes" # Share exists on disk1, disk2 n-------d shareUseCache="no" # Share exists on disk1 system shareUseCache="prefer" # Share exists on cache W---------k shareUseCache="no" # Share exists on disk2 You have the ‘system’’ and ‘appdata’ shares set to always be on the cache, so you have to take that into account. In addition the ‘domains’ share had files on the cache but is not set to transfer its contents to the array. Yes, i understand this.. But WHY all of a sudden is there so much space taken up by these programs / folders? Like overnight... mover used to get it down to like 10% on the cache.. Now it's at 50%.. And i USED to have it set to have the 2nd storage option set to array on APPDATA so it would move... but when I had it set like that, just recently, it wouldn't move much and kept the cache at 1 tb of used space... ANY ideas of what i can do to get the cache drive storage down?? Thanks!! Quote Link to comment
itimpi Posted March 5 Share Posted March 5 You should probably use the Compute option on the Shares tab to get an idea of what is taking up all the space on the cache. Quote Link to comment
itimpi Posted March 5 Share Posted March 5 You have over 100GB in each of the appdata, domains and system share set to stay on cache. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 Just now, itimpi said: You have over 100GB in each of the appdata, domains and system share set to stay on cache. so that would be 300 GB out of 2TB, which would be ok... i do see on the data share that is 760GB on cache.. what does that mean and why does mover not move it? Thanks for your time man! Greatly appreciated! Quote Link to comment
itimpi Posted March 5 Share Posted March 5 You should activate mover logging and then run mover to see why. Also it look like the cache is 1TB - not 2TB. you also have not set a Minimum Free Space value for the cache to set the condition for starting to bypass the cache for new files. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 ill do that now. Thank you! can i post the logs from mover here? Quote Link to comment
itimpi Posted March 5 Share Posted March 5 Just now, F0R3STLANE said: can i post the logs from mover here? You can - but the mover information is not anonymised. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 1 minute ago, itimpi said: You can - but the mover information is not anonymised. Thanks for the heads-up Where can i find the mover logs after its done? I will copy and paste some of the info here for your review. Thanks! Quote Link to comment
itimpi Posted March 5 Share Posted March 5 14 minutes ago, F0R3STLANE said: Thanks for the heads-up Where can i find the mover logs after its done? I will copy and paste some of the info here for your review. Thanks! The information is added to the system’s syslog. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 27 minutes ago, itimpi said: You should activate mover logging and then run mover to see why. Also it look like the cache is 1TB - not 2TB. you also have not set a Minimum Free Space value for the cache to set the condition for starting to bypass the cache for new files. didnt see the 2nd part of your post here.. The cache is 2tb NVMe drive. What should i set the min free space to be on the cache? i don't know / have any idea what it should be? i want to have good performance for my dockers but i don't want to fill up the cache drive 1000% Quote Link to comment
itimpi Posted March 5 Share Posted March 5 3 minutes ago, F0R3STLANE said: The cache is 2tb NVMe drive. Not according to your diagnostics: /dev/sdl1 932G 209G 723G 23% /mnt/cache There appear to be 2 500GB SSDs configured as raid0. 7 minutes ago, F0R3STLANE said: What should i set the min free space to be on the cache? It depends on your use of the system. It is discussed in this section of the online documentation accessible via the ‘Manual’ link at the bottom of the GUI or the DOCS link at the top of each forum page. The Unraid OS->Manual section in particular covers most features of the current Unraid release. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 Please see the attached screenshots. I have no idea how its showing as 2x 500GB SSDs in a raid0... After mover ran, i got some errors back but i have no idea how to interpret them. It looks like its not moving the items from the DATA folder (which is my downloads from radarr / sonarr). Seems like some got stuck in there and wont move... Any idea? Quote Link to comment
itimpi Posted March 5 Share Posted March 5 Those messages show you appear to have corruption on that drive. @JorgeB tends to be best on ways to fix this. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 i looked into the data file and it looks like under /mnt/user/data/downloads/usenet/complete/radarr it is holding some videos on the cache AND the array. but they are all labeled FAILED... Thanks in advance Jorge Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 Here are some examples of it saying they are being held in cache AND the array, but it says FAILED.. This is the source of the storage on my cache drive, 100%.. Do I just delete the ones that are being held on my cache? Do I delete all the failed ones? Thanks! Quote Link to comment
trurl Posted March 5 Share Posted March 5 1 hour ago, itimpi said: Not according to your diagnostics: /dev/sdl1 932G 209G 723G 23% /mnt/cache There appear to be 2 500GB SSDs configured as raid0. Must be somebody else /dev/nvme0n1p1 1.9T 955G 906G 52% /mnt/cache But, why do you have 100G docker.img? /dev/loop2 100G 9.8G 90G 10% /var/lib/docker Default 20G is often enough, and looks like it would be plenty for you. Quote Link to comment
F0R3STLANE Posted March 5 Author Share Posted March 5 4 minutes ago, trurl said: Must be somebody else /dev/nvme0n1p1 1.9T 955G 906G 52% /mnt/cache But, why do you have 100G docker.img? /dev/loop2 100G 9.8G 90G 10% /var/lib/docker Default 20G is often enough, and looks like it would be plenty for you. i frogot to change that back... doing that now Quote Link to comment
trurl Posted March 5 Share Posted March 5 54 minutes ago, F0R3STLANE said: Those messages indicate you should do memtest immediately. You shouldn't even attempt to run any computer unless memory is working perfectly. Everything goes through RAM, The OS and other executable code, your data, everything. The CPU can't do anything with anything until it is loaded into RAM. You may have to reformat cache after you get memory taken care of. This corruption might also be a reason mover can't work since it has to be able to delete files from cache after copying to the array. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.