i noticed my cache drive is staying full.. of 1TB

i run mover it runs and knocks off like 100gb or 2.. but then stops i have to restart it to keep moving

is there a log file for mover why its shutting down early? there is nothing in the system logs under error or warning

Edited August 3Aug 3 by comet424

i ended up just moving things with mc

but if there is no logs i guess just a glitch i guess

There is an option under Settings->Scheduler->Mover options to enable mover logging (entries get written to the syslog). It can be very verbose so only leave it enabled if you are actively investigating a mover problem.

It might be worth posting your system's diagnostics zip file so we can check your settings to see if we can spot anything that might cause this.

14 hours ago, comet424 said:

i noticed my cache drive is staying full.. of 1TB

i run mover it runs and knocks off like 100gb or 2.. but then stops i have to restart it to keep moving

is there a log file for mover why its shutting down early? there is nothing in the system logs under error or warning

Either you are hitting a free space roadblock with a too restrictive share split level or the files are in use.

@itimpi oh ok..

so here is the logs i 99% sure i hadnt rebooted.. dunno if you see anything..

@MowMdown i not sure what my levels are but i shouldnt ran out of disk space and i had stopped dock.. but shouldnt been files in use

is there any program plug in or application that tells you what files are being access'ed copied etc.. ive run that htop top commands and the dashboard page where it says shares and the streams have numbers i guess they being accessed

but i wonder if there is a program that tells me what file is being copied or accessed.. . as a server you think you could see what files be in access mode etc... i dunno if stuff like that is possible or not just asking as i always wondered

tardis-diagnostics-20260804-1711.zip

Try the "open files v2" plugin. It might be what you might be looking for. I will say though this plugin might currently not work under certain conditions due to a missing kernel parameter that has not been activated.

Also the File Activity V2 plugin.

Edited August 5Aug 5 by MowMdown

I see a bunch of "Mover Finished" logs which means mover is working correctly, which means you likely have files that are open for read. Mover cant move these until theyre no longer accessed by whatever process is accessing them.

@MowMdown ok ya id had ran it manually the mover so probably showed i did it a few times during the day

and i think i already had the file activity plugin but maybe not v2 ill check and install that other one..

i appreciate it

I would suggest tuning your ingest flow on how much new data is being written to the cache pool vs the array. Otherwise the only other solution is getting more pool storage.

It would be one thing if those files are like weeks/months old and not being moved but I have no way of knowing.

One other suggestion is writing a user script and executing it hourly a simple mover start in the script would be all you need.

I did not see a Minimum Free Space set for any pool. You should set this for any pool that will be used for caching purposes as it sets the level at which when it drops below this new files should start bypassing being cached. Typically you want it set to something like twice the size of the largest file to be cached.

@MowMdown ok ya id had ran it manually the mover so probably showed i did it a few times during the day

and i think i already had the file activity plugin but maybe not v2 ill check and install that other one..

i appreciate it

@itimpi ah ok i didnt know you can set a mini size for cache pool.. just the folders

and i set them all to 100gb i know i have files bigger then 100gb but to maximize disk space setting it to 100gb was good.. as that double is not good as my vms are 100gb so then if i set the array to 200 then thats 200gb wasted space on each drive... it should just move to the next drive that has appropiate disk space

and i find also if you default a share it will default to like 1.7tb which if thats the minum nothng ever gets written to that drive or you cant fill up a drive when 1.7tb is left.. so i always been just setting it to 100gb to get the full space out of these drives

least thats how i viewed things

@MowMdown as for tuning the ingetst dunno how you do that... but every night i do a daily backup that backs up to the Backup Files folder

which is on the array and cache pool

so my 1Tb of vms or so and the app data backup from the nvme drive to the cache pool i guess and then array

but maybe i need to change it some how as i dont copy alot to the array just the nightly backups

as it just came to me maybe i doing the backups wrong?

so i set my Backup Files share to just Array not cache drive..

but its not what i wanted either

maybe can help

so i found backing up my 100gb home assistant vm took 30 min or so not 3 or 4 min to copy from nvme to Sata SSD thats the cache drive.. i wonder if at the time its backing up mover is running same time? as i find it copys god awful slowly i should be getting like 500mbs and i find when i copy the 100gb file i get like 32mb or or less a second...

so i not sure 100% how to make it fast and not clash mover and vm and appdata backups

or is it possible to get mover to move twice? so mover moves regular files at a certain time like midnight

but then appdata and VMS backup to the cache drive.. but as soon its done mover activates and moves to the array to keep things fast...even though i experiencing piss poor slow speed

and even if i set min to 100gb space and even if i say i have a 500gb file i still want it set to 100gb so it only leaves 100gb on each drive and then moves to the next drive if it has 500gb to handle file ok copy if no move to the next file but still a min of 100gb left on each drive to maximize drives and just keep filling the next drive till there is 100gb free.. and thats how i though i have things working

and do you guys know why copying 100gb from nvme to the sata ssd i get fluxuations from 9mbs.s to like 200mb/s it doesn stay at a constant 500 600 mb/s

is it if the ssd is on a sata port or if its on the hba card... is there a way to boost it to 500... as its 1 single file yet slow copying from nvme to sata.. i watching it by doing

rsync --progress * /mnt/cache_drive/Backup\ Files

its averaging around 25-39mb/s i just copying my homeassistant vm 100gb and its turned off .. so i should be zipping copying or is only cache drives fast when its from another computer on the network copying to unraid

not unraid nvme to cache drive..

Edited August 7Aug 7 by comet424