Freender

In my use case I have a share called /mnt/disk1/backup and under this share I have a dir called nas-docker. This dir is huge it has 30+ levels of depth and a lot of files. I noticed 2 issues: 1) Use Adaptive depth: Adaptive. With default settings this would run 2 find commands (one that uses 'User defined options' and another one that counts files) back 2 back 30 times. Each run would be super slow. When I changed "Use Adaptive depth" to "Fixed" with Maximum level depth = 24, this reduced functions calls to just 2 finds per run. 2) Then I exclude nas-docker from /mnt/disk1/backup by adding the following arg: -a '-name pictures -prune -o -name nas-docker -prune -o -print'as per instructions from the plugin descriptions: Its possible to tell cache_dirs to avoid traversing all directories with a certain name. The following example avoids '.Recycle.Bin' and 'temp' and 'log' folders: -a '-noleaf -name .Recycle.Bin -prune -o -name log -prune -o -name temp -prune -o -print' This would speed up the first find, however the second one would be running for a long time (It would travers all dirs because filtering arguments are not passed to the second find command) Logs This is the log when the original script with default settings without any User defined options reaches depth level 7: cache_dirs version 2.2.9 Setting Memory ulimit to 50000 Setting cache_pressure=10 Arguments=-i backup -i cottonwood -i media -i trigkey -c 4 -l on Max Scan Secs=10, Min Scan Secs=1 Scan Type=adaptive Min Scan Depth=4 Max Scan Depth=none Use Command='find -noleaf' ---------- Caching Directories --------------- backup cottonwood media trigkey ---------------------------------------------- Setting Included dirs: backup,cottonwood,media,trigkey Setting Excluded dirs: min_disk_idle_before_restarting_scan_sec=60 scan_timeout_sec_idle=150 scan_timeout_sec_busy=30 scan_timeout_sec_stable=30 frequency_of_full_depth_scan_sec=604800 cache_dirs started 2025.07.14 12:00:54 Executed find in (0s) 00.24s, wavg=00.24s Idle____________ depth 4 slept 0s Disks idle before/after scan 9998s/9998s Scan completed/timedOut counter cnt=0/1/0 mode=2 scan_tmo=30s maxCur=9999 maxWeek=9999 isMaxDepthComputed=0 CPU= 8%, filecount[4]=27939 2025.07.14 12:00:55 Executed find in (0s) 00.61s, wavg=00.49s Idle____________ depth 5 slept 1s Disks idle before/after scan 9998s/9998s Scan completed/timedOut counter cnt=0/1/0 mode=1 scan_tmo=150 s maxCur=9999 maxWeek=9999 isMaxDepthComputed=0 CPU= 7%, filecount[5]=58493 2025.07.14 12:00:57 Executed find in (21s) 21.35s, wavg=10.92s Idle____________ depth 6 slept 1s Disks idle before/after scan 9998s/9998s Scan completed/timedOut counter cnt=0/1/0 mode=1 scan_tmo=15 0s maxCur=9999 maxWeek=9999 isMaxDepthComputed=0 CPU=16%, filecount[6]=167066 Depth level 6 takes 21 seconds and level 7 was running for 3.5 minutes until I cancelled the test:

@silverkin good suggestion, I also tested locally for a couple of days, works great. @Alex R. Berg I have create a pull request here: GitHubAdd support for passing user-defined options to file coun...Ability to pass 'User defined options' to file counting Merge request for the fix suggested here: https://forums.unraid.net/topic/4351-cache_dirs-an-attempt-to-keep-directory-entries-in-ram...

The "Synchronize Primary files to Secondary" works as intended. However it shouldn't be used in automated setups like Radarr or Sonarr. For example, when Radarr upgrades a movie's quality, it can result in duplicate files - especially if the filenames include quality tags or if different file extensions are used (e.g. current movie is in .mp4 and upgraded version is in .mkv). Another issue arises when the same files exist on both the cache and the array: if you perform a bulk rename in Radarr, only the files on the cache will be renamed, leaving the original copies on the array untouched. This also leads to duplication and inconsistent file organization.

Synchronize Primary files to Secondary The concept of this option is great, however there is one corner case which prevents me from using it 1) Download a movie in WEB-DL format. 2) Run mover to sync file from cache to array 3) Upgrade movie quality to let's say Bluray 4) Run mover to sync file from cache to array Actual Result: on array we would have 2 files - one movie in WEB-DL and another in Bluray. This happens because deleting file from /mnt/user doesn't delete a file from /mnt/user0

Hi @Reynald, thanks for your work! I noticed the following errors in the logs: Aug 21 13:20:29 NAS move: Deleting empty dir /mnt/cache/backup/docker/ab_20240816_040001 Aug 21 13:20:29 NAS move: 0 files remaining from caches to array 0B Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 1050: [: : integer expression expected Aug 21 13:20:29 NAS move: ------------------------------------------------------------------- Cleaning up ----------------------------------------------------------------- Aug 21 13:20:29 NAS move: Restoring original turbo write mode Auto (read/modify/write) Aug 21 13:20:29 NAS move: Cleaning lock and stop files Aug 21 13:20:29 NAS kernel: mdcmd (54): set md_write_method auto Aug 21 13:20:29 NAS kernel: Aug 21 13:20:29 NAS move: ****************************************************************** WE ARE DONE ! **************************************************************** # Skip filesize = 0 (hardlinks already handled in a previous loop) if [ "$NBLINKS" -gt 1 ] && [ "$FILESIZE" = 0 ] ; then continue Not sure if it is a data issue or we need to check if $NBLINKS is not null. I can attach Mover_action_2024-08-21T124119.list and Filtered_files_2024-08-21T124119.list if required.

After updating to 2024.08.04.2112 mover crashed at night (the logs were disabled, not sure what happened), my scheduler page was not showing any mover properties as well. In the config /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg I see 2 new empty parameters: movingThreshold= freeingThreshold= changing movingThreshold to 85% resolved an issue movingThreshold="85" freeingThreshold=

Fantastic! I have set the threshold to 0% for all shares (e.g. I like when appdata backups moved to array overnight) and overridden it to 85% for media. According to the logs (test mode), everything should work as expected. Let’s check the test results tonight. One more unrelated question: How is the ‘Synchronize cache files to array’ feature designed to work? It would be great to have all files on the ‘Media’ share synchronized with the array, so if there isn’t enough space available on the cache, the mover could simply delete the file from the cache without needing to write anything to the array (if the file is already in sync).

sent via PM

Yeah, all files in Mover_action_*.list have 'keep' option Case #2 (Auto moving enabled, there are no share overrides) • Pool usage: 84% • Threshold: 80% Actual Result: All files in Mover_action_*.list have the ‘keep’ action. Just in case, I disabled Test Mode - nothing is moved. Expected Result: After running the mover, some files in Mover_action_*.list should have the ‘move’ action. Jul 29 16:32:01 NAS move: ***************************************************************** FILTERING FILES *************************************************************** Jul 29 16:32:01 NAS move: ----------------------------------------------------------- Settings for appdata share ---------------------------------------------------------- Jul 29 16:32:01 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 16:32:01 NAS move: Share Information: Name: appdata - Path: /mnt/cache/appdata - Cache mode: only Jul 29 16:32:01 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:01 NAS move: cache/appdata usage: 277686311760 bytes (258 GiB) Jul 29 16:32:01 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Skipfilelist string: find "/mnt/cache/appdata" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:01 NAS move: ------------------------------------------------------------ Settings for backup share ---------------------------------------------------------- Jul 29 16:32:01 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:01 NAS move: Share Information: Name: backup - Path: /mnt/cache/backup - Cache mode: yes Jul 29 16:32:01 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:01 NAS move: Default threshold: 80 % - backup share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:01 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Skipfilelist string: find "/mnt/cache/backup" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:01 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T163201.list for backup Jul 29 16:32:01 NAS move: ------------------------------------------------------------ Settings for docker share ---------------------------------------------------------- Jul 29 16:32:01 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 16:32:01 NAS move: Share Information: Name: docker - Path: /mnt/cache/docker - Cache mode: only Jul 29 16:32:01 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:01 NAS move: cache/docker usage: 7973245632 bytes (7 GiB) Jul 29 16:32:01 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Skipfilelist string: find "/mnt/cache/docker" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:01 NAS move: ------------------------------------------------------------- Settings for isos share ----------------------------------------------------------- Jul 29 16:32:01 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:01 NAS move: Share Information: Name: isos - Path: /mnt/cache/isos - Cache mode: yes Jul 29 16:32:01 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:01 NAS move: Default threshold: 80 % - isos share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:01 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Skipfilelist string: find "/mnt/cache/isos" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:01 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T163201.list for isos Jul 29 16:32:01 NAS move: ------------------------------------------------------------ Settings for media share ----------------------------------------------------------- Jul 29 16:32:01 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:01 NAS move: Share Information: Name: media - Path: /mnt/cache/media - Cache mode: yes Jul 29 16:32:01 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:01 NAS move: Default threshold: 80 % - media share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:01 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:01 NAS move: Skipfilelist string: find "/mnt/cache/media" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T163201.list for media Jul 29 16:32:04 NAS move: ----------------------------------------------------------- Settings for pictures share --------------------------------------------------------- Jul 29 16:32:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:04 NAS move: Share Information: Name: pictures - Path: /mnt/cache/pictures - Cache mode: yes Jul 29 16:32:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:04 NAS move: Default threshold: 80 % - pictures share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Skipfilelist string: find "/mnt/cache/pictures" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T163201.list for pictures Jul 29 16:32:04 NAS move: ------------------------------------------------------------ Settings for steam share ----------------------------------------------------------- Jul 29 16:32:04 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 16:32:04 NAS move: Share Information: Name: steam - Path: /mnt/cache/steam - Cache mode: only Jul 29 16:32:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:04 NAS move: cache/steam usage: 55265793616 bytes (51 GiB) Jul 29 16:32:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Skipfilelist string: find "/mnt/cache/steam" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: ------------------------------------------------------------ Settings for system share ---------------------------------------------------------- Jul 29 16:32:04 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 16:32:04 NAS move: Share Information: Name: system - Path: /mnt/cache/system - Cache mode: only Jul 29 16:32:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:04 NAS move: cache/system usage: 152768 bytes (149 KiB) Jul 29 16:32:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Skipfilelist string: find "/mnt/cache/system" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: --------------------------------------------------------- Settings for time_machine share ------------------------------------------------------- Jul 29 16:32:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:04 NAS move: Share Information: Name: time_machine - Path: /mnt/cache/time_machine - Cache mode: yes Jul 29 16:32:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:04 NAS move: Default threshold: 80 % - time_machine share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Skipfilelist string: find "/mnt/cache/time_machine" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: ------------------------------------------------------- Settings for time_machine_pc share ------------------------------------------------------ Jul 29 16:32:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 16:32:04 NAS move: Share Information: Name: time_machine_pc - Path: /mnt/cache/time_machine_pc - Cache mode: yes Jul 29 16:32:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3373779198240 bytes (3 TiB) Jul 29 16:32:04 NAS move: Default threshold: 80 % - time_machine_pc share threshold: NA % => Threshold selected: 80 %,s size: 3095077584896 bytes (2 TiB) Jul 29 16:32:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 16:32:04 NAS move: Skipfilelist string: find "/mnt/cache/time_machine_pc" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 16:32:04 NAS move: ---------------------------------------------------------- Settings for zfs_backup share -------------------------------------------------------- Jul 29 16:32:04 NAS move: No shareCachePool entry found in config file, defaulting to cache Jul 29 16:32:04 NAS move: Cache mode: No. Skipping Jul 29 16:32:04 NAS move: ************************************************************ ANALYSING MOVING ACTIONS *********************************************************** Jul 29 16:32:04 NAS move: Deciding the action (move/sync/keep) for each file. There are 1203 files, it can take a while... Jul 29 16:32:06 NAS move: No new files will be moved/synced from cache to array Jul 29 16:32:06 NAS move: No new files will be moved/synced from array to cache Action Log: CACHEPOOLNAME|SHARENAME|SHAREUSECACHE|MODIFICATIONTIME|FILESIZE|POOLSUM|THRESHOLD|NBLINKS|INODE|ACTION|FROM|TO|FILEPATH cache|appdata|only|9999999999|277686311760|277686311760|3095077584896|0|0|keep|/mnt/cache|/mnt/cache|appdata cache|docker|only|9999999999|7973245632|285659557392|3095077584896|0|0|keep|/mnt/cache|/mnt/cache|docker cache|steam|only|9999999999|55265793616|340925351008|3095077584896|0|0|keep|/mnt/cache|/mnt/cache|steam cache|system|only|9999999999|152768|340925503776|3095077584896|0|0|keep|/mnt/cache|/mnt/cache|system cache|pictures|yes|1722283458|396327|340925900103|3095077584896|1|862|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/05/f3/05f365ca-6848-4f61-8d66-651dc1c61b43.mp4 cache|pictures|yes|1722283457|247340|340926147443|3095077584896|1|1000|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/cc/d8/ccd8c0a4-ff17-49f2-8d3f-c0d8ec604e51.mp4 cache|pictures|yes|1722283454|11277940|340937425383|3095077584896|1|1002|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/eb/c6/ebc6e997-c421-455e-a102-044d1eec1af7.mp4 cache|pictures|yes|1722283331|328314|340937753697|3095077584896|1|226|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/cb/9d/cb9dfcad-3931-453c-af93-eef97eb3dff1.mp4 cache|pictures|yes|1722283328|444276|340938197973|3095077584896|1|1426|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/e0/0e/e00efad8-18b6-49a6-acde-932b094f8ffd.mp4 cache|pictures|yes|1722283325|471987|340938669960|3095077584896|1|1260|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/80/b5/80b57dca-7fea-4d4f-ba74-9cb154a15e0b.mp4 cache|pictures|yes|1722283323|847081|340939517041|3095077584896|1|998|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/4c/27/4c272d3e-cef8-4b3d-8ab9-482cd179ad0b.mp4 cache|pictures|yes|1722283319|5452932|340944969973|3095077584896|1|1098|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/4d/f9/4df9f2da-73fa-41e5-a7cb-09a858566934.mp4 cache|pictures|yes|1722283222|169987|340945139960|3095077584896|1|852|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/13/eb/13ebc94e-2058-4079-b69e-9e1ef8fabcb9.mp4 cache|pictures|yes|1722283220|317874|340945457834|3095077584896|1|370|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/0b/78/0b78bb97-8e8a-4300-adbd-34a2e30bfd4e.mp4 cache|pictures|yes|1722283218|965163|340946422997|3095077584896|1|1418|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/8a/25/8a25a257-22ef-45f1-955b-239ad4e473ca.mp4 cache|pictures|yes|1722283215|63614495|341010037492|3095077584896|1|1412|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/86/61/86616870-4569-4444-8e3e-3ba8dcc33a30.mp4 cache|pictures|yes|1722283034|17769864|341027807356|3095077584896|1|850|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/7a/c3/7ac3575f-e331-430e-8253-20641257c074.mp4 cache|pictures|yes|1722282979|29671005|341057478361|3095077584896|1|426|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/22/75/22755539-de27-4f3e-94ed-c4308112e2ec.mp4 cache|pictures|yes|1722282746|748213|341058226574|3095077584896|1|62|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/c7/8d/c78ddcce-4082-4fcc-aa70-6340d477cc37.mp4 cache|pictures|yes|1722282742|719743|341058946317|3095077584896|1|1410|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/a6/9b/a69b3765-36da-4a50-9084-9f5dfd6eb353.mp4 cache|pictures|yes|1722282738|696341|341059642658|3095077584896|1|992|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/9a/f7/9af744de-8973-49d0-b9e7-dbfc1be26974.mp4 cache|pictures|yes|1722282736|1008149|341060650807|3095077584896|1|1408|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/87/00/870092eb-744e-4868-81b4-87e66a759539.mp4 cache|pictures|yes|1722282732|745384|341061396191|3095077584896|1|224|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/64/cb/64cbd6e8-e60f-4a0c-8d2d-df7385784b37.mp4 cache|pictures|yes|1722282729|1532399|341062928590|3095077584896|1|844|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/72/2f/722f77e1-d8d6-492e-b760-99b1a2b1b97d.mp4 cache|pictures|yes|1722282726|564063|341063492653|3095077584896|1|424|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/84/05/8405a84f-9731-48cf-9cf1-887b5a661ace.mp4 cache|pictures|yes|1722282723|332964|341063825617|3095077584896|1|630|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/39/5f/395f4cbd-4307-47c4-96ce-38eeab8d7394.mp4 cache|pictures|yes|1722282717|227759|341064053376|3095077584896|1|628|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/6e/42/6e4287eb-8eaf-4328-9f6e-e069d66135cd.mp4 cache|pictures|yes|1722282716|710732|341064764108|3095077584896|1|1246|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/6b/01/6b01113e-2d6c-42d6-a9ad-ff2959461d75.mp4 cache|pictures|yes|1722282713|239270|341065003378|3095077584896|1|758|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/b9/f1/b9f1442c-1f51-4920-8615-c4e8d107b4ae.mp4 cache|pictures|yes|1722282711|716480|341065719858|3095077584896|1|1244|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/2c/0b/2c0be43b-a718-4312-bbba-281d37e9d57b.mp4 cache|pictures|yes|1722282708|985418|341066705276|3095077584896|1|60|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/f3/e9/f3e9f6d4-829b-4527-a280-805c7f852b07.mp4 cache|pictures|yes|1722282706|499796|341067205072|3095077584896|1|1090|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/3b/39/3b3914a9-6bed-47a7-82dd-30472b34e4e1.mp4 cache|pictures|yes|1722282703|526965|341067732037|3095077584896|1|364|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/30/d0/30d0f58f-a5a4-4cab-901d-f2da02e34d4a.mp4 cache|pictures|yes|1722282701|262976|341067995013|3095077584896|1|842|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/be/08/be0832b6-a144-4eaf-8925-072b02a1f0be.mp4 cache|pictures|yes|1722282698|376841|341068371854|3095077584896|1|362|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/46/35/46355910-534a-41f7-b364-578f1e391cbd.mp4 cache|pictures|yes|1722282690|263129|341068634983|3095077584896|1|978|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/99/4e/994e661a-c258-4038-839e-d2553c827b59.mp4 cache|pictures|yes|1722282669|293243|341068928226|3095077584896|1|972|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/f2/00/f20000ba-1dbf-45fc-ae44-4cca95480c98.mp4 cache|pictures|yes|1722282665|305887|341069234113|3095077584896|1|1088|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/80/0a/800af07a-74bc-4106-b91e-67137a7e477b.mp4 cache|pictures|yes|1722282658|424926|341069659039|3095077584896|1|744|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/41/fd/41fddc1e-b924-40d4-a136-612e245f267e.mp4 cache|pictures|yes|1722282650|413132|341070072171|3095077584896|1|1242|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/0a/05/0a05aedd-6240-4c49-9a9f-6cf61b841985.mp4 cache|pictures|yes|1722282634|750048|341070822219|3095077584896|1|742|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/eb/9b/eb9bd1ae-a280-481a-afae-ddb63bd72492.mp4 cache|pictures|yes|1722282611|555211|341071377430|3095077584896|1|618|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/1a/f9/1af9f462-3ab3-4f72-b629-623373b494bb.mp4 cache|pictures|yes|1722282595|222918|341071600348|3095077584896|1|356|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/de/bf/debf44f6-01f1-40e0-b49e-1d3a2b17569b.mp4 cache|pictures|yes|1722282580|343680|341071944028|3095077584896|1|1236|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/dc/a8/dca875f0-d107-4dd5-9309-974a4c01f396.mp4 cache|pictures|yes|1722282570|536552|341072480580|3095077584896|1|740|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/7a/8f/7a8f46f4-c35e-4bb5-a2fb-d70b5fa0127b.mp4 cache|pictures|yes|1722282559|379264|341072859844|3095077584896|1|20|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/51/29/5129d3f8-e82c-4c6c-abd0-60ecccdf60fb.mp4 cache|pictures|yes|1722282531|673632|341073533476|3095077584896|1|1062|keep|/mnt/cache|/mnt/cache|pictures/encoded-video/239e7fe0-5449-4db9-a2df-b6ffbc90c873/6a/23/6a23f136-b12f-42dd-8b94-bc6a02360a79.mp4 cache|pictures|yes|1722282509|10166262|341083699738|3095077584896|1|54|keep|/mnt/cache|/mnt/cache|pictures/upload/239e7fe0-5449-4db9-a2df-b6ffbc90c873/8d/32/8d32443b-af33-45b7-a460-57930a704c72.MOV ...

@Reynald thanks for your support. 1) Greatly appreciate these 2 settings: Show advanced filters Show advanced options: This makes the plugin cleaner and focuses on the main functions. 2) To make debugging easier I simplified my config (disabled override shares). My current pool usage is 84% and threshold is 85%. Expected Result: I don't expect any files to be moved from cache to array with this config Actual Results: "/tmp/ca.mover.tuning/Filtered_files_2024-07-29T125104.list for media" file has created. Size - 205K -rw-r--r-- 1 root root 205K Jul 29 12:51 Filtered_files_2024-07-29T125104.list Full Log: Jul 29 12:51:04 NAS move: ***************************************************************** FILTERING FILES *************************************************************** Jul 29 12:51:04 NAS move: ----------------------------------------------------------- Settings for appdata share ---------------------------------------------------------- Jul 29 12:51:04 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 12:51:04 NAS move: Share Information: Name: appdata - Path: /mnt/cache/appdata - Cache mode: only Jul 29 12:51:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671008256 bytes (3 TiB) Jul 29 12:51:04 NAS move: cache/appdata usage: 277430949136 bytes (258 GiB) Jul 29 12:51:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Skipfilelist string: find "/mnt/cache/appdata" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:04 NAS move: ------------------------------------------------------------ Settings for backup share ---------------------------------------------------------- Jul 29 12:51:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:04 NAS move: Share Information: Name: backup - Path: /mnt/cache/backup - Cache mode: yes Jul 29 12:51:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671008256 bytes (3 TiB) Jul 29 12:51:04 NAS move: Default threshold: 85 % - backup share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Skipfilelist string: find "/mnt/cache/backup" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:04 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T125104.list for backup Jul 29 12:51:04 NAS move: ------------------------------------------------------------ Settings for docker share ---------------------------------------------------------- Jul 29 12:51:04 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 12:51:04 NAS move: Share Information: Name: docker - Path: /mnt/cache/docker - Cache mode: only Jul 29 12:51:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671008256 bytes (3 TiB) Jul 29 12:51:04 NAS move: cache/docker usage: 7979181760 bytes (7 GiB) Jul 29 12:51:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Skipfilelist string: find "/mnt/cache/docker" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:04 NAS move: ------------------------------------------------------------- Settings for isos share ----------------------------------------------------------- Jul 29 12:51:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:04 NAS move: Share Information: Name: isos - Path: /mnt/cache/isos - Cache mode: yes Jul 29 12:51:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671008256 bytes (3 TiB) Jul 29 12:51:04 NAS move: Default threshold: 85 % - isos share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:04 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:04 NAS move: Skipfilelist string: find "/mnt/cache/isos" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:04 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T125104.list for isos Jul 29 12:51:04 NAS move: ------------------------------------------------------------ Settings for media share ----------------------------------------------------------- Jul 29 12:51:04 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:04 NAS move: Share Information: Name: media - Path: /mnt/cache/media - Cache mode: yes Jul 29 12:51:04 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671008256 bytes (3 TiB) Jul 29 12:51:04 NAS move: Default threshold: 85 % - media share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:05 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:05 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:05 NAS move: Skipfilelist string: find "/mnt/cache/media" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: Updated Filtered filelist: /tmp/ca.mover.tuning/Filtered_files_2024-07-29T125104.list for media Jul 29 12:51:08 NAS move: ----------------------------------------------------------- Settings for pictures share --------------------------------------------------------- Jul 29 12:51:08 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:08 NAS move: Share Information: Name: pictures - Path: /mnt/cache/pictures - Cache mode: yes Jul 29 12:51:08 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671668432 bytes (3 TiB) Jul 29 12:51:08 NAS move: Default threshold: 85 % - pictures share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:08 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Skipfilelist string: find "/mnt/cache/pictures" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: ------------------------------------------------------------ Settings for steam share ----------------------------------------------------------- Jul 29 12:51:08 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 12:51:08 NAS move: Share Information: Name: steam - Path: /mnt/cache/steam - Cache mode: only Jul 29 12:51:08 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671668432 bytes (3 TiB) Jul 29 12:51:08 NAS move: cache/steam usage: 55265793616 bytes (51 GiB) Jul 29 12:51:08 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Skipfilelist string: find "/mnt/cache/steam" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: ------------------------------------------------------------ Settings for system share ---------------------------------------------------------- Jul 29 12:51:08 NAS move: Cache mode: Only. Nothing will be moved. Its usage is taken into account in the calculation of the threshold. Jul 29 12:51:08 NAS move: Share Information: Name: system - Path: /mnt/cache/system - Cache mode: only Jul 29 12:51:08 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671668432 bytes (3 TiB) Jul 29 12:51:08 NAS move: cache/system usage: 152768 bytes (149 KiB) Jul 29 12:51:08 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Skipfilelist string: find "/mnt/cache/system" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: --------------------------------------------------------- Settings for time_machine share ------------------------------------------------------- Jul 29 12:51:08 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:08 NAS move: Share Information: Name: time_machine - Path: /mnt/cache/time_machine - Cache mode: yes Jul 29 12:51:08 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671668432 bytes (3 TiB) Jul 29 12:51:08 NAS move: Default threshold: 85 % - time_machine share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:08 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Skipfilelist string: find "/mnt/cache/time_machine" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: ------------------------------------------------------- Settings for time_machine_pc share ------------------------------------------------------ Jul 29 12:51:08 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 12:51:08 NAS move: Share Information: Name: time_machine_pc - Path: /mnt/cache/time_machine_pc - Cache mode: yes Jul 29 12:51:08 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3372671668432 bytes (3 TiB) Jul 29 12:51:08 NAS move: Default threshold: 85 % - time_machine_pc share threshold: NA % => Threshold selected: 85 %,s size: 3288519933952 bytes (2 TiB) Jul 29 12:51:08 NAS move: Adding Skip Folder List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Adding Skip File List. List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 12:51:08 NAS move: Skipfilelist string: find "/mnt/cache/time_machine_pc" -type f -depth -not -path '/mnt/cache/media/downloads/*' -printf '%T@|%s|%S|%n|%i|%p|\0' | awk -v RS='\0' -v FS='|' -v SPARSENESS=$SPARSENESS -v CACHEPOOLNAME=$CACHEPOOLNAME -v SHARENAME=$SHARENAME -v SHAREUSECACHE=$SHAREUSECACHE -v CACHESIZETHRESH=$CACHESIZETHRESH '{cmd="stat -c%Y \""$6"\""; cmd | getline result; close(cmd); sub(/\n$/, "", result); printf "%s|%s|%s|%d|%d|%d|%s|%d|%d|%s\n", CACHEPOOLNAME, SHARENAME, SHAREUSECACHE, result, CACHESIZETHRESH, $2, $3, $4, $5, $6}' | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') Jul 29 12:51:08 NAS move: ---------------------------------------------------------- Settings for zfs_backup share -------------------------------------------------------- Jul 29 12:51:08 NAS move: No shareCachePool entry found in config file, defaulting to cache Jul 29 12:51:08 NAS move: Cache mode: No. Skipping Jul 29 12:51:08 NAS move: ************************************************************ ANALYSING MOVING ACTIONS *********************************************************** Jul 29 12:51:08 NAS move: Deciding the action (move/sync/keep) for each file. There are 1065 files, it can take a while... Jul 29 12:51:10 NAS move: No new files will be moved/synced from cache to array Jul 29 12:51:10 NAS move: No new files will be moved/synced from array to cache Jul 29 12:51:10 NAS move: ****************************************************************** WE ARE DONE ! ****************************************************************

3) In /boot/config/plugins/ca.mover.tuning/shareOverrideConfig/media.cfg threshold is set: shareThreshold="85" However in https://github.com/R3yn4ld/ca.mover.tuning/blob/master/source/ca.mover.tuning/usr/local/emhttp/plugins/ca.mover.tuning/age_mover threshold is misspelled (shareTreshold instead of shareThreshold) if [ -z $(cfg shareTreshold) ]; then SHAREPCTLIMIT="NA" else SHAREPCTLIMIT=$(cfg shareTreshold) mvlogger "Share threshold: $SHAREPCTLIMIT %" As a result mover fails if a share has an override. Jul 29 00:58:46 NAS move: ---------- Settings override for media: ---------- Jul 29 00:58:46 NAS move: Default threshold: Jul 29 00:58:46 NAS move: Age: Automatic (smart caching) Jul 29 00:58:46 NAS move: No Turbo Mode argument supplied Jul 29 00:58:46 NAS move: Skip file list path: /mnt/user/backup/mover-ignore/mover_ignore.txt Jul 29 00:58:46 NAS move: Skip folder list path: /mnt/cache/media/downloads/* Jul 29 00:58:46 NAS move: No Repair argument provided Jul 29 00:58:46 NAS move: No Sparness argument supplied Jul 29 00:58:46 NAS move: No Synchronize Cache argument provided Jul 29 00:58:46 NAS move: No Test Mode argument supplied Jul 29 00:58:46 NAS move: Cache mode: Yes/Cache->Array. Will smart move old files from Cache to Array. Nothing will be moved from Array to Cache Jul 29 00:58:46 NAS move: Share Information: Name: media - Path: /mnt/cache/media - Cache mode: yes Jul 29 00:58:46 NAS move: Pool Information: Name: cache - pool used: 84 % - size: 3362321969248 bytes (3 TiB) Jul 29 00:58:46 NAS move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 396: 3868846981120 * /100: syntax error: operand expected (error token is "/100") I am going to sleep, and I will check if this helps tomorrow.

1) After a fresh installation (2024.07.29), I am not able to see the Mover settings in Settings > Scheduler. I believe the issue is with the freshly generated /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg. The content inside is written as a single line. After I broke down the lines, it started working. 2) I also suggest setting the “Move Now button follows plug-in filters” option to ‘Yes’ by default.

My use case: 1) I want to avoid running mover during "business hours" as much as possible. Mover is always running at night regardless of threshold for all shares (I care about Age only for /mnt/user/media) 2) For /mnt/user/media share I have an override to move files older than XXX days. 10 minutes before mover starts I run custom script to adjusts XXX days to value which reduces utilization to let's say 70%. Advantages: For all shares except /mnt/user/media mover moves everything at night. Disadvantage: It sometimes move to much staff (sometimes I download 400 GB downloaded on a single day and only a few GB required to bring utilization down to 70%) I like Reynald's approach for auto age, it's more granular, however #2 can only be achieved if we implement threshold per share (now it's global) 3) During the day I am fine with utilization up to 95%. At this point (95%) sabnzbd automatically pauses all downloads (I pointed sabnzbd directly to /mnt/cache/media/downloads to see real cache utilization) to prevent cache overflow. Once this happens I receive an alert and manually run mover. It would be great if we ran it automatically (technically I can run custom script in cron but it's better to implement this out of the box)

Last test results: 1) Updated age_mover based on comment above and restarted mover. #Get the size threshold in bytes if is_zfs_mountpoint_fstype "/mnt/$CACHEPOOLNAME"; then CACHESIZETHRESH=$(( $(zfs list -Hp -o available,used $CACHEPOOLNAME | awk '{print $1 + $2}') * $DEFAULTTHRESHOLD /100)) #CACHESIZETHRESH=$(( $(zpool list -p -o size $CACHEPOOLNAME | tail -n 1) * $DEFAULTTHRESHOLD /100 )) 2) I have /mnt/media share mover override, a part from that very standard parameters: age - Auto Mover threshold: 68% Pool Usage was 69% at the moment I ran mover. 3) From the log I can see CACHESIZETHRESH: 2630815947161 which is accurate. 4) The script was running for a while, pool at 65% now however mover is still running... In my understanding it should stop moving at <= 68% NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT cache 5.45T 3.55T 1.91T - - 10% 65% 1.00x ONLINE - raidz1-0 5.45T 3.55T 1.91T - - 10% 65.0% - ONLINE nvme1n1p1 1.82T - - - - - - - ONLINE nvme2n1p1 1.82T - - - - - - - ONLINE nvme0n1p1 1.82T - - - - - - - ONLINE Log: mvlogger: *********************************MOVER START******************************* mvlogger: Age supplied: -1 mvlogger: Size supplied: 0 mvlogger: Sparness supplied: 0 mvlogger: SKIP FILES PATH: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: SKIP FOLDERS: /mnt/cache/media/downloads/* mvlogger: No Skip File Types Argument Supplied mvlogger: No Before Script Argument Supplied mvlogger: No After Script Argument Supplied mvlogger: CTIME Argument: no mvlogger: No Original Mover Threshold Percent Supplied mvlogger: No Test Mode Argument Supplied mvlogger: No Ignore Hidden Files Argument Supplied mvlogger: Threshold Percent: 68 mvlogger: No Script to Run. mvlogger: CACHETHRESH is blank mvlogger: Share Name Only: backup mvlogger: Cache Pool Name: cache mvlogger: cache Threshold Pct: mvlogger: OVERALL Threshold: 68 mvlogger: Share Path: /mnt/cache/backup mvlogger: cache is zfs. mvlogger: Pool Pct Used: 69 % mvlogger: DFTPCT LIMIT USED FOR SETTING: 68 mvlogger: Threshold Used: 68 mvlogger: Adding Skip Folder List mvlogger: Skip Folder List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Adding Skip File List mvlogger: Skip File List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Skipfiletypes string: find "/mnt/cache/backup" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: Share Name Only: isos mvlogger: Cache Pool Name: cache mvlogger: cache Threshold Pct: mvlogger: OVERALL Threshold: 68 mvlogger: Share Path: /mnt/cache/isos mvlogger: cache is zfs. mvlogger: Pool Pct Used: 69 % mvlogger: DFTPCT LIMIT USED FOR SETTING: 68 mvlogger: Threshold Used: 68 mvlogger: Adding Skip Folder List mvlogger: Skip Folder List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Adding Skip File List mvlogger: Skip File List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Skipfiletypes string: find "/mnt/cache/isos" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: Share Name Only: media mvlogger: -----Updating-Mover-Based-On-"media"-Settings----- mvlogger: Age supplied: -1 mvlogger: Size supplied: 0 mvlogger: Sparness supplied: 0 mvlogger: SKIP FILES PATH: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: SKIP FOLDERS: /mnt/cache/media/downloads/* mvlogger: No Skip File Types Argument Supplied mvlogger: No Before Script Argument Supplied mvlogger: No After Script Argument Supplied mvlogger: CTIME Argument: no mvlogger: No Original Mover Threshold Percent Supplied mvlogger: No Test Mode Argument Supplied mvlogger: No Ignore Hidden Files Argument Supplied mvlogger: Threshold Percent: 0 mvlogger: Cache Pool Name: cache mvlogger: cache Threshold Pct: mvlogger: OVERALL Threshold: 68 mvlogger: Share Path: /mnt/cache/media mvlogger: cache is zfs. mvlogger: Pool Pct Used: 69 % mvlogger: DFTPCT LIMIT USED FOR SETTING: 68 mvlogger: Threshold Used: 68 mvlogger: Adding Skip Folder List mvlogger: Skip Folder List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Adding Skip File List mvlogger: Skip File List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Skipfiletypes string: find "/mnt/cache/media" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: FINDSTR is: find "/mnt/cache/media" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: -----Reverting-"media"-Mover-Settings----- mvlogger: Age supplied: -1 mvlogger: Size supplied: 0 mvlogger: Sparness supplied: 0 mvlogger: SKIP FILES PATH: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: SKIP FOLDERS: /mnt/cache/media/downloads/* mvlogger: No Skip File Types Argument Supplied mvlogger: No Before Script Argument Supplied mvlogger: No After Script Argument Supplied mvlogger: CTIME Argument: no mvlogger: No Original Mover Threshold Percent Supplied mvlogger: No Test Mode Argument Supplied mvlogger: No Ignore Hidden Files Argument Supplied mvlogger: Threshold Percent: 68 mvlogger: Share Name Only: pictures mvlogger: Cache Pool Name: cache mvlogger: cache Threshold Pct: mvlogger: OVERALL Threshold: 68 mvlogger: Share Path: /mnt/cache/pictures mvlogger: cache is zfs. mvlogger: Pool Pct Used: 69 % mvlogger: DFTPCT LIMIT USED FOR SETTING: 68 mvlogger: Threshold Used: 68 mvlogger: Adding Skip Folder List mvlogger: Skip Folder List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Adding Skip File List mvlogger: Skip File List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Skipfiletypes string: find "/mnt/cache/pictures" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: Share Name Only: time_machine mvlogger: Cache Pool Name: cache mvlogger: cache Threshold Pct: mvlogger: OVERALL Threshold: 68 mvlogger: Share Path: /mnt/cache/time_machine mvlogger: cache is zfs. mvlogger: Pool Pct Used: 69 % mvlogger: DFTPCT LIMIT USED FOR SETTING: 68 mvlogger: Threshold Used: 68 mvlogger: Adding Skip Folder List mvlogger: Skip Folder List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Adding Skip File List mvlogger: Skip File List Path: /mnt/user/backup/mover-ignore/mover_ignore.txt mvlogger: Skipfiletypes string: find "/mnt/cache/time_machine" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: FINDSTR is: find "/mnt/cache/time_machine" -depth -not -path "/mnt/cache/media/downloads/*" | grep -vFx -f <(sed 's/\/*$//' '/mnt/user/backup/mover-ignore/mover_ignore.txt') mvlogger: Share Name Only: time_machine_pc mvlogger: Cache Pool Name: cache ... mvlogger: CACHESIZETHRESH: 2630815947161 mvlogger: CACHESIZETHRESH: 2630815947161 mvlogger: CACHESIZETHRESH: 2630815947161

I believe I found the root cause of my issue. My cache pool config - zfs raid z1 with 3 NVMEs (2 TB each). Meaning my raw total size is 6 TB however usable capacity is <4 TB ( 2 TB lost due to redundancy). age_mover:712 #Get the size threshold in bytes if is_zfs_mountpoint_fstype "/mnt/$CACHEPOOLNAME"; then CACHESIZETHRESH=$(( $(zpool list -p -o size $CACHEPOOLNAME | tail -n 1) * $DEFAULTTHRESHOLD /100 )) else CACHESIZETHRESH=$(( $(df --output=size --block-size=1 /mnt/$CACHEPOOLNAME | tail -n 1) * $DEFAULTTHRESHOLD /100 )) fi In script we use zpool list to determine total capacity. The problem is, for raid z1 it shows 6 TB (raw size) which is not accurate. zpool list -p -o size cache SIZE 5995774345216 I believe instead of zpool list we should use something like that (this shows real formatted size) zfs list -Hp -o available,used cache | awk '{print $1 + $2}' 3868846981120