5 hours ago, ronia said:

Toggling only the tool back from mover to rsync and files/hardlinks are being moved as expected

6 hours ago, NCM said:

At least in my limited testing Rsync seemed ~50% faster than native move.

Will be cool to have logs to check if it so , not personally tested but some user said move working faster ... Maybe will make also test sometime

5 hours ago, ronia said:

Toggling only the tool back from mover to rsync and files/hardlinks are being moved as expected.

You can enable debug then check debug file, the move operation will be listed in log if success or fail.

4 hours ago, Masterwishx said:

Will be cool to have logs to check if it so , not personally tested but some user said move working faster ... Maybe will make also test sometime

ca.mover.tuning-debug-20250603-1933.zip

Hopefully that's helpful.

@JoshUK found issue when mover start stuck at end stage.

Will be fixed in new version

On 6/3/2025 at 1:03 PM, Masterwishx said:

You can enable debug then check debug file, the move operation will be listed in log if success or fail.

I found the relevant lines in the debug log:

-------------------------------------------------------------- Debugging Move Action ------------------------------------------------------------

07:29:38.073 Move cmd: move, Move file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e05-MrHulk-WEBDL-1080p.mkv, Dest: /mnt/user0/

file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e05-MrHulk-WEBDL-1080p.mkv [28,c178b0] has 1 dangling link(s)

------------------------------------------------------- Debugging Clean Folder - Start Loop -----------------------------------------------------

07:29:38.099 Current file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e05-MrHulk-WEBDL-1080p.mkv, Current folder: /mnt/cache/data/media/tv2/Single's Inferno/Season 03, Previous folder: , Previous cou

nt: -1

-------------------------------------------------------- Debugging Clean Folder - End Loop ------------------------------------------------------

07:29:38.120 Cycle of delete folder, Previous count: 11, Count of files: 11

------------------------------------------------------- Debugging Clean Folder - Start Loop -----------------------------------------------------

07:29:38.143 Current file: /mnt/cache/data/torrents/avistaz/Singles.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk/Singles.Inferno.S03E05.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk.mkv, Current folder: /mnt/cache/data/torrents/avistaz/Singles

.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk, Previous folder: /mnt/cache/data/media/tv2/Single's Inferno/Season 03, Previous count: 11

-------------------------------------------------------- Debugging Clean Folder - End Loop ------------------------------------------------------

07:29:38.165 Cycle of delete folder, Previous count: 11, Count of files: 11

-------------------------------------------------------------- Debugging Move Action ------------------------------------------------------------

07:29:38.201 Move cmd: move, Move file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e02-MrHulk-WEBDL-1080p.mkv, Dest: /mnt/user0/

file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e02-MrHulk-WEBDL-1080p.mkv [28,c178ed] has 1 dangling link(s)

------------------------------------------------------- Debugging Clean Folder - Start Loop -----------------------------------------------------

07:29:38.227 Current file: /mnt/cache/data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e02-MrHulk-WEBDL-1080p.mkv, Current folder: /mnt/cache/data/media/tv2/Single's Inferno/Season 03, Previous folder: /mnt/cache/dat

a/torrents/avistaz/Singles.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk, Previous count: 11

-------------------------------------------------------- Debugging Clean Folder - End Loop ------------------------------------------------------

07:29:38.248 Cycle of delete folder, Previous count: 11, Count of files: 11

------------------------------------------------------- Debugging Clean Folder - Start Loop -----------------------------------------------------

07:29:38.271 Current file: /mnt/cache/data/torrents/avistaz/Singles.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk/Singles.Inferno.S03E02.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk.mkv, Current folder: /mnt/cache/data/torrents/avistaz/Singles

.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk, Previous folder: /mnt/cache/data/media/tv2/Single's Inferno/Season 03, Previous count: 11

-------------------------------------------------------- Debugging Clean Folder - End Loop ------------------------------------------------------

07:29:38.293 Cycle of delete folder, Previous count: 11, Count of files: 11

So it seems like it's not picking up the hardlink, as the previous logs indicated that the hardlinks were detected:

Jun  3 07:29:38 Dammerung move: Moving "/mnt/cache/./data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e05-MrHulk-WEBDL-1080p.mkv" "/mnt/cache/./data/torrents/avistaz/Singles.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk/Singles.Inferno.S03E05.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk.mkv"  to  /mnt/user0/ (preserving hardlinks)

Jun  3 07:29:38 Dammerung move: Moving "/mnt/cache/./data/media/tv2/Single's Inferno/Season 03/Single's Inferno (2021)-s03e02-MrHulk-WEBDL-1080p.mkv" "/mnt/cache/./data/torrents/avistaz/Singles.Inferno.S03.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk/Singles.Inferno.S03E02.1080p.NF.WEB-DL.DDP5.1.H.264-MrHulk.mkv"  to  /mnt/user0/ (preserving hardlinks)

Edited June 5, 20251 yr by ronia

36 minutes ago, ronia said:

hardlinks were detected

37 minutes ago, ronia said:

(preserving hardlinks

It's just message from the code

39 minutes ago, ronia said:

[28,c178ed] has 1 dangling link(s)

This is more interesting becose message from binary move, will try to check what is mean.

Did you tryed unraid move for hard links sometime maybe?

Found in forum:

It seems or something broken on disk or it's just how unraid mover works with hard links when some think use thouse files at moment of moving. But rsync work somehow, will try to check more later

Does this work for cache pools? I just added 2 new ssd's and made a new cache pool (first time using one) and I moved my appdata to the new pool.. and running mover start from cli this is all it does.

root@mediabox:~# mover start

***************************************************** Mover Tuning Plugin version 2025.06.01 ****************************************************

----------------------------------------------------------------- Global settings ---------------------------------------------------------------

Using global (cache:yes) moving threshold: 0 %

Using global (cache:yes) freeing threshold: 0 %

Using global (cache:prefer) fillup threshold: 95 %

Age: no = 0 ; daysold:

Clean Folders: yes

No CTIME argument provided, defaulting to no

No ATIME argument provided, defaulting to no

Skip filetypes: !qB

Notify: yes

Logging: yes

Debug Logging: no

Log parent folder: /tmp

Log files delete age: 5 days

List files delete age: 10 days

Validate Filenames: no

Move files tool: rsync

***************************************************************** FILTERING FILES ***************************************************************

----------------------------------------------------------- Processing [appdata] share ----------------------------------------------------------

Primary storage: cache_pool - size: 932GiB - used: 3 % (22GiB)

Secondary storage: none

Share Information: Name: appdata - Path: /mnt/cache_pool/appdata

Mover action: no action, only cache_pool used (cache:only).

Only one share found in cache pool. Skipping cache pool size calculation.

On 6/3/2025 at 3:59 PM, Masterwishx said:

 2025.06.01 version Update

new: Added an option "Move files tool" to select the file-moving tool between Rsync and the Unraid move utility, default file-moving tool set to Rsync. (masterwishx)

new: Introduced a new debug command "mover debug" to generate a diagnostics package for troubleshooting.

fix: Enhanced logging and debug information for file move operations.

fix: Updated debug package creation to copy the diagnostics ZIP to the system boot logs directory.

Thanks for the update below.

Unfortunately, I can still not download the log (ERROR: The Mover Tuning Debug Package Generation Script has failed - no response from the bash backend).

I ran it manually via CLI (mover debug). Just not sure where to find it. I tried to download the diagnostic log (from Unraid GUI), which works, but I also cannot find the created debug file. It's not in the log folder.

I found it, please see attached log. Woudl be great to have your help!

ca.mover.tuning-debug-20250606-2007.zip

8 hours ago, RonneBlaze said:

Does this work for cache pools? I just added 2 new ssd's and made a new cache pool (first time using one) and I moved my appdata to the new pool.. and running mover start from cli this is all it does.

root@mediabox:~# mover start

***************************************************** Mover Tuning Plugin version 2025.06.01 ****************************************************

----------------------------------------------------------------- Global settings ---------------------------------------------------------------

Using global (cache:yes) moving threshold: 0 %

Using global (cache:yes) freeing threshold: 0 %

Using global (cache:prefer) fillup threshold: 95 %

Age: no = 0 ; daysold:

Clean Folders: yes

No CTIME argument provided, defaulting to no

No ATIME argument provided, defaulting to no

Skip filetypes: !qB

Notify: yes

Logging: yes

Debug Logging: no

Log parent folder: /tmp

Log files delete age: 5 days

List files delete age: 10 days

Validate Filenames: no

Move files tool: rsync

***************************************************************** FILTERING FILES ***************************************************************

----------------------------------------------------------- Processing [appdata] share ----------------------------------------------------------

Primary storage: cache_pool - size: 932GiB - used: 3 % (22GiB)

Secondary storage: none

Share Information: Name: appdata - Path: /mnt/cache_pool/appdata

Mover action: no action, only cache_pool used (cache:only).

Only one share found in cache pool. Skipping cache pool size calculation.

You have only one share with cache:only so nothing to move

2025.06.07

- fix: Fixed "mover start" from CLI freezing before the end stage at "resetRunOnceMoverSettings" function. _(masterwishx)_

- fix: Fixed the mover process retrieving blank values for parent processes instead of "bash" and "crond" commands.

- new: Added a time counter feature to calculate the elapsed time during file move operations. This enhancement provides better visibility into the performance of file moves.

2 hours ago, Masterwishx said:

2025.06.07

- fix: Fixed "mover start" from CLI freezing before the end stage at "resetRunOnceMoverSettings" function. _(masterwishx)_

- fix: Fixed the mover process retrieving blank values for parent processes instead of "bash" and "crond" commands.

- new: Added a time counter feature to calculate the elapsed time during file move operations. This enhancement provides better visibility into the performance of file moves.

Not sure this was in response to me? If so, I updated and gave it another try. Still not able to move $$$ files and also not able to downlad the log (except the manual way shared above).

9 minutes ago, steve1977 said:

Not sure this was in response to me

No , Sorry just worked on new version fixes

20 minutes ago, steve1977 said:

Still not able to move $$$ files

Did you tried to use move instead of Rsync ?

24 minutes ago, steve1977 said:

Still not able to move $$$ files and also not able to downlad the log (except the manual way shared above).

By the mover logs you send i can see files are moving ...

6 minutes ago, Masterwishx said:

By the mover logs you send i can see files are moving ...

Yes, all files are moving. Except the ones that have $ in the filename.

16 minutes ago, Masterwishx said:

Did you tried to use move instead of Rsync ?

Just did and it works with mover. It doesn't work with rsync. Shall I just leave it with mover?

Let's say I set Only move at this threshold of used cache space: to 50%. And also Move files that are greater than this many days old: to 150 days.

If my cache exceeds 50% but all files are less than 150 days old. Will the mover run but simply not move any files?

If I enable Test Mode, where does it output to? The system log?

I clicked Move Now with test mode enabled and the mover has been running for the past 20 minutes with zero cache and hard drive activity. Did something go wrong with that operation? Never mind. I suspect what happened is there was a huge number of affected files which made the mover very slow to start.

Edited June 7, 20251 yr by Marc_G2

Hi all,
I've been using the Mover Tuner plugin without any issues, but recently it has stopped moving files from my temp drive. The temp drive is completely full now, and the mover is not transferring the files as it did before.

ca.mover.tuning-debug-20250607-1826.zip

19 hours ago, Masterwishx said:

You have only one share with cache:only so nothing to move

not true.. the appdata share is cache only on the new cache pool i made named cache_pool I have a data share that is set to Cache > Array and it uses a separate cache drive named cache... it never even made it to the data share it just stopped and sat on the appdata share.

5 hours ago, Marc_G2 said:

If my cache exceeds 50% but all files are less than 150 days old. Will the mover run but simply not move any files?

1/ the mover will ONLY run on the scheduler you set (there is no watchdog for fillrates etc ...), so

2/ if you cache is filled > 50 %

3/ and ALL files are < 150 days old

the mover will run xyz hours, days, ... whatever you setup in scheduler, but will NOT transfer anything as there are no files > 150 days old.

it will then 1st look if treehold is met (> 50 % fillrate), then it will look to move files based on age, if you set a fixed age (150 days) then ONLY files which are older will be moved until (your not mentioned target fillrate) is matched OR if all files > 150 days are moved ...

simple as that ...

15 hours ago, steve1977 said:

Shall I just leave it with mover?

Yep, it's fine for this I added move if someone has issues with Rsync, also it's unraid native moving tool.

Edited June 8, 20251 yr by Masterwishx

I migrated from the old plugin, and my "Comma separated list of file types:" ignore list isn't working.

What is the correct format for the list?

I copied and pasted my list from the old plugin: .jpg,.JPG,.nfo,NFO (etc)

I tried reformatting with spaces: .jpg, .JPG, .nfo, .NFO (etc)

The log appears to be respecting the list:

Skip filetypes: ass ASS gif GIF idx IDX jfif JFIF jpeg JPEG jpg JPG nfo NFO png PNG srt SRT ssa SSA sub SUB svg SVG txt TXT vtt VTT ffs_db ffs_lock

But then it's spewing 239,120 entries of attempted moves, ignoring my list; It takes several hours, each attempt.

Moving "/mnt/cache/./Podcasts/Radiolab/folder.jpg" to /mnt/user0/

TEST MODE: Would Move using rsync utility

227824 files remaining from caches to array 11GiB

I am calling "mover start" from a backup script, in case that makes any difference.

Edited June 9, 20251 yr by nmkaufman

On 6/7/2025 at 6:30 PM, fahmula said:

Hi all,
I've been using the Mover Tuner plugin without any issues, but recently it has stopped moving files from my temp drive. The temp drive is completely full now, and the mover is not transferring the files as it did before.

ca.mover.tuning-debug-20250607-1826.zip

Any help? example of logs. It find files but not moving.

Jun 8 21:18:39 Skynet move: Deciding the action (move/sync/keep) for each file. There are 521 files, it can take a while...

Jun 8 21:18:40 Skynet move: No new files will be moved/synced from primary to secondary

Jun 8 21:18:40 Skynet move: No new files will be moved/synced from secondary to primary

Jun 8 21:18:40 Skynet move: Action started at: 21:18:40