On 3/19/2025 at 3:57 PM, Masterwishx said:

 

 

oh I don't even have that- I'll check it out.  Thanks!  

Hi everyone,

I wanted to use mover tuning mostly to keep 3 folders always on the cache SSD.

It's possible to set up that it will sync only those 3 folder and that it will move all the others?

I would like the document folder to always be on the SSD so that read times are improved, but the Download folder can be moved to array at night for example

On 10/28/2022 at 3:09 AM, hugenbdd said:

How to ignore a SINGLE file

1.) Find the path of the file you wish to ignore.
    ls -ltr /mnt/cache/Download/complete/test.txt
        root@Tower:/# ls -ltr /mnt/cache/Download/complete/test.txt
        -rwxrwxrwx 1 root root 14 Oct 27 11:32 /mnt/cache/Download/complete/test.txt*
2.) Copy the complete path used.  
    /mnt/cache/Download/complete/test.txt
3.) Create a text file to hold the ignore list.
    vi /mnt/user/appdata/mover-ignore/mover_ignore.txt
4.) Add a file path to the mover_ignore.txt file
    While still in vi press the i button on your keyboard.
    Right click mouse.
5.) Exit and Save
    ESC key, then : key, then w key, then q key
6.) Verify file was saved
    cat /mnt/user/appdata/mover-ignore/mover_ignore.txt
    "This should print out 1 line you just entered into the mover_ignore.txt"
7.) Verify the find command results does not contain the ignored file
    find "/mnt/cache/Download" -depth | grep -vFf '/mnt/user/appdata/mover-ignore/mover_ignore.txt'
    /mnt/cache/Download is the share name on the cache. (Note, cache name could be different if you have multiple caches or changed the default name)

 

How to ignore Muliple files.

1.) Find the paths of the files you wish to ignore
    ls -ltr /mnt/cache/Download/complete/test.txt
    ls -ltr /mnt/cache/Download/complete/Second_File.txt
2.) Copy the complete paths used to a separate notepad or text file.
    /mnt/cache/Download/complete/test.txt
    /mnt/cache/Download/complete/Second_File.txt
3.) Copy the paths in your notepad to the clip board. 
    Select, the right click copy
4.) Create a text file to hold the ignore list.
    vi /mnt/user/appdata/mover-ignore/mover_ignore.txt
5.) Add the file paths to the mover_ignore.txt file
    While still in vi press the i button on your keyboard.
    Right click mouse.

    You should now have two file paths in the file.
6.) Exit and Save
    ESC key, then : key, then w key, then q key
7.) Verify file was saved
    cat /mnt/user/appdata/mover-ignore/mover_ignore.txt
    "This should print out 2 lines you just entered into the mover_ignore.txt"
8.) Verify the find command results does not contain the ignored files
    find "/mnt/cache/Download" -depth | grep -vFf '/mnt/user/appdata/mover-ignore/mover_ignore.txt'
    /mnt/cache/Download is the share name on the cache. (Note, cache name could be different if you have multiple caches or changed the default name)

How to Ignore a directory
instead of a file path, use a directory path.  no * or / at the end.
This may cause issues if you have other files or directories named the similar but with extra text.

/mnt/cache/Download/complete

*Note /mnt/cache/Download/complete  will also ignore /mnt/cache/Download/complete-old 

 

 

*I use vi in this example instead of creating a file in windows, as windows can add ^m characters to the end of the line, causing issues in Linux.   This would not be an issue if dos2unix was included in unRAID.

 

**Basic vi commands

https://www.cs.colostate.edu/helpdocs/vi.html

So I am trying to ignore a directory that has spaces in its name would I put the path in the .txt like "/mnt/arraycache/media/TV Shows/The Boys"   or  /mnt/arraycache/media/TV Shows/The Boys 

Mover ignore is also not working for me. Added 3 folders to mover_ignore.txt and they are being copied over to the array.

5 hours ago, Octavius_Flavius said:

Mover ignore is also not working for me. Added 3 folders to mover_ignore.txt and they are being copied over to the array.

Ignore is currently working for me.  Make sure you're specifying the right location as I also made that mistake originally.  For example:

 

/mnt/cache/data/cross-seed-links/
/mnt/cache/data/cross-seeds/
/mnt/cache/data/downloads/
/mnt/cache/data/irc/
/mnt/cache/data/torrents/
/mnt/cache/data/media/music/
/mnt/cache/data/scripts/

 

And not this format: /mnt/user/data/...

Edited March 24, 20251 yr by ronia

18 hours ago, ronia said:

Ignore is currently working for me.  Make sure you're specifying the right location as I also made that mistake originally.  For example:

 

/mnt/cache/data/cross-seed-links/
/mnt/cache/data/cross-seeds/
/mnt/cache/data/downloads/
/mnt/cache/data/irc/
/mnt/cache/data/torrents/
/mnt/cache/data/media/music/
/mnt/cache/data/scripts/

 

And not this format: /mnt/user/data/...

 

I am using the following settings:

 

Move files off Primary (cache) based on age? yes

Move files that are greater than this many days old: auto

Ignore files and folders listed inside of a text file: yes

File list path:  /mnt/data/virtualization/appdata/mover_ignore/mover_ignore.txt

 

within mover_ignore.txt I added the following entries:

/mnt/cache/media/torrents/
/mnt/cache/media/transcode/
/mnt/cache/media/usenet/

Will the rebalance option honor the split level? I have some directories in my share on the array that for whatever reason are not split across the directories like they should be. unbalance helps but I would have to go to each subdirectory and fix it manually. I was hoping that rebalance not only rebalances between primary and secondary but also would "fix" wrong splits within secondary... Any chance?

On 3/21/2025 at 10:53 PM, cbr600ds2 said:

 

oh I don't even have that- I'll check it out.  Thanks!  

 

Ok so I found it and fixed it.  The Movies get cleared but the TV folder keeps the TV show folders.   Is that a weird glitch?  

3 hours ago, cbr600ds2 said:

TV folder keeps the TV show folders.   Is that a weird glitch?  

Is this dataset or folder on zfs? 

Post the logs

9 hours ago, JPHobby said:

Any chance?

I think only primary and the secondary 

On 3/19/2025 at 2:49 PM, Masterwishx said:

Fixed issue with wrong thresholds for cache:yes , you can check it by download and test :  https://github.com/masterwishx/ca.mover.tuning/blob/dev-new-fixes-4/source/ca.mover.tuning/usr/local/emhttp/plugins/ca.mover.tuning/age_mover

 

I have tested this in the new version and the thresholds seem to be following the global settings now. Thanks!

 

However, I seem to also be having the same issue as others where the mover is still moving files that should be ignored. In light of my previous issues, I'm wondering if this isn't also an issue with the global settings not being applied.

 

My mover ignore script includes:

     /mnt/buffer/data/usenet
     /mnt/buffer/data/torrent
     /mnt/buffer/./data/usenet
     /mnt/buffer/./data/torrent

 

However I am still getting the following when running mover:

     Moving "/mnt/buffer/./data/usenet/complete/default/test_download_10GB.1.4/test_download_10GB.bin"  to  /mnt/user0/ 
 

11 hours ago, Masterwishx said:

Is this dataset or folder on zfs? 

Post the logs

 

Ummm... folder?   

skynet-diagnostics-20250326-1351.zip

5 hours ago, Ichthus said:

global settings not being applied.

Post logs and debug logs 

5 hours ago, Ichthus said:

My mover ignore script includes

What the path of ignore file? 

Hey guys! I just migrated from the other mover tuning plugin, and wondered if any of you could give my settings a quick look? Basically I only want to move all my files once a week (cron job), and have it check every hour to see if the cache is over 75% (in which case, it would start moving). Is this the way to go? Cheers!

 

1 hour ago, Masterwishx said:

What the path of ignore file? 

Doh... my bad... I had the wrong file referenced. All is good now!

 

Thanks again!

2 hours ago, Rijstkeizer said:

if the cache is over 75% (in which case, it would start moving

Looks fine will move after 75% until 0%

I am using

 

Move files off Primary (cache) based on age? --> YES

 

with 15 days. The cache is under the threshold. I was of the opinion that even though the usage is not over the threshold the mover plugin should move files older than 15 days to secondary storage. Is this not true or is this a bug?

 

Regards

JP

7 hours ago, JPHobby said:

Is this not true or is this a bug?

not a bug

 

7 hours ago, JPHobby said:

I was of the opinion that even though the usage is not over the threshold the mover plugin should move files older than 15 days to secondary storage

nope, 1st trigger is treehold, IF > N % ... start moving ... and then move all > 15 days old ... keep the newer files still caced.

 

so its a feature, not a bug ...

 

IF you want only aging as measurement, set treeholds low like 0 0 ... keep your age rule, mover will always move files > 15 days old away, if that is what you looking for ...

Hello all. I’m having an issue where mover tuning is filling my flash drive with logs. 
 

/tmp/ca.mover.tuning

 

I have logging disabled but still writing files to /tmp and after ~48 hours will write 8gb to flash and fill it and crash server. 
 

Included ss is after ~12 hours. 
 

I’ve had to uninstall to stop this. 
 

thank you. 

12 minutes ago, elmlund said:

Hello all. I’m having an issue where mover tuning is filling my flash drive with logs. 
 

/tmp/ca.mover.tuning

Do you have /tmp on flash drive? 

 

In next version will be option to change parent folder logs location + age for logs and list files

5 minutes ago, Masterwishx said:

Do you have /tmp on flash drive? 

 

In next version will be option to change parent folder logs location + age for logs and list files

Yeah not sure why /tmp is there. I would like it not to be but that how it's been since the Unraid 7 update and moving to the newest mover tuning. 

 

Would be great to use again and would be fantastic to be able to move logs to array and have them wipe after a few days. Thank you heaps. 

 

Awesome work!

AH I might have been cracked out when I thought that was flash drive. Guess that's just the rootfs. 

 

I had 16GB RAM installed, seems when mover tuning would max the /tmp allocation of 8GB it would cause system to hang due to running out of memory possibly?

 

I just installed another 16GB (so 32GB total now), and can see the /tmp is now 16GB.

 

This might have fixed my issue, but being able to get the logs off RAM would be good anyhow. 

Yeah it crashes either because the rootfs is full or you were using more than half the RAM already.

 

It should just not log that much, are you sure you turned off all logging?

20 minutes ago, Kilrah said:

Yeah it crashes either because the rootfs is full or you were using more than half the RAM already.

 

It should just not log that much, are you sure you turned off all logging?

Based on the settings I’ve seen, I believe all of them are off. 

 

Edited March 28, 20251 yr by elmlund