Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

[Plugin] Mover Tuning

Featured Replies

27 minutes ago, hugenbdd said:

Is this link available?
It is necessary for plugin developers to take appropriate action within their plugins to enable them to utilize the multi-language support. The details on what is required are covered in the design guide here.  "Here" <- https://wiki.unraid.net/images/5/5e/Multi-language_Support_Design_Guide.pdf   Doesn't seem to work.

Best to look at other plugins.

 

You need the translation parts.https://github.com/SimonFair/USB_Manager/blob/85cb99a5aca0b633184fec3d557587aec36802c6/source/USBDevices.php#L14

 

Value to be translated in php are between _()_ and _() is javascript

 

echo "<td>"._('Volume(Storage)    ')."</td><td>"._('Mappin

  • Replies 3.5k
  • Views 485.8k
  • Created
  • Last Reply

Top Posters In This Topic

Most Popular Posts

  • hugenbdd
    hugenbdd

    New Version 07-03-2023   HUGE thanks/Shout-out to @Swarles for the help with updating code fixes and adding a great new feature.  You can now have some customization per share.  It's great t

  • How to ignore a SINGLE file 1.) Find the path of the file you wish to ignore.     ls -ltr /mnt/cache/Download/complete/test.txt         root@Tower:/# ls -ltr /mnt/cache/Download/complete/test

  • Hi all, I made a new version of the plugin. This fork replaces @hugenbdd's plugin which is not maintained anymore and will land in community applications if your feedbacks are positive.  

Posted Images

14 hours ago, Swarles said:

Great! Do let us know if the email ends up coming through again or not. Otherwise I'll ask hugendbb if we can change it permanently. Also keep in mind it will be reset if your server restarts (until it is implemented) :)

 

Not entirely sure what you mean but the location in sbin is correct and the file SHOULD exist (if that's what you meant).

 

It is working fine! No email tonight and the mover force task ran.

This means the change from "2>/dev/null\" to "&> /dev/null\" fixed my problem with the emails!

Hi, still on 6.11.5

 

I keep randomly getting a mover error with the plugin every now and then:

 

cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Jul 13 08:00:01 redacted root: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 675: [: 87: unary operator expected

 

I have not changed anything in the config in over a month and it worked before.

 

Does anyone have a clue what the cause could be?

9 hours ago, cynikaly said:

Hi, still on 6.11.5

 

I keep randomly getting a mover error with the plugin every now and then:

 

cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Jul 13 08:00:01 redacted root: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 675: [: 87: unary operator expected

 

I have not changed anything in the config in over a month and it worked before.

 

Does anyone have a clue what the cause could be?

Looking into this..

 

9 hours ago, cynikaly said:

Hi, still on 6.11.5

 

I keep randomly getting a mover error with the plugin every now and then:

 

cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Jul 13 08:00:01 redacted root: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 675: [: 87: unary operator expected

 

I have not changed anything in the config in over a month and it worked before.

 

Does anyone have a clue what the cause could be?

Can you make a small change to the settings under scheduler, apply, then change back.

 

It's possible the file was lost or not saved for some reason.

/boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg should be there.

On 7/15/2023 at 6:10 AM, dopeytree said:

Think mover tuning is still moving hidden folders which have a .folder denotation.

Bit confused by the log.

Could you provide some more info for which share you’re trying to use a hidden folder? From what I can see in your latest logs from diagnostics you have been using the “Move now” button located in individual share settings which moves all files and ignores mover tuning settings. See point 3 in my previous post.

On 7/8/2023 at 3:18 PM, Swarles said:

Hmm this is not expected behaviour and I have tested on my unraid to be working.

A couple things:

  1. Make sure that if the particular share with ".folder" is using its own settings (mover settings override) that the setting to ignore hidden files is set to yes in that share. If it is not using its own settings the global settings must be set to yes.
  2. Ensure that the type of share is valid (Primary: Cache, Mover: cache-->array), other share types do not use mover settings.
  3. Ensure that you're not trying to move files by hitting the "Move ALL" button in the share settings.
  4. Ensure that you do not have "Move All from Cache-Yes shares when disk is above a certain percentage:" set to Yes in your share/mover settings. If this successfully executes, it will move all the files off the cache not following settings.
  5. Set "Test Mode:" and "Move Now button follows plug-in filters:" to yes, also enable logs. Then run the mover and in "cd /tmp/Mover" use "cat Custom_Mover_Tuning_*latest*.list" this will show the files that will move. None of the files in .folder should be here. IF they are, do the following: "cat Mover_Tuning_*latest*.log". You can post the logs in a spoiler here or send to me privately.
      Reveal hidden contents

    Alternatively if you look through your logs yourself; find "Skipfiletypes string: ...." (there should be 1 for each cache-->array share), that is (most of) the find string being used so you can then run that in your your terminal and it will output all the paths that the mover will attempt to move for that share. It should not include paths for .folder or its contents.

     

If you can confirm the first 4 points that would be helpful, and the logs in step 5 would be helpful too. Thank you :) 

 

 

Alternatively: you can move away from the hidden folders approach and simply put the path to the folder you want to skip in the skip files list with that setting enabled. I believe this should work fine for your use case and in the next release will be fully supported.

Edited by Swarles
Meant folder not url lol

Is there a way to check the status of the mover from the terminal, either in this plugin or natively? Not in the sense of percentage, but if it's running or not?

yup, you can do age_mover status

it will just cat out the pid file.

/var/run/mover.pid

 

I also write the status of the current mover of what file it's on and there is a "GUI" update, if your willing to modify unraid from stock files. (manual install, I'm out the next few days so can't provide instructions right now, but they are posted here or on Reddit if you want to hunt them down)

29 minutes ago, hugenbdd said:

yup, you can do age_mover status

I'm getting, a 'command not found' when I try and run that.

 

I'm excited for that update, I saw the info on github!

 

I'm working on a script right now, so the GUI wouldn't be helpful in this use case :)

argg.. you caused me to find an issue.  ;)

I will fix when I get some time.  but.. I'm away for a few days so probably over the weekend.

In the meantime.. you can use this to grab status or check for the pid file.

root@Tower:/usr/local/emhttp/plugins/ca.mover.tuning# ./age_mover status
 

or check for the existence of the PID file.  If it exists, the Process # (pid) will be in the file.

 

cat /var/run/mover.pid

I am having issues with mover not "moving". 

 

Troubleshooting so far:

  1. Removed age requirement
  2. Lowered cache space threshold
  3. Stopped docker tried to execute mover
  4. Setting share "use cache pool" from yes to no, then back to yes

  5. Looked for shareCacheEnabled="yes" in /config/share.cfg but my usb does not have that file?

  6. Looked for mover.pid but again not on my system?

 

I've read some people suggest that dual drive cache eventually creates problems for mover. I don't know why since it is just in RAID1 config basically right?

drives.JPG

mover.JPG

share.JPG

meydertyrocc-diagnostics-20230722-1259.zip

config shares.JPG

mover_pid.JPG

Edited by sharkaccident

I've uninstalled CA mover and everything seems to be working with default Unriad Mover utlity. 

12 hours ago, sharkaccident said:

5. Looked for shareCacheEnabled="yes" in /config/share.cfg but my usb does not have that file?

6. Looked for mover.pid but again not on my system?

5. I believe the following should fix your issue. Go into terminal and paste the following:

echo shareCacheEnabled='"yes"' >> /boot/config/share.cfg

This will add share.cfg to your config with the appropriate line. Let me know if the mover tuning plugin works now.
EDIT: I think the other way to have the file created would be to edit your global share settings. "Settings>Global Share Settings"

 

6. I believe mover.pid will only exist while the mover is running. I may be wrong though.

Edited by Swarles

I have installed the plugin on 6.11 and the mover not working.

 

How can I checked this on syslog or another log and fix this?

 

Here is the Config:

Screenshot_20230723-105432_Firefox.png

Screenshot_20230723-105320_Firefox.png

Screenshot_20230723-105257_Firefox.png

Edited by Revan335

8 hours ago, Revan335 said:

I have installed the plugin on 6.11 and the mover not working.

 

How can I checked this on syslog or another log and fix this?

 

Here is the Config:

Screenshot_20230723-105432_Firefox.png

Screenshot_20230723-105320_Firefox.png

Screenshot_20230723-105257_Firefox.png


What would be helpful is if you do the following:

  1. Go to “cd /boot/config” and identify if “share.cfg” file exists. If not follow the steps from my comment above yours and see if it is now working.
  2. otherwise:
  3. Enable Mover Logging.
  4. Set “Move Now Button Follows Plug-In Filters” to yes.
  5. Set “Test Mode” to yes.
  6. Run mover.
  7. Go to “cd /top/Mover” and share the .log file.

This should help us identify where the mover is progressing to / stopping.

Hi, so I’m trying to get it so new media stays on the cache drive (media share) for a period of time, say 7 days in this example, but all other data in other shares moves from cache to array once a night - normal mover behaviour. I’m trying to avoid spinning up disks for recently added media that gets watched a few times. 
 

I have used the following settings. Will this work as desired?

IMG_0276.jpeg

IMG_0278.jpeg

7 hours ago, stridemat said:

Hi, so I’m trying to get it so new media stays on the cache drive (media share) for a period of time, say 7 days in this example, but all other data in other shares moves from cache to array once a night - normal mover behaviour. I’m trying to avoid spinning up disks for recently added media that gets watched a few times. 
 

I have used the following settings. Will this work as desired?

With those settings applied to the "media" share, no files in the media share will be moved until the time it was last modified (mtime) exceeds 7 days. If there are other files in the media share you want to move sooner than 7 days they won't move either and there's no way to do this. Those settings will only apply to the "media" share and no other share. Note, if you're using usenet you might need to disabled a setting that preserves the original timestamps of a .rar file. Otherwise this will result in the 7 days being unreliable because.

 

If you store metadata or cover art etc with your media, I'd recommend using the skip file types setting to keep those on the cache for whenever they are loaded, this will stop the disks spinning up when someone is browsing.

9 hours ago, Swarles said:

With those settings applied to the "media" share, no files in the media share will be moved until the time it was last modified (mtime) exceeds 7 days. If there are other files in the media share you want to move sooner than 7 days they won't move either and there's no way to do this. Those settings will only apply to the "media" share and no other share. Note, if you're using usenet you might need to disabled a setting that preserves the original timestamps of a .rar file. Otherwise this will result in the 7 days being unreliable because.

 

If you store metadata or cover art etc with your media, I'd recommend using the skip file types setting to keep those on the cache for whenever they are loaded, this will stop the disks spinning up when someone is browsing.

Thanks. I am using usenet so will have to see if I can find this setting in SAB. 

2 hours ago, stridemat said:

Thanks. I am using usenet so will have to see if I can find this setting in SAB. 

Config>Special>ignore_unrar_dates

3 hours ago, Swarles said:

Config>Special>ignore_unrar_dates

Thanks. I found it earlier and on a test all seems to be working. 

Strange, the Cache is more empty. The Mover must be worked but I changed no config.

 

Maybe a Plugin Update.

 

I'm watching this in next time.

 

Many Thanks!

Edited by Revan335

Is there a way to configure the "Move All from Cache-Yes shares when disk is above a certain percentage" / "Move All from Cache-yes shares pool percentage" settings to move only enough files to get the disk below a certain percentage? 

 

The practical use-case is that if the cache is being used for hot-file access, you want to keep as many files as possible in the cache. Ideally you can evict files from the cache drive based on last access or creation time (in addition to the filter settings).

 

EDIT: I found the comment about using the "keep files under a certain age", but that requires some fairly precise tuning and the workload on the cache disk is fairly variable. It looks like a candidate location to filter the file list would be here https://github.com/hugenbd/ca.mover.tuning/blob/master/source/ca.mover.tuning/usr/local/emhttp/plugins/ca.mover.tuning/age_mover#L753 (to sort the file list by age and then take files until you get to the threshold). I don't have a dev environment setup for doing this otherwise I'd help out :).

Edited by jch

  • 2 weeks later...

Hi 

Can this script skipp to move folder 

Like I don't want my sabnzbd to move at all from my cache . 

I have my media folder in same folder as sabnzbd so when download finish move file to media but when I press move now button it start from those small incomplete file from sabnzbd 

On 8/6/2023 at 2:48 AM, armin0012002 said:

Hi 

Can this script skipp to move folder 

Like I don't want my sabnzbd to move at all from my cache . 

I have my media folder in same folder as sabnzbd so when download finish move file to media but when I press move now button it start from those small incomplete file from sabnzbd 

Use the "Skip Files List" setting. To do this provide the path to a .txt file which contains file paths you want the mover to ignore. In that .txt put the path to the sabnzbd folder. Full support for this will be in the next update but for now as long as you don't have another folder called sabnzbd1 or similar it will work just fine as expected.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.