[Plugin] Mover Tuning

hugenbdd · August 24, 2023

I'm still on 6.11.4, will upgrading tomorrow morning to test and debug.

Is there any info in Logs or any new files created in /tmp/Mover directory?

Kloudz · August 24, 2023

5 minutes ago, hugenbdd said:

I'm still on 6.11.4, will upgrading tomorrow morning to test and debug.

Is there any info in Logs or any new files created in /tmp/Mover directory?

Yep new files created today. My scheduler runs every two hours you can see where I did manual triggers a few times and nothing was happening
image.png.609ee9fc8e1ed4f0669b50837a4ca210.png

image.png.824e4623eb7b5b9b0940c2ac134cd6ca.png

.list files has all the files that needs to be moved but were never moved. they're still in the zfs pool that I set as my 'cache' drives

hugenbdd · August 24, 2023

52 minutes ago, Kloudz said:

Yep new files created today. My scheduler runs every two hours you can see where I did manual triggers a few times and nothing was happening

.list files has all the files that needs to be moved but were never moved. they're still in the zfs pool that I set as my 'cache' drives

DM sent. (Can you send me one of the Mover_Tuning log files?)

hugenbdd · August 24, 2023

3 hours ago, Robbie G78 said:

So, should I still just run that command and that fixes it?

No, you have the pointer needed.
Can you send me a few mover logs from /tmp/Mover in a DM

kizer · August 24, 2023

Running 2023.08.22

Is this solely a 6.12 problem or does it affect 6.11.5 as well? Some of us are still on older releases. 😃

I just clicked move in 6.11.5 and it seems to be moving files.

Then again some how my Move Now button follows plug-in filters: got changed to NO

So I don't know if that is helpful or not helpful at all.

Grrrrr, now files I purposely delayed are being moved to the array. Lol Next time I'll check my settings before clicking a button.

Swarles · August 25, 2023

On 8/23/2023 at 10:44 PM, Robbie G78 said:

The only way I was able to get the mover to start was by going into the share that I needed the files moved on and invoking "Move" from there. I don't think the schedule for mover is running either.

10 hours ago, Kloudz said:

I have this same issue, I triggered "Move" from the main screen and nothing happens.

Do either of you get the "mover: started...mover: finished" syslog?

Also, are either of you using the "Move now button follows plugin filters" set to yes?

Robbie G78: Being able to invoke the mover from the share is strange because it calls the mover in the same way that using the move button and the schedule does.

Just and FYI I am on 6.12.3 with Mover Tuning 2023.08.22 and both the schedule and move button working for me. Strange indeed.

Edited August 25, 2023 by Swarles

sourCream · August 25, 2023

7 hours ago, Swarles said:

Do either of you get the "mover: started...mover: finished" syslog?

Also, are either of you using the "Move now button follows plugin filters" set to yes?

Robbie G78: Being able to invoke the mover from the share is strange because it calls the mover in the same way that using the move button and the schedule does.

Just and FYI I am on 6.12.3 with Mover Tuning 2023.08.22 and both the schedule and move button working for me. Strange indeed.

Also having this same issue. I can invoke mover from the share page but cannot do so from the main page or the scheduler page. I have the "Move now button follows plugin filters" set to No.

I sent some logs and all my settings being used to hugenbdd.

What I have not tried is toggling the button filter to yes the back to no or removing and reinstalling the plugin.

wibble · August 25, 2023

2 hours ago, sourCream said:

What I have not tried is toggling the button filter to yes the back to no or removing and reinstalling the plugin.

I tried those, no effect.

Robbie G78 · August 25, 2023

I've never had to pull logs out of Unraid before. where are the instructions on how to do that????

Kloudz · August 25, 2023

3 hours ago, sourCream said:

Also having this same issue. I can invoke mover from the share page but cannot do so from the main page or the scheduler page. I have the "Move now button follows plugin filters" set to No.

I sent some logs and all my settings being used to hugenbdd.

What I have not tried is toggling the button filter to yes the back to no or removing and reinstalling the plugin.

I'm having this same issue, same issue as @Robbie G78.

Move button doesn't work from the Main screen and Scheduler. Scheduler is set to run every 2 hours

image.png.99a0a310ed5592c420e54195560ddf9b.png

But when triggering from the Shares screen. Here is a clip of telling me I kicked the mover from the share screen. Please don't mind the redaction:

image.png.bf4309b74d7ef9dfc0af1fb880b8800a.png

Kloudz · August 25, 2023

I removed the plugin and restarted my server. Added files to my cache drive then triggered Mover from Main screen and see that it's now working. I'm still playing around with it and waiting for Scheduler to kick off Mover in half an hour to see if it will move files.

I'll be back and let you all know if Mover is working when Scheduler triggers it.

Kloudz · August 25, 2023

33 minutes ago, Kloudz said:

I removed the plugin and restarted my server. Added files to my cache drive then triggered Mover from Main screen and see that it's now working. I'm still playing around with it and waiting for Scheduler to kick off Mover in half an hour to see if it will move files.

I'll be back and let you all know if Mover is working when Scheduler triggers it.

Confirmed, Mover is triggered and working when using Scheduler. This is without the Mover Tuning Plugin

Kloudz · August 25, 2023

Installed Mover Tuning Plugin again and Mover again is not working after triggering from the Main screen Uninstalling for now.

update, after uninstall, mover works again when triggered

Edited August 25, 2023 by Kloudz

hugenbdd · August 25, 2023

Swarles found a piece of code I changed that may be causing this Need a bit to revert and I'll post it here for someone to try before a release.

hugenbdd · August 25, 2023

Please try this file.

I have revered a few lines back to the old mover. Would be helpful if you had logging on.

} else {
//exec("echo 'Running from button' >> /var/log/syslog");
//Default "move now" button has been hit.
$niceLevel = $cfg['moverNice'] ?: "0";
$ioLevel = $cfg['moverIO'] ?: "-c 2 -n 0";
logger("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");
passthru("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");

mover.php

Kloudz · August 26, 2023

7 hours ago, hugenbdd said:

Please try this file.

I have revered a few lines back to the old mover. Would be helpful if you had logging on.

} else {
//exec("echo 'Running from button' >> /var/log/syslog");
//Default "move now" button has been hit.
$niceLevel = $cfg['moverNice'] ?: "0";
$ioLevel = $cfg['moverIO'] ?: "-c 2 -n 0";
logger("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");
passthru("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");

mover.php 6.94 kB · 1 download

I probably wont get to it today, migrating some of my cache pools to zfs

Robbie G78 · August 26, 2023

On 8/25/2023 at 1:23 PM, hugenbdd said:

Please try this file.

I have revered a few lines back to the old mover. Would be helpful if you had logging on.

} else {
//exec("echo 'Running from button' >> /var/log/syslog");
//Default "move now" button has been hit.
$niceLevel = $cfg['moverNice'] ?: "0";
$ioLevel = $cfg['moverIO'] ?: "-c 2 -n 0";
logger("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");
passthru("ionice $ioLevel nice -n $niceLevel /usr/local/sbin/mover.old $options");

mover.php 6.94 kB · 1 download

I replaced the file and it is working as it should be! I renamed the old mover.php to mover.php.old so if leaving the .old php file in there is a problem let me know and I will remove it.

Edited August 26, 2023 by Robbie G78
I figure it out

WWGT · August 28, 2023

I am trying to use mover tuning to let specific shares stay on the cache for 10 days.

If i set this in the global settings it works fine. Whenever i use the share override function and set it to 10 days (and disabled or 1 day in global settings) it gets ignored and starts moving all files anyway.

A fix for this would be helpfull. I'm on the latest unraid version.

As you can imagine I want documents to be moved "asap" and movies to stay > 1 week on the cache.

Possible this is only happening when clicking the Move button on the Main tab. Have not checked yet if it runs correctly with the cron job.

Edited August 28, 2023 by WWGT

Swarles · August 29, 2023

7 hours ago, WWGT said:

As you can imagine I want documents to be moved "asap" and movies to stay > 1 week on the cache.

This is primarily the behaviour the per-share settings were made for, so that is definitely possible

7 hours ago, WWGT said:

Possible this is only happening when clicking the Move button on the Main tab. Have not checked yet if it runs correctly with the cron job.

I'm glad you included this information as it may be your issue. The Move button on the Main tab ignores the Mover Tuning plugin by default. What you should do is ensure the "Move now button follows plugin filters" option in 'Settings>Scheduler>Mover Tuning' is set to "yes". This will use your mover tuning settings when manually hitting the run button.

On a side note, are you also on the latest Mover Tuning plugin update? It is interesting your mover tuning is working with the latest Unraid and moving all files, a lot of users have said it is no longer working for them. It's a strange divide. Hmm.

WWGT · August 29, 2023

17 hours ago, Swarles said:

This is primarily the behaviour the per-share settings were made for, so that is definitely possible

I'm glad you included this information as it may be your issue. The Move button on the Main tab ignores the Mover Tuning plugin by default. What you should do is ensure the "Move now button follows plugin filters" option in 'Settings>Scheduler>Mover Tuning' is set to "yes". This will use your mover tuning settings when manually hitting the run button.

On a side note, are you also on the latest Mover Tuning plugin update? It is interesting your mover tuning is working with the latest Unraid and moving all files, a lot of users have said it is no longer working for them. It's a strange divide. Hmm.

Oh I had that problem. Fix was reinstalling plugin and changing some settings, save and then revert settings. The config files were missing after install.

Also "Move now button follows plugin filters" was active, forgot to mention it.

knights_of_pine · September 1, 2023

6.12.3, plugin 2023.08.22.

i have the above problem. when i click the manual move now button it does not work. also moving tuner is not moving on the set schedule.

when i click move now log says:

shcmd (530893): /usr/local/sbin/mover &> /dev/null &

Edited September 1, 2023 by knights_of_pine

Chunks · September 1, 2023

I had the same issue where pressing the "move" button didn't do anything. If you go into the "Scheduler" page, under Settings, you can turn on "Mover - logging".

When i did that, and manually ran the mover by clicking the button, the system log clearly showed a bunch of file-not-found errors for a .cfg file. I'm afraid I didn't save the log, but since it was related to this plugin i just removed the plugin and then Mover started working again. This was on 6.11.5 but now I'm running 6.12.4 (I upgraded just after removing this plugin, I think anyway.... it was a long night).

TRaSH · September 1, 2023

I'm testing something new with this plugin
and trying to run a script after the mover tuning started
but somehow i get a error that it can't find the script.
Fastdrive = another nvme drive i'm using

```
Sep 1 19:46:58 root: Starting Mover
Sep 1 19:46:58 root: Forcing turbo write on
Sep 1 19:46:58 kernel: mdcmd (92): set md_write_method 1
Sep 1 19:46:58 kernel:
Sep 1 19:46:58 root: ionice -c 2 -n 7 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 10 0 0 '' '' '' "/mnt/fastdrive/userScripts/userScripts/mover-after.sh" yes 90 '' '' 30
Sep 1 19:46:58 root: Log Level: 1
Sep 1 19:46:58 root: mover: started
Sep 1 19:46:58 root: mover: finished
Sep 1 19:46:58 root: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 849: /mnt/fastdrive/userScripts/userScripts/mover-after.sh: cannot execute: required file not found
Sep 1 19:46:58 root: Restoring original turbo write mode
```

Solved: CRLF vs LF

Left it here for others if they run in to the same issue
image.png.1bcad6610530406da5e7b78d79fc49c4.png

Edited September 1, 2023 by TRaSH
wrong screenshot

rcarre · September 3, 2023

Feature request: in the per-share mover tuner settings, have the option to move all files from that share that are on the cache to the array if the share size on the cache exceeds a certain size, could be in bytes or percent (10% free, etc)

Edited September 3, 2023 by rcarre

Taddeusz · September 4, 2023

I get a bunch of this in my log and then mover gets stuck running:

Sep  4 11:17:16 unRAID move: /tmp/Mover Directory does not exist. Creating it
Sep  4 11:17:16 unRAID move: mover: started
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: cat: /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg: No such file or directory
Sep  4 11:17:16 unRAID move: /usr/local/emhttp/plugins/ca.mover.tuning/age_mover: line 684: [: 38: unary operator expected

[Plugin] Mover Tuning

Recommended Posts

Link to comment

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

Squid

hugenbdd

hugenbdd

Posted Images

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Join the conversation