Everything posted by Reynald
-
[Plugin] Mover Tuning
Because there are activity I installed it with the URL Yes, and in the logs you should see: mvlogger "Launching before script: (path of the script)" mvlogger "Before script finished"
-
[Plugin] Mover Tuning
2024.08.10: Better filtering with ctime=no (R3yn4ld) Shall solve escaping special characters. Improved Synchronization (R3yn4ld): Improve synchronization by looking for files on cache first Do not count synchronized files twice (freeing/priming target were half achieved) Optimize Filtering File and Decision loops regarding Rebalance and Synchronize Moved test mode on top of Mover Tuning Page Add check for primary storage not existing (dust config files) I think I covered everything and everyone since previous version, except the bc thing
-
[Plugin] Mover Tuning
I was working on your recommendation until I see that a new version of NerdTools is alive, maintained, and working: gravityfargo/unRAID-NerdTools: Install extra packages for advanced users. (github.com) I will then use the NerTools mechanism to propose to install bc. I don't want to develop a package manager function in Mover Tuning as it's not the objective (while it's as easy as a wget package, put in extra, and install but I don't want the hassle of managing updates) Any documented guidance to a cleaner solution will be welcomed
-
[Plugin] Mover Tuning
That's a good point. I went a bit far away from original mover tuning plugin and it probably worth it. There are some specific use case that are not completely working (dirty config files, config without array, or something we don't have time to investigate yet) I've honestly thought about naming this Mover Tuning V2 or beta, but in the beginning we worked together with Hugenbdd and Swarles. @alturismo what do you think please ? If we decide a split would you help me moving relative posts in a new thread I would create ? Or finally, as 2023 version is not maintained anymore we can stay here ? I don't mind in any case, my goal is to bring a functional plugin to the community..
-
[Plugin] Mover Tuning
Very nice analyse @ZGief, and thanks for complements @alturismo There is already a check on line 494: if [ ! -d "$SHAREPATH" ] && [ $SHAREUSECACHE != "no" ]; then # Do not process this pool if path does not exist mvlogger "$SHAREPATH does not exist. Is the share still used? Consider removing $SHARECFG if not." mvlogger "=> Skipping" continue # Move to the next iteration of the loop However, this adress a deleted or removed share, but deleted or renamed pool is not checked. Is your cachepool still named cache? (that's in your domains.cfg) You can modify the code like this, around line 438 PRIMARYSTORAGENAME=$(grep "shareCachePool=" "$SHARECFG" | cut -d'=' -f 2 | tr -d '"' | tr -d '\r') if [ -z "$PRIMARYSTORAGENAME" ]; then PRIMARYSTORAGENAME="user0" fi # Check if the storage exists if [ ! -d "$PRIMARYSTORAGENAME" ]; then # Do not process this pool if path does not exist mvlogger "$PRIMARYSTORAGENAME does not exist. Is the pool still used? Consider removing $SHARECFG if not." mvlogger "=> Skipping" continue # Move to the next iteration of the loop fi I'm going to add this in next version
-
[Plugin] Mover Tuning
Yes, you got it ! In your log, the error: df: /mnt/cache: No such file or directory is relative to the else. Now we need to understand why $PRIMARYSTORAGENAME is cache/ instead of cache/domains. Can you please check if domains folder is present in cache?
-
[Plugin] Mover Tuning
OK @ZGiefthank you. It's then something about your options (I admit I've never tested with age=no and no other filters). I will do some tests reproducing your configuration. Also, your test mode is set to yes, that does not explain the errors but explain why files are not moved
-
[Plugin] Mover Tuning
*0/100 is strange, I would expect 70/100 and 20/100. Do you have a share setting override?
-
[Plugin] Mover Tuning
Ok, that's what I expected. I will modify checking function to accommodate that.
-
[Plugin] Mover Tuning
I'll investigate, I did my best on escaping, but here, it's a command which call a program which call a program. It shall be fine if you use ctime Yes however
-
[Plugin] Mover Tuning
Thanks for your comment. Is it still not moving anything or was it test mode? Good point for bc. Anyway, as unraid 7 is based on slackware 15, as recent 6.x versions, I don't see a problem (I myself choose to continue using nerdpack as long as repo is alive), but yes, I will definitly think about this point I will move the option on top in second position, that makes sense . I will also remove this default when the plugin will be stable enough, I've completly rewritten some part and I consider that it's safer to check in test mode, before going live, at the moment.
-
[Plugin] Mover Tuning
Hummm, OK, I will investigate. Can you please: post the result of this command in terminal: ls /boot/config/pools/*.cfg | wc -l
-
[Plugin] Mover Tuning
2024.08.07.0858 Fix bug introduced by "Allow operation without array if multiple pools" preventing mover to run if less than 2 pools installed. Allow operation without array if multiple pools [R3yn4ld]. Unraid 7.0.0.beta2 may be required for this to work (6.x gui might not allow to have pool as Primary and Secondary) Add cleanup empty folder function[R3yn4ld]
-
[Plugin] Mover Tuning
Sorry guys I was sleeping and couldn't correct the bug earlier. Oups, the error is due to the new possibility to run without array. Pushing a patch in a few minutes
-
[Plugin] Mover Tuning
2024-08-07 Allow operation without array if multiple pools (R3yn4ld) Unraid 7.0.0.beta2 may be required for this to work (6.x gui might not allow to have pool as Primary and Secondary) (cc @ramjam824 please test and report :)) Add cleanup empty folder function (R3yn4ld): Will delete empty folder if file have been moved (cc @RonneBlaze)
-
[Plugin] Mover Tuning
There is no cleaning function yet, I'm going to add it (if you wanna wait a little before cleaning, so you can report if it works) I will also relax starting verification for those like @ramjam824 who don't have an array but raid pool instead. Coming soon
-
[Plugin] Mover Tuning
I'm not yet used with file filtering, it is still the same code for this part as the outdated version you use. Anyway, to get the latest plugin, follow the link in my signature: where it says: "I take over CA Mover Tuning. "
-
[Plugin] Mover Tuning
2024.08.06.0813 Bug fixes (R3yn4ld): Resynchronize not working for share below moving threshold. Internal mover moving files from Secondary to Primary instead of syncing (you may Resynchronize to correct the effect) 2024.08.06.0255 Added Resynchronize all Primary files to Secondary option (R3yn4ld): Resynchronize all Primary files to Secondary. This will resynchronize the Primary (cached) files on both Primary and Secondary (array) so they are backed up and parity protected. All files will be synchronized again independently of modification time. This can be a long operation. Run-once setting will reset back to No after next run Minor bug fixes and improvements (R3yn4ld)
-
[Plugin] Mover Tuning
Of course it is However it's not the same bug because now (lack of) configuration shall be handled correctly. Found the cause, it's about the new RESYNCHRONIZECACHE option. I forgot a space in the code (see on Github). Bug effect: resynchronize Primary->Secondary option won't work for share that does not met moving threshold. Error will be corrected in next version.
-
[Plugin] Mover Tuning
2024-08-06 Added Resynchronize all Primary files to Secondary option (R3yn4ld): Resynchronize all Primary files to Secondary. This will resynchronize the Primary (cached) files on both Primary and Secondary (array) so they are backed up and parity protected. All files will be synchronized again independently of modification time. This can be a long operation. Run-once setting will reset back to No after next run Minor bug fixes and improvements (R3yn4ld)
-
[Plugin] Mover Tuning
New version: 2024.08.05.2004 Rebalance shares: Enhance previous "Repair Primary" option. Renamed it "Rebalance shares". This will move files from shares to their primary and secondary storage if spread elsewhere. May imply moving older files from Primary->Secondary or Secondary->Primary if allowed (cache:prefer or cache:yes) to free some space. Note: "Run-once" is a writting error in the setting, it is meant to be "yes" Bug fixes Normaly freeingThreshold="" bug is gone
-
[Plugin] Mover Tuning
Great thank you (well, not the crash, but the empty parameters). And thanks for report. I'm not sure about that the way I'm handling these new parameters in the plugin installation/updating script then: ca.mover.tuning/plugins/ca.mover.tuning.plg at 2024-08-04-release2 · R3yn4ld/ca.mover.tuning (github.com) Maybee $old_tresh value is not correctly interpreted during update. I've added error control in age_mover script and will rework installation script.
-
[Plugin] Mover Tuning
OK thanks, I will add something in plugin installation script. In the mean time, to solve the bug, just change and apply this setting: (edit: I realize help text contain a mistake, I will change to "Set to the amount of disk space used on the Primary (cache) drive after the mover ran.")
-
[Plugin] Mover Tuning
Hi, I thought I fixed this bug, but the solution seems not working for everyone Can you please share /boot/config/plugins/ca.mover.tuning/ca.mover.tuning.cfg
-
[Plugin] Mover Tuning
Oups, almost forgot to announce: 2024.08.04.2112 Unraid 7.0.0 beta2 Secondary storage Compatibility (R3yn4ld) minor enhancements (6.12 mover action naming) and... can now move between pools (tested on 7.0.0-beta2) ! Fix find not ignoring hidden files (R3yn4ld) (Thanks to helpful-tune3401) 2024-08-04.0054: Fix default Settings handling causing a "Unary operator" bug (R3yn4ld) (thanks to Alturismo) Add freeing threshold option (R3yn4ld) This one is a big one, bringing pool to pool moving. I ran it all the day. Please test in test mode, check /tmp/ca.mover.tuning/Mover_action_xxx.list