21 minutes ago, AgentXXL said:

Let me know if you need more info or clarification. Thanks!

 

i ll need some more Infos, may as background what the intention is and what the base should be ...

 

- Mediaserver will access /mnt/user/media/whatever

> now, underneath this plugins intention is to copy files from disk to ssd, so far so easy

> so while we are now accessing some Share, we always need a FUSE access so we have a cache > array (disks) access

> causewhen i copy and switch,for the Mediaserverits always /mnt/user/Media/whatever ... im deeper in proc filedescriptor  ...

> so, accessing your external Servers and running the plugins there should be even fine oob ...

> as far as there is always a /mnt/user/... access given with a cache > array setup on the remote servers

> sample, /mnt/addons/UnraidII/Media is actually /mnt/user/Unraid/Media/ locally (with a cache drive included)

 

let me think about it, i ll message you when i have some time to look at something like this

I switched just now to "multi" before I was trying the "only" mode for Media Server Mode:

 

with "multi" ist working like the old version

Edited January 11, 20251 yr by simatra

3 minutes ago, simatra said:

here we go 

ok, with this setup you shouldnt use Mediaserver setup ... good point, i ll add to infos, i ll add a function to "rewrite"

 

you have not a 1:1 setup, so you use /data as mountpoint in plex ...

 

so plex is reporting a path which doesnt exist in Servers point of view ...

 

update will come, for now, please disable multi or only, wont work, regular mode should work anyway on plex anytime.

6 minutes ago, alturismo said:

i ll need some more Infos, may as background what the intention is and what the base should be ...

 

- Mediaserver will access /mnt/user/media/whatever

> now, underneath this plugins intention is to copy files from disk to ssd, so far so easy

> so while we are now accessing some Share, we always need a FUSE access so we have a cache > array (disks) access

> causewhen i copy and switch,for the Mediaserverits always /mnt/user/Media/whatever ... im deeper in proc filedescriptor  ...

> so, accessing your external Servers and running the plugins there should be even fine oob ...

> as far as there is always a /mnt/user/... access given with a cache > array setup on the remote servers

> sample, /mnt/addons/UnraidII/Media is actually /mnt/user/Unraid/Media/ locally (with a cache drive included)

 

let me think about it, i ll message you when i have some time to look at something like this

OK, so I understood correctly - right now the plugin will only see the Media folder at /mnt/user/Media, not the folder at /mnt/addons/Media. /mnt/addons is used specifically by the UD plugin and is NOT merged by shfs with /mnt/user. When unRAID offers support for multiple arrays (as pools), I plan to migrate the mergerfs pool to them. As I have 56 data disks, my plan is to make 4 unRAID 'arrays', each with 1 parity disk and 14 data disks. Then all of the Media folders under those 4 arrays will all be merged by shfs.

Edited January 11, 20251 yr by AgentXXL

8 minutes ago, simatra said:

I switched just now to "multi" before I was trying the "only" mode for Media Server Mode:

 

thanks for the feedback !!! forgot that there are still users out there with /media or /data setups  my fault

4 minutes ago, AgentXXL said:

right now the plugin will only see the Media folder at /mnt/user/Media, not the folder at /mnt/addons/Media.

actually not, you "could" setup anything actually as its not bound in any way ... but its a matter of "the end"

 

the success feature is that the mediaserver will use the cached ssd file instead the array disk file ....

 

so, now for Plex, sample, a media file is located at /mnt/user/Media/movies/some movie/movie file.mkv, which is either a cached ssd (primary) or array disk (secondary) ... now, when i switch in background from lets say ../disk2/...file.mkv to ../cache/...file.mkv ... while playing it doesnt matter, file usage will switch and cache ssd will be used, now once you stop, pause, next episode, ... plex will again look at /mnt/user/Media/... and file should be now located on a cache ssd drive (promary) and also then we have a success ...

 

the plugin actually can move from > to anywhere, doesnt matter at all ... but the usage is the point, how can Plex as sample access the files from "somewhere" then and doesnt open the /mnt/user/... file, there is the point.

 

sample when i test here "wild", as you see ... also some pool disk ...

 

Jan 10 20:55:33 AlsServerII root: cache-mover: move / copy /mnt/disks/Samsung_SSD_950_PRO/Media/VCD/Atomic Blonde (2017)/ to /mnt/cache/Media/VCD/Atomic Blonde (2017)/

 

i ll get in contact with your point, but will need some time, 1st prio will be the rewrite ... will be something for your setup too

what kind of setup would be now state of the art? as I have a lot ongoing on the media folders like updating and syncing subtitles, converting to h265. I realy would like to use only copying the media that is used by plex to the cache.

1 minute ago, simatra said:

what kind of setup would be now state of the art?

a 1:1 mount ... then we dont have to rewrite, rethink pathes depening on point of view (host or docker)

 

sample

 

then we have a 1:1 plex or host

 

 

so /mnt/user/Media/... is the same on Host and Plex

 

your setup is Plex Point of view /data/..... so we have to rewrite always, no big deal, i already implemented this in my ffmpeg transcoding plugin ... even i dont need it anymore, but i also had /date or /media ages ago

 

if all is ok, update will come tomorrow

8 minutes ago, alturismo said:

if all is ok, update will come tomorrow

great thanks mate, I think I will do the 1:1 on next rebuild maybe during my next vacation days , but right now I do not have the patience.

 

1 hour ago, simatra said:

great thanks mate, I think I will do the 1:1 on next rebuild maybe during my next vacation days , but right now I do not have the patience.

 

would this be clear enough then ?

 

 

so, depending on your mountpoint, i assume something like this in your Plex setup

 

/data <> /mnt/user/Media

 

then you would add them like the blueprints ...

25 minutes ago, alturismo said:

sample when i test here "wild", as you see ... also some pool disk ...

 

Jan 10 20:55:33 AlsServerII root: cache-mover: move / copy /mnt/disks/Samsung_SSD_950_PRO/Media/VCD/Atomic Blonde (2017)/ to /mnt/cache/Media/VCD/Atomic Blonde (2017)/

 

i ll get in contact with your point, but will need some time, 1st prio will be the rewrite ... will be something for your setup too

 

Some more info that may be helpful:

 

As my unRAID array is full, I no longer use mover. So for example, the share Media has a primary of cache (4TB SSD pool) but no secondary storage. When Plex or JF on AnimMini access /mnt/remotes/AnimNAS_Media, it still sees any files at /mnt/cache/Media merged with /mnt/user0/Media. shfs is still merging the paths even though secondary storage is not set.

 

When adding new media, it goes direct to the cache pool. The mover tuning plugin was causing some issues so I now have it turned off (set 'Disable Mover running on a schedule:' to yes). There's been a fork of it and a new maintainer (Reynald) so I have installed it, but it's still disabled since the array is full. I now manually move new content from the `cache` pool to /mnt/addons/Media/<subfolder> where <subfolder> is Movies, TV, Music, etc.

 

For the mergerfs pool, there is no concept of primary vs secondary storage as /mnt/addons is not merged by shfs. I have added the /mnt/addons/Media/<subfolder>` path to my libraries, at /AllDisks/remotes/AnimDL_Media/<subfolder> as shown in this screenshot for the Movies library. The AllDisks path is an added container path mapped to /mnt on the host. I add the AllDisks path to any of my containers that need access to disks/shares.

 

 

The middle path (containing `PiranhaPlex`) is the subset of data I use for testing with the Plex instance on AnimNAS. This allows it to be used for testing as well as having the data indexed in the Plex instance I and my family use (on AnimMini). Similar is done for other libraries.

 

 

2 minutes ago, AgentXXL said:

The mover tuning plugin was causing some issues so I now have it turned off (set 'Disable Mover running on a schedule:' to yes).

im aware of that, thats why i fast wrote a "simple" one ...

 

in terms interested you can already install it manually, will come to CA as soon approved

https://raw.githubusercontent.com/alturismo/unraid-simple-mover/master/simple-mover.plg

 

and about your setup, im on that usecase (partly) already and there is a culprit (multi pool setup)

 

https://forums.plex.tv/t/same-mediafile-on-2-disk-sources-any-way-to-set-priority/899265/7

 

thanks for the infos

16 minutes ago, alturismo said:

im aware of that, thats why i fast wrote a "simple" one ...

 

in terms interested you can already install it manually, will come to CA as soon approved

https://raw.githubusercontent.com/alturismo/unraid-simple-mover/master/simple-mover.plg

 

and about your setup, im on that usecase (partly) already and there is a culprit (multi pool setup)

 

https://forums.plex.tv/t/same-mediafile-on-2-disk-sources-any-way-to-set-priority/899265/7

 

thanks for the infos

 

BTW - I tried to setup the plugin to see how it would work even though it could only do the content on the unRAID array. I have a full 28 data disks but could only enter disk1 through disk15 (seperated by spaces) in the Monitor Disks field. Is there a short form to include all disks, like using disk*?

1 minute ago, AgentXXL said:

Is there a short form to include all disks, like using disk*?

 actually not ... i ll extend the input field

 

but wouldnt be used on Mediaserver only mode anyhow

1 hour ago, simatra said:

great thanks mate, I think I will do the 1:1 on next rebuild maybe during my next vacation days , but right now I do not have the patience.

 

update pushed, couldnt test myself, let me know if it works, thanks.

3 hours ago, alturismo said:

would this be clear enough then ?

Yes this will work!

 

my Setup would be

Media Server mountpoint: /data

Media Server host path: /mnt/user/data/

2 hours ago, alturismo said:

update pushed, couldnt test myself, let me know if it works, thanks.

I updated to 2025.01.11a  but I can't see that fields

 

Edited January 11, 20251 yr by simatra

5 hours ago, simatra said:

I updated to 2025.01.11a  but I can't see that fields

 

on one of my test servers here

 

 

after update

 

 

may check in unraid console

 

cat /usr/local/emhttp/plugins/cache-mover/cache-mover.page | grep -i rewrite_source

 

when there is a return, its there ... may try refrshing browser

Version 2025.01.12 did the trick. It is working as intended. I'll keep you posted.

its copying now but I'm still getting this error:

Jan 12 10:10:38 Jarvis root: cache-mover: sent 10.79G bytes  received 950 bytes  9.67M bytes/sec
Jan 12 10:10:38 Jarvis root: cache-mover: total size is 10.81G  speedup is 1.00
Jan 12 10:10:38 Jarvis root: cache-mover: grep: Invalid range end

On 1/10/2025 at 8:07 PM, alturismo said:

with this, well, your cron entries are failed ...

 

yours
*/3****

correct would be with spaces
*/3 * * * *

 

and if it works or not, when you check the help page i pointed out upper, you can test your fans manually

 

replace hwmon, pwm... with yours and try in terminal ... but may just start with fixing your crons

 

Testing Fans in Unraids Terminal as sample
------------------------------------------------------------------------
1. activate OS Control for a Fan
------------------------------------------------------------------------
echo 1 > /sys/devices/platform/nct6775.672/hwmon/hwmon2/pwm7_enable
------------------------------------------------------------------------
Info, echo 1 > ... once done the fan is controlled only by OS
to return to BIOS Control, most likely a reboot is required
------------------------------------------------------------------------
2. set speed value for a Fan from 0 - 255
------------------------------------------------------------------------
echo 255 > /sys/devices/platform/nct6775.672/hwmon/hwmon2/pwm7
------------------------------------------------------------------------
Info, echo 0 - 255 > ... to check if pwm control is functional
while 0 is off and 255 is max
note your prefered min / max values for setup
------------------------------------------------------------------------
Fans which are adjustable can be setted up for HDD / CPU setup
------------------------------------------------------------------------

 

Thank you once again for your response and the effort you put into developing your plugins.

I feel like such a fool when it comes to the Cron formatting 🙈

4 hours ago, simatra said:

copying now but I'm still getting this error

may a screen from your settings and the log from start to end as quote here.

 

Shouldn't be a real fail, but I would like to know what ...

1 hour ago, alturismo said:

may a screen from your settings and the log from start to end as quote here.

 

Shouldn't be a real fail, but I would like to know what ...

here we go:

Jan 12 15:12:03 Jarvis root: cache-mover: move / copy /mnt/user0/data/movies/30 Days Max (2020)/ to /mnt/cache/data/movies/30 Days Max (2020)/
Jan 12 15:12:03 Jarvis root: cache-mover: sending incremental file list
Jan 12 15:12:03 Jarvis root: cache-mover: 
Jan 12 15:12:03 Jarvis root: cache-mover: sent 251 bytes  received 12 bytes  526.00 bytes/sec
Jan 12 15:12:03 Jarvis root: cache-mover: total size is 10.89G  speedup is 41,391,858.32
Jan 12 15:12:03 Jarvis root: cache-mover: grep: Invalid range end
Jan 12 15:22:02 Jarvis root: cache-mover: move / copy /mnt/user0/data/movies/30 Days Max (2020)/ to /mnt/cache/data/movies/30 Days Max (2020)/
Jan 12 15:22:02 Jarvis root: cache-mover: sending incremental file list
Jan 12 15:22:02 Jarvis root: cache-mover: 
Jan 12 15:22:02 Jarvis root: cache-mover: sent 251 bytes  received 12 bytes  526.00 bytes/sec
Jan 12 15:22:02 Jarvis root: cache-mover: total size is 10.89G  speedup is 41,391,858.32
Jan 12 15:22:02 Jarvis root: cache-mover: grep: Invalid range end
Jan 12 15:32:03 Jarvis root: cache-mover: move / copy /mnt/user0/data/movies/30 Days Max (2020)/ to /mnt/cache/data/movies/30 Days Max (2020)/
Jan 12 15:32:03 Jarvis root: cache-mover: sending incremental file list
Jan 12 15:32:03 Jarvis root: cache-mover: 
Jan 12 15:32:03 Jarvis root: cache-mover: sent 251 bytes  received 12 bytes  526.00 bytes/sec
Jan 12 15:32:03 Jarvis root: cache-mover: total size is 10.89G  speedup is 41,391,858.32
Jan 12 15:32:03 Jarvis root: cache-mover: grep: Invalid range end

 

Heyho - i did find an issue with the way you grep non existing folders for your exclusion-file. I raised an issue inside of Github for it => https://github.com/alturismo/unraid-cache-mover/issues/1

54 minutes ago, stefan_s said:

i did find an issue with the way you grep non existing folders for your exclusion-file.

well, i say thanks for pointing it out ... but you probably dont want to know my oppinion about special characters ... and wonder about issues on post processing in other applications ... wonder why ppl still doing such things, no offense, still many out there, i tested through all Plex rules including their schema and there are no brackets so i missed that.

 

thanks for the feedback and the open issue, will be also fixed but not today