Jump to content

yendi

Members
 View Profile  See their activity

  • Posts

    118

  • Joined

  • Last visited

 Content Type 

Posts posted by yendi

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    Sorry man, i'm French so my english is not perfect :D

     

    My original usage was everything on Unraid as everyone here, I made several test when the issue started to troubleshoot...

    I think that my issues started when I shrinked my array (using unbalance) as I had 44Tb before switching to rclone + gdrive and I didn't need all those drives anymore. Maybe the gathering process done by Unbalance created side effects on my unraid installation.

     

    So to explain the best possible way, I tried few things:

    1/ rclone mounted on unraid:

            a/ Plex on Unraid: some media do not play

            b/ Plex on a windows PC targeting the "/rclone_mount" or "/union" share (on unraid): some media do not play

            c/ "/rclone_mount" (on unraid) accessed via a windows PC: some media do not play (Explorer/VLC freeze)

            d/ copy of any file works and is playable in local...

     

    2/ rclone mounted on windows

            a/ Plex on windows: no issue

            b/ Playing any file directly from the mount: no issue

     

    I have formated my HDD and restored the USB stick as a new 6.6.7 and recreating my server as we speak.

    I have changed my cache drive as xfs (was btrfs) and hopefully it will work... I just have Rclone + scripts and plex installed. I let it create all libraries right now and will test it tonight. FINGER CROSSED !

     

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    Hey,

     

    I have a 1000/300 fiber. I have stopped every other docker than plex but I have to disagree, it's not related to plex:

    I cannot access in a reliable way media thru rclone unraid on windows, BUT i can access those files from rclone on Windows. For me it's a Rclone or Unraid problem. What do you guys think ?

     

    Rclone mount: 

    #!/bin/bash
#######  Check if script is already running  ##########
if [[ -f "/mnt/user/appdata/other/rclone/rclone_mount_running" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Exiting script already running."
exit
else
touch /mnt/user/appdata/other/rclone/rclone_mount_running
fi
#######  End Check if script already running  ##########
#######  Start rclone gdrive mount  ##########
# check if gdrive mount already created
if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs already mounted."
else
echo "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs."
# create directories for rclone mount and unionfs mount
mkdir -p /mnt/user/appdata/other/rclone
mkdir -p /mnt/user/mount_rclone/google_vfs
mkdir -p /mnt/user/mount_unionfs/google_vfs
mkdir -p /mnt/user/rclone_upload/google_vfs
rclone mount --allow-other --buffer-size 128M --dir-cache-time 72h --drive-chunk-size 512M --fast-list --log-level INFO --log-file /tmp/user.scripts/tmpScripts/rclone_mount/mount.log --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs &
# check if mount successful
# slight pause to give mount time to finalise
sleep 5
if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check rclone gdrive vfs mount success."
else
echo "$(date "+%d.%m.%Y %T") CRITICAL: rclone gdrive vfs mount failed - please check for problems."
rm /mnt/user/appdata/other/rclone/rclone_mount_running
exit
fi
fi
#######  End rclone gdrive mount  ##########
#######  Start unionfs mount   ##########
if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs already mounted."
else
unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs
if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted."
else
echo "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed."
rm /mnt/user/appdata/other/rclone/rclone_mount_running
exit
fi
fi
#######  End Mount unionfs   ##########
############### starting dockers that need unionfs mount ######################
# only start dockers once
if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: dockers already started"
else
touch /mnt/user/appdata/other/rclone/dockers_started
echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers."
docker start plex
docker start tautulli
docker start radarr
docker start sonarr
docker start ombi
docker start bazarr
docker start radarr-uhd-binhex
fi
############### end dockers that need unionfs mount ######################
exit

     

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    2 minutes ago, Kaizac said:

    No you don't need a new API, neither would it lose your data. Just create the new rclone mount. A little tip to be sure. When filling in your client ID and password, delete the laster number or letter of the string and type it in manually. Just to make sure there are no copy and pasting errors.

    I just tried, I even used an other rclone version (stable one this time, not the beta) and same issue. The mount is here but some media can be read other dont.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    1 minute ago, Kaizac said:

    Ok let's run through the basics first to be 100% sure.

     

    Did you get the latest Rclone version on your Unraid box?

    Create your Rclone mount freshly. So just delete it from the config and create it new. You don't have the recreate the crypt, just the mount. Then reboot without your dockers autostarting. Test it through windows explorer on the mount_rclone folder (so not the union folder).

    Do I need a new API and stuff ? If I change API and key, will I loose my data?

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    4 minutes ago, Kaizac said:

    Ok, so where do we stand now? Opening files through windows explorer all works? They all play? And only Plex now gives problems with sometimes playing and sometimes not?

    To sum up:

    On Unraid: 

    Plex: All local files plays, some remote plays, other don't (seems to be always the same)

    Windows explorer on the unraid rclone mount share: some remote files plays other dont. (seems to be always the same)

     

    On Windows:

    If I mount the same rclone share directly on windows (with rclone windows, without passing thru unraid) All files plays fine plex/explorer

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    7 minutes ago, Kaizac said:

    Try running Plex vanilla. So without the hardware acceleration and see if it runs then. Are you sure your Plex library is pointing to the right level of folder? When you go into your Plex library and you open a movie (not play it) do you see that everything is filled in correctly? And the linking is correct to the right folder and file?

    For the folder mapping, yes I am sure it is mapped correctly and plex SEE the file (it can analyse it and see subs included).

    Regarding Hardware transcoding, no luck, I just tried to deactivate and some media are playing, other not (remote). Crazy thing is that the same media is playing remotely with no issue and an other one is not. But I am able to open all media on a windows computer so it is not media related...

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    Just now, Kaizac said:

    Rclone stores it in your RAM, so that shouldn't be the R/W issue. I don't understand why you have that /dev/dri in your Plex template? I don't have it, so it's something you've added manually?

    Also why didn't you fill in the links to Movies and such? They should be pointing to your unionfs/Movies folder with r/w access.

    The dev/dri is for hardware acceleration. Regarding the /Movies and /TV i use an other variable the /rclone one that you can see at the bottom of the screenshot...

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    1 hour ago, Kaizac said:

    @yendican you post a screenshot of your Plex docker settings? Did you put the right folders as r/w slave? And what folders did you add to your Plex library? Did you disable all the analyzing stuff?

    image.thumb.png.284ce4c44fb5d7d4e571131ef9f43127.png

     

    Regarding the R/W I restored the "Safe Docker Permissions" but did not touch anything else. Maybe it could be the folder where the temporary movie is downloaded that has RW issues? I mean Rclone must be storing chunks somewhere when playing a media, maybe he is not able to do so ? Do you guys know where it could be ?

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    6 minutes ago, nuhll said:

    Didnt had a single issue (after i created my own api id).

     

    Only one thing i can think of, how you have your movies organzied?

     

    movies/moviename/files?

    or movies/moviename.file ?

    I have a very standard setup: 

    Radarr 1080p

    Radar UHD

    Sonarr

    Plex

    Ombi

    Tauttuli

     

    Organization:

      

    Root

-- 4k
---- Movie 4K 1 (YEAR)
------ File
---- Movie 4K 2 (YEAR)
------ File

-- Movies
---- Movie 1080p 1 (YEAR)
------ File
---- Movie 1080p 2 (YEAR)
------ File

--TV_Shows
etc...

--Other

     

    What makes me think it comes from UnRAID is that with the smae MOUNT command on a windows PC, same network and a brand new Plex server Windows I have no issue whatsover...

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    46 minutes ago, nuhll said:

    I have pretty much sonarr/radarr/plex standard, just deactivated the preview creation in plex (took too long)

     

    Never had any ban or issues to retrieve remote files... so far. I have around 3000+ movies and around 150 + series.

     

    How big is your database?

    I have about the same size of library, but I think I have idenfied the issue:

    As explained I have also the problem if I open a file on windows, from an UnRaid rclone share. I tried to mount the same share directly from unraid Windows and have no issues.

     

    Then to troubleshoot a bit better I installed a new Plex server on UnRaid and HAD the issue, I then installed a Plex server on Windows pointing on the rclone windows, and no issues.

     

    As my server is connected via ethernet I remove this from the equation, and I assume that there is some kind of issues on my unraid system/docker engine. I had few unclean shutdown because the docker engine was stuck so I am asking myself if it did not create some side effects issues, dunno...

    I have backed up everything that is not a media and will be format and clean reinstall unraid today (start from scratch and reinstall everything. I am thinking on keeping the appdata from all dockers except Plex, install them one by one if the issue is gone to immediately identify it if the issue reappears after reinstalling a docker), hopefully this will solve my issue.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    So it's not a API call issue as I have no problem uploading without any error. When I reach API limit I had a message in the upload saying API Rate limit exceed or something similar. 

    2019/09/15 19:34:29 DEBUG : gumkl37i63l70uc0ufklrjq3ic/jqdod4b7jtrggrjc7perjig6venga6g4jj8tl6dsvgr22e8r45qg/uf7cq92dioivmjp6m1lmvdnui69pattb328dev1376fp5s6fisrlckb4v8up65e6p696qm4hscs0pb0tgmp1vh88jo7fl4k84u5gc0ht7clpnc4gmru2kfuq0bnrhl4u: Sending chunk 15569256448 length 536870912
2019/09/15 19:34:39 INFO :
Transferred: 29.516G / 5.521 TBytes, 1%, 8.177 MBytes/s, ETA 1w1d3h38m21s
Errors: 0
Checks: 1446 / 1448, 100%
Transferred: 48 / 2562, 2%
Elapsed time: 1h1m36.4s
Checking:
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 18% /80.073G, 4.128M/s, 4h29m9s
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 30% /47.306G, 4.076M/s, 2h17m11s
Transferring:
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 18% /80.073G, 4.128M/s, 4h29m9s
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 30% /47.306G, 4.076M/s, 2h17m11s

2019/09/15 19:34:29 DEBUG : gumkl37i63l70uc0ufklrjq3ic/jqdod4b7jtrggrjc7perjig6venga6g4jj8tl6dsvgr22e8r45qg/uf7cq92dioivmjp6m1lmvdnui69pattb328dev1376fp5s6fisrlckb4v8up65e6p696qm4hscs0pb0tgmp1vh88jo7fl4k84u5gc0ht7clpnc4gmru2kfuq0bnrhl4u: Sending chunk 15569256448 length 536870912
2019/09/15 19:34:39 INFO :
Transferred: 29.516G / 5.521 TBytes, 1%, 8.177 MBytes/s, ETA 1w1d3h38m21s
Errors: 0
Checks: 1446 / 1448, 100%
Transferred: 48 / 2562, 2%
Elapsed time: 1h1m36.4s
Checking:
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 18% /80.073G, 4.128M/s, 4h29m9s
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 30% /47.306G, 4.076M/s, 2h17m11s
Transferring:
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 18% /80.073G, 4.128M/s, 4h29m9s
* 4k/xxxxxxxxx…ueHD.7.1.Atmos-FGT.mkv: 30% /47.306G, 4.076M/s, 2h17m11s

2019/09/15 19:34:46 DEBUG : gumkl37i63l70uc0ufklrjq3ic/ldkif04thouaso6v4mutn223f1t3p6sf6bt9ug9s8r9ivf36v6l0/f5bc12htqdevl3o3osg28mpp6ktobisoetrpcjvpmk2t5egv3ooj2ncmna68p1mm4mfl7aq3d6jrcuheui5m6qi20mju5o9ulqs6t2u1jsqv6g83dubm11vgil4als6g: Sending chunk 16106127360 length 536870912

     

    Here is what I have on plex when I try to start a remote movie: image.thumb.png.a026e907e97e42cfccddd0798fca5b2c.png

     

    I tried to create a new plex docker to do some tests (plex inc provider this time instead of linuxserver), here is my findings:

     

    I created 2 libraries: One pointing on rclone_upload (so all the pending uploads) and an other on the mount_rclone (so all the already uploaded files).

    Plex can parse both folders, local and remote and find the correct info from the media (Resolution, subtitles available etc) but is still unable to play remote content... 

     

    I dont understand how it can get metadata and file info and not be able to open the media...

     

    Crazy thing is that I am able _sometimes_ to open a remote file, I would say 10% of the time.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted · Edited by yendi

    [gdrive]
    type = drive
    clientXXXXXXXXXXXXhr.apps.googleusercontent.com
    client_secret = ycDVPT_WXXXXXXXXXX
    scope = drive
    token = {"access_token":"ya29.XXXXXX_6InM3eF6zcbSs39LJ4qYRbYgBU-XXXXXXXXXXX_3u5fRjPNAyu9FPoh6BHVsIBc16OXdLIVBjUfHSuoEZ6D0NIcY","token_type":"Bearer","refresh_token":"1/XXXXXXXXXXXXXXXX","expiry":"2019-09-15T11:04:49.004526138+02:00"}

    [gdrive_media_vfs]
    type = crypt
    remote = gdrive:crypt
    filename_encryption = standard
    directory_name_encryption = true
    password = XXXXXXXXX-a68Inf_HY_qUAy_
    password2 = CXXXXXXXX

     

     

    Im on mobile so difficult to clean the passWord and API but I added a bunch of XXX 
     

    there is no way to add a verbose mode to the RClone mount? To be able to identify if it’s api calls?

×
×
  • Create New...