May 3, 20197 yr Author On 5/2/2019 at 9:42 AM, DZMM said: I'm going to try and do a review of the github content this weekend as I haven't updated it for over 4 months now. I've fixed some errors in the mount and unmount scripts which might explain why some users were having problems re-mounting
May 3, 20197 yr Author On 5/2/2019 at 2:07 PM, francrouge said: here you go thx mount.txt 2.96 kB · 0 downloads unmount.txt 1.09 kB · 0 downloads sorry, @francrouge you were having the problem I just fixed. If the mount was successful it wasn't deleting the /mnt/user/appdata/other/rclone/rclone_mount_running file allowing a manual mount to be run, until the unmount script runs at array stop or start. I've removed this check altogether as it's not needed as the script automatically remounts only if the mountcheck file isn't there, which is the real check that needs doing. Here's your scripts: #!/bin/bash ####### Start rclone mounts ########## # create directories for rclone mount and unionfs mount mkdir -p /mnt/user/appdata/other/rclone mkdir -p /mnt/user/mount_rclone/google_vfs mkdir -p /mnt/user/mount_unionfs/google_vfs mkdir -p /mnt/user/rclone_upload/google_vfs ####### Start rclone gdrive mount ########## # check if gdrive mount already created if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs already mounted." else echo "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs." rclone mount --allow-other --buffer-size 512M --dir-cache-time 72h --drive-chunk-size 512M --fast-list --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs & # check if mount successful # slight pause to give mount time to finalise sleep 5 if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone gdrive vfs mount success." else echo "$(date "+%d.%m.%Y %T") CRITICAL: rclone gdrive vfs mount failed - please check for problems." exit fi fi ####### End rclone gdrive mount ########## ####### Start unionfs mount ########## if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs already mounted." else unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted." else echo "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed." exit fi fi ####### End Mount unionfs ########## ############### starting dockers that need unionfs mount ###################### # only start dockers once if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: dockers already started" else touch /mnt/user/appdata/other/rclone/dockers_started echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers." docker start PlexMediaServer docker start tautulli docker start binhex-sonarr docker start binhex-sickchill docker start binhex-jackett docker start binhex-delugevpn docker start binhex-krusader fi ############### end dockers that need unionfs mount ###################### exit #!/bin/bash # unmount to be safe fusermount -uz /mnt/user/mount_unionfs/google_vfs fusermount -uz /mnt/user/mount_rclone/google_vfs # Remove other dummy files if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then echo "upload file present - removing dummy file" rm /mnt/user/appdata/other/rclone/rclone_upload else echo "rclone upload already exited properly" fi if [[ -f "/mnt/user/appdata/other/rclone/rclone_cleanup" ]]; then echo "cleanup file present - removing dummy file" rm /mnt/user/appdata/other/rclone/rclone_cleanup else echo "cleanup already exited properly" fi if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then echo "removing dummy docker check file" rm /mnt/user/appdata/other/rclone/dockers_started else echo "docker run once already removed" fi exit Edited May 3, 20197 yr by DZMM
May 4, 20197 yr sorry, [mention=76071]francrouge[/mention] you were having the problem I just fixed. If the mount was successful it wasn't deleting the /mnt/user/appdata/other/rclone/rclone_mount_running file allowing a manual mount to be run, until the unmount script runs at array stop or start. I've removed this check altogether as it's not needed as the script automatically remounts only if the mountcheck file isn't there, which is the real check that needs doing. Here's your scripts: #!/bin/bash####### Start rclone mounts ########### create directories for rclone mount and unionfs mountmkdir -p /mnt/user/appdata/other/rclonemkdir -p /mnt/user/mount_rclone/google_vfsmkdir -p /mnt/user/mount_unionfs/google_vfsmkdir -p /mnt/user/rclone_upload/google_vfs####### Start rclone gdrive mount ########### check if gdrive mount already createdif [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; thenecho "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs already mounted."elseecho "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs."rclone mount --allow-other --buffer-size 512M --dir-cache-time 72h --drive-chunk-size 512M --fast-list --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs &# check if mount successful# slight pause to give mount time to finalisesleep 5if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; thenecho "$(date "+%d.%m.%Y %T") INFO: Check rclone gdrive vfs mount success."elseecho "$(date "+%d.%m.%Y %T") CRITICAL: rclone gdrive vfs mount failed - please check for problems."exitfifi####### End rclone gdrive mount ################# Start unionfs mount ##########if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; thenecho "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs already mounted."elseunionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfsif [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; thenecho "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted."elseecho "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed."exitfifi####### End Mount unionfs ######################### starting dockers that need unionfs mount ####################### only start dockers onceif [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; thenecho "$(date "+%d.%m.%Y %T") INFO: dockers already started"elsetouch /mnt/user/appdata/other/rclone/dockers_startedecho "$(date "+%d.%m.%Y %T") INFO: Starting dockers."docker start PlexMediaServerdocker start tautullidocker start binhex-sonarrdocker start binhex-sickchilldocker start binhex-jackettdocker start binhex-delugevpndocker start binhex-krusaderfi############### end dockers that need unionfs mount ######################exit #!/bin/bash# unmount to be safefusermount -uz /mnt/user/mount_unionfs/google_vfsfusermount -uz /mnt/user/mount_rclone/google_vfs# Remove other dummy filesif [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; thenecho "upload file present - removing dummy file"rm /mnt/user/appdata/other/rclone/rclone_uploadelseecho "rclone upload already exited properly"fiif [[ -f "/mnt/user/appdata/other/rclone/rclone_cleanup" ]]; thenecho "cleanup file present - removing dummy file"rm /mnt/user/appdata/other/rclone/rclone_cleanupelseecho "cleanup already exited properly"fiif [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; thenecho "removing dummy docker check file"rm /mnt/user/appdata/other/rclone/dockers_startedelseecho "docker run once already removed"fiexit Great :) thx i'm going to try it tonight Envoyé de mon Pixel 2 XL en utilisant Tapatalk
May 4, 20197 yr 2 hours ago, DZMM said: sorry, @francrouge you were having the problem I just fixed. If the mount was successful it wasn't deleting the /mnt/user/appdata/other/rclone/rclone_mount_running file allowing a manual mount to be run, until the unmount script runs at array stop or start. I've removed this check altogether as it's not needed as the script automatically remounts only if the mountcheck file isn't there, which is the real check that needs doing. Here's your scripts: #!/bin/bash ####### Start rclone mounts ########## # create directories for rclone mount and unionfs mount mkdir -p /mnt/user/appdata/other/rclone mkdir -p /mnt/user/mount_rclone/google_vfs mkdir -p /mnt/user/mount_unionfs/google_vfs mkdir -p /mnt/user/rclone_upload/google_vfs ####### Start rclone gdrive mount ########## # check if gdrive mount already created if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs already mounted." else echo "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs." rclone mount --allow-other --buffer-size 512M --dir-cache-time 72h --drive-chunk-size 512M --fast-list --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs & # check if mount successful # slight pause to give mount time to finalise sleep 5 if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone gdrive vfs mount success." else echo "$(date "+%d.%m.%Y %T") CRITICAL: rclone gdrive vfs mount failed - please check for problems." exit fi fi ####### End rclone gdrive mount ########## ####### Start unionfs mount ########## if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs already mounted." else unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted." else echo "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed." exit fi fi ####### End Mount unionfs ########## ############### starting dockers that need unionfs mount ###################### # only start dockers once if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: dockers already started" else touch /mnt/user/appdata/other/rclone/dockers_started echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers." docker start PlexMediaServer docker start tautulli docker start binhex-sonarr docker start binhex-sickchill docker start binhex-jackett docker start binhex-delugevpn docker start binhex-krusader fi ############### end dockers that need unionfs mount ###################### exit #!/bin/bash # unmount to be safe fusermount -uz /mnt/user/mount_unionfs/google_vfs fusermount -uz /mnt/user/mount_rclone/google_vfs # Remove other dummy files if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then echo "upload file present - removing dummy file" rm /mnt/user/appdata/other/rclone/rclone_upload else echo "rclone upload already exited properly" fi if [[ -f "/mnt/user/appdata/other/rclone/rclone_cleanup" ]]; then echo "cleanup file present - removing dummy file" rm /mnt/user/appdata/other/rclone/rclone_cleanup else echo "cleanup already exited properly" fi if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then echo "removing dummy docker check file" rm /mnt/user/appdata/other/rclone/dockers_started else echo "docker run once already removed" fi exit Can you tell me if the setting looks good for the cron job ? thx
May 4, 20197 yr Author 6 hours ago, francrouge said: Can you tell me if the setting looks good for the cron job ? thx Yes, although I'd do every 5 minutes personally and also run the unmount at array start so it runs if you have an unclean shutdown
May 4, 20197 yr Yes, although I'd do every 5 minutes personally and also run the unmount at array start so it runs if you have an unclean shutdownGood i will do that.Also just to let you know that it seem stable right now so a great thx for youre help !ThxEnvoyé de mon Pixel 2 XL en utilisant Tapatalk
May 4, 20197 yr 12 hours ago, DZMM said: Yes, although I'd do every 5 minutes personally and also run the unmount at array start so it runs if you have an unclean shutdown Hi again I got this error i can't mount the script. mkdir: cannot create directory '/mnt/user/mount_rclone/google_vfs': File exists 04.05.2019 16:35:01 INFO: mounting rclone vfs. 2019/05/04 16:35:04 Fatal error: Can not open: /mnt/user/mount_rclone/google_vfs: open /mnt/user/mount_rclone/google_vfs: transport endpoint is not connected 04.05.2019 16:35:06 CRITICAL: rclone gdrive vfs mount failed - please check for problems. Script Finished Sat, 04 May 2019 16:35:06 -0400
May 9, 20197 yr Hi, im trying to setup rclone with gdrive and tdrive without it being encrypted how do I do this as I don’t need gdrive_media_vfs and tdrive_media_vfs and without them your script does not work
May 9, 20197 yr Author 1 hour ago, Spoonsy1480 said: Hi, im trying to setup rclone with gdrive and tdrive without it being encrypted how do I do this as I don’t need gdrive_media_vfs and tdrive_media_vfs and without them your script does not work Just configure tdrive to not be a crypt and make it a direct mount of your google drive.
May 9, 20197 yr Author On 5/4/2019 at 9:39 PM, francrouge said: Hi again I got this error i can't mount the script. mkdir: cannot create directory '/mnt/user/mount_rclone/google_vfs': File exists 04.05.2019 16:35:01 INFO: mounting rclone vfs. 2019/05/04 16:35:04 Fatal error: Can not open: /mnt/user/mount_rclone/google_vfs: open /mnt/user/mount_rclone/google_vfs: transport endpoint is not connected 04.05.2019 16:35:06 CRITICAL: rclone gdrive vfs mount failed - please check for problems. Script Finished Sat, 04 May 2019 16:35:06 -0400 not sure what's happening, but try taking: mkdir -p /mnt/user/mount_rclone/google_vfs out of your mount script
May 9, 20197 yr 9 hours ago, DZMM said: Just configure tdrive to not be a crypt and make it a direct mount of your google drive. How do I direct mount it all my data is already on my tdrive, not worried about uploading as I have hetzner cloud server for that as my upload speed is poor. my tdrive already has folders on it, I would just like plex to play them from unRAID server Edited May 9, 20197 yr by Spoonsy1480
May 9, 20197 yr Author 9 hours ago, Spoonsy1480 said: How do I direct mount it all my data is already on my tdrive, not worried about uploading as I have hetzner cloud server for that as my upload speed is poor. my tdrive already has folders on it, I would just like plex to play them from unRAID server Can you post your rclone config (remember to take out any personal info e.g. passwords) and mount script please
May 10, 20197 yr gdrive] type = drive client_id = xxxxxxxxxxxxxx client_secret = xxxxxxxxxxx scope = drive token = {"access_token":"xxxxxxxx [tdrive] type = drive client_id = xxxxxxxxx client_secret = xxxxxxxxx scope = drive token = {"access_token xxxxxxxx team_drive = xxxxx
May 10, 20197 yr #!/bin/bash #---------------------------------------------------------------------------- #first section makes the folders for the mount in the /mnt/disks folder so docker containers can have access #there are 4 entries below as in the video i had 4 remotes amazon,dropbox, google and secure #you only need as many as what you need to mount for dockers or a network share mkdir -p /mnt/disks/tdrive mkdir -p /mnt/disks/gdrive #This section mounts the various cloud storage into the folders that were created above. rclone mount --max-read-ahead 1024k --allow-other tdrive: /mnt/disks/tdrive & rclone mount --max-read-ahead 1024k --allow-other gdrive: /mnt/disks/gdrive & I have modified the script from spaceinvader one to this and now it works thanks for your help Edited May 10, 20197 yr by Spoonsy1480
May 11, 20197 yr Hi Everyone Trying to set this up, i created the config and gdrives test fine. The next step in the guide says to: touch mountcheck When i do this i don't see anything created on my grives? Is this normal and OK to proceed with next steps or should i stop and figure out why i don't see anything. I get no errors when doing touch mountcheck it just returns to command line. Also what if any shares do i need to create in unraid before doing this or do the scripts do for me automagically? thanks Edited May 11, 20197 yr by Viperkc
May 11, 20197 yr Author On 5/10/2019 at 1:39 PM, Spoonsy1480 said: #!/bin/bash #---------------------------------------------------------------------------- #first section makes the folders for the mount in the /mnt/disks folder so docker containers can have access #there are 4 entries below as in the video i had 4 remotes amazon,dropbox, google and secure #you only need as many as what you need to mount for dockers or a network share mkdir -p /mnt/disks/tdrive mkdir -p /mnt/disks/gdrive #This section mounts the various cloud storage into the folders that were created above. rclone mount --max-read-ahead 1024k --allow-other tdrive: /mnt/disks/tdrive & rclone mount --max-read-ahead 1024k --allow-other gdrive: /mnt/disks/gdrive & I have modified the script from spaceinvader one to this and now it works thanks for your help Playback will be awful if you stream using a normal mount and you'll probably suffer from API bans
May 11, 20197 yr Author 43 minutes ago, Viperkc said: The next step in the guide says to: touch mountcheck When i do this i don't see anything created on my grives? The touch command creates a file - you need to run the next commands to copy it to the mounts: rclone copy mountcheck gdrive_media_vfs: -vv --no-traverse rclone copy mountcheck tdrive_media_vfs: -vv --no-traverse
May 12, 20197 yr New setup here working great so far thanks to your awesome scripts. And BIG thanks to Kaizac for his awesome help in getting me up and running. So i have one question, i am moving my library manually to the upload folder a little bit at a time, when the first batch was uploading i started to notice more files automatically showing up in the upload folder. I think this might be due to the --min-age 30m setting, but could be wrong. If that is causing it to auto move files can i remove it? until i get the manual part done? I also noticed when it did the move my files were not put in my media folders (IE: Movies and TV Shows) they were just dumped in the root folder on my gdrive. Thanks Edited May 12, 20197 yr by Viperkc
May 12, 20197 yr Author 5 hours ago, Viperkc said: New setup here working great so far thanks to your awesome scripts. And BIG thanks to Kaizac for his awesome help in getting me up and running. So i have one question, i am moving my library manually to the upload folder a little bit at a time, when the first batch was uploading i started to notice more files automatically showing up in the upload folder. I think this might be due to the --min-age 30m setting, but could be wrong. If that is causing it to auto move files can i remove it? until i get the manual part done? I also noticed when it did the move my files were not put in my media folders (IE: Movies and TV Shows) they were just dumped in the root folder on my gdrive. Thanks The scripts don't move files to the upload folder - you have to do that, or you've setup radarr to add new files to the mount. The min-age setting tells rclone not to move files from the upload folder to the mount that's younger than 30 mins.
May 12, 20197 yr Author Just now, DZMM said: I also noticed when it did the move my files were not put in my media folders (IE: Movies and TV Shows) they were just dumped in the root folder on my gdrive. You either need to put the files in the right subfolders in your upload folder, or your scripts aren't quite setup properly - post your upload script
May 12, 20197 yr Sorry i forgot to update. It was actually Radaar changing file dates randomly as it did a scan. There is a setting there that can turn that off and when i did it stopped moving things to my uploads folder. Regarding the not moving to folder problem that ended up being a typo in my upload script. All is working perfectly now. Thanks
May 13, 20197 yr On 5/9/2019 at 9:26 AM, DZMM said: not sure what's happening, but try taking: mkdir -p /mnt/user/mount_rclone/google_vfs out of your mount script Hi i think i might found the problem my ram was too high 98% and unraid killed the script. But since i cannot start the upload script. 13.05.2019 12:30:24 INFO: Exiting as script already running. Script Finished Mon, 13 May 2019 12:30:24 -0400 Full logs for this script are available at /tmp/user.scripts/tmpScripts/Upload - Rclone/log.txt #!/bin/bash ####### Check if script already running ########## if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Exiting as script already running." exit else touch /mnt/user/appdata/other/rclone/rclone_upload fi ####### End Check if script already running ########## ####### check if rclone installed ########## if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: rclone installed successfully - proceeding with upload." else echo "$(date "+%d.%m.%Y %T") INFO: rclone not installed - will try again later." rm /mnt/user/appdata/other/rclone/rclone_upload exit fi ####### end check if rclone installed ########## # move files rclone move /mnt/user/rclone_upload/google_vfs/ gdrive_media_vfs: -vv --drive-chunk-size 512M --checkers 3 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --bwlimit 9500k --tpslimit 3 --min-age 30m # remove dummy file rm /mnt/user/appdata/other/rclone/rclone_upload exit
May 13, 20197 yr Author 21 minutes ago, francrouge said: Hi i think i might found the problem my ram was too high 98% and unraid killed the script. But since i cannot start the upload script. 13.05.2019 12:30:24 INFO: Exiting as script already running. Script Finished Mon, 13 May 2019 12:30:24 -0400 Full logs for this script are available at /tmp/user.scripts/tmpScripts/Upload - Rclone/log.txt #!/bin/bash ####### Check if script already running ########## if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Exiting as script already running." exit else touch /mnt/user/appdata/other/rclone/rclone_upload fi ####### End Check if script already running ########## ####### check if rclone installed ########## if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: rclone installed successfully - proceeding with upload." else echo "$(date "+%d.%m.%Y %T") INFO: rclone not installed - will try again later." rm /mnt/user/appdata/other/rclone/rclone_upload exit fi ####### end check if rclone installed ########## # move files rclone move /mnt/user/rclone_upload/google_vfs/ gdrive_media_vfs: -vv --drive-chunk-size 512M --checkers 3 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --bwlimit 9500k --tpslimit 3 --min-age 30m # remove dummy file rm /mnt/user/appdata/other/rclone/rclone_upload exit Manually remove this file /mnt/user/appdata/other/rclone/rclone_upload It should get removed at array start/end depending on how you've setup your unmount script
May 15, 20197 yr I was having 429 Rate Limit Exceeded errors in my log. It was taking 20-30 seconds to access files. I found this thread on the RClone with other users having the same problem. The fix is to add the user-agent option to your mount script. I added this --user-agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36" which is the Chrome user-agent. This has fixed the problem for me. There are reports that you can choose any user agent you want and it will work.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.