Guide: How To Use Rclone To Mount Cloud Drives And Play Files

[NewDisplayName]

Ur too fast...

 

i was editing this at the moment u answered:

Also i would change your script so it only uplaods files older then e.g. 1 year, so i dont waste time uploading "bad movies".

 

I wonder if it would be possible to uploadonly  files to gdrive when 2 ips (local) are not reachable. So it doesnt interfer with other network activitys.

Edited November 7, 2018 by nuhll

[DZMM]

25 minutes ago, nuhll said:

Ur too fast...

 

i was editing this at the moment u answered:

Also i would change your script so it only uplaods files older then e.g. 1 year, so i dont waste time uploading "bad movies".

change --min-age 30m to --min-age 1y in the move script

 

26 minutes ago, nuhll said:

I wonder if it would be possible to uploadonly  files to gdrive when 2 ips (local) are not reachable. So it doesnt interfer with other network activitys.

Nope.  you could schedule your upload to run overnight and calculate an appropriate --max-transfer to ensure it finishes in the morning.

 

https://rclone.org/commands/rclone_move/

[NewDisplayName]

Yes, that wuld be the last way, but the thing is, even if i upload 24/7 it would take months/years to upload, and when i set a fixed hours per day, it would probably never finish before my unraid dies... XD

 

So a "if ping XXX = not reachable" -> do ur thing really a big difference in time.

 

If i pay u, could you code it? just a simple check if any of 2 local ips are reachable, if so, dont transfer, if not reachable, do transfer. maybe check every 5 min. and abort/resume accordingly (but i guess rsync handle that on itself)

Edited November 9, 2018 by nuhll

[NewDisplayName]

Okay, i startet playin with it, but i cant even login.

 

It says i should connect to 127.0.0.1 which is ofc not working. If i enter the unraid ip, it redirects me back to 127.0.0.1 which is ofc not working... how to login to gdrive?

 

Tried to install lynx but i get lynx: error while loading shared libraries: libidn.so.11: cannot open shared object file: No such file or directory

 

edit: ok im dumb, didnt saw that N option... 

 

Quote

 

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
touch: cannot touch '/mnt/user/appdata/other/rclone/rclone_mount_running': No such file or directory
10.11.2018 12:02:17 INFO: Check rclone vfs mount success.
fusermount: failed to unmount /mnt/user/mount_unionfs/google_vfs: Invalid argument

Failed to open /mnt/user/rclone_upload/google_vfs/: No such file or directory. Aborting!

10.11.2018 12:02:17 CRITICAL: unionfs Remount failed.
rm: cannot remove '/mnt/user/appdata/other/rclone/rclone_mount_running': No such file or directory
 

 

Okay im adding the mount thing:

 

I guess the problem is the rc ip addr, u say we should change it, but in your script its not there... ? i added it after mount "rclone mount --rc --rc-addr  192.168.86.2:5572"

 

But what ip is that? can it be local ip? does it need to be remote ip? Why not use local host (default?)

 

Solution:

you need to manually add directorys, i didnt read that in your post (or is it msising?)

For ip Adress im using my LAN IP adress of unraid.

 

root@Unraid-Server:~# mkdir /mnt/user/appdata/other
root@Unraid-Server:~# mkdir /mnt/user/appdata/other/rclone/
root@Unraid-Server:~# mkdir /mnt/user/rclone_upload/
root@Unraid-Server:~# mkdir /mnt/user/rclone_upload/google_vfs

 

Can you please check my picture if i understand it correct?

Edited November 10, 2018 by nuhll

[DZMM]

3 hours ago, nuhll said:

Solution:

you need to manually add directorys, i didnt read that in your post (or is it msising?)

It was missing - fixed

 

scripts look good - have you uploaded anything yet to test?

[NewDisplayName]

3 minutes ago, DZMM said:

It was missing - fixed

 

scripts look good - have you uploaded anything yet to test?

Ive added a movie under /mnt/user/mount_unionfs/Filme/ but it didnt upload, even after i pressed run script (rclone upload)

 

Seems like wrong directory, but i did like u wrote in post, so im confused what to do.

 

The test file tho seems to be transfered i found a file inside crypt directory on gdrive.

 

I would also suggest you add the rc-addr INSIDE YOUR LAN IP HERE into the script, so its more easy to find out that you need to change that.

Edited November 10, 2018 by nuhll

[DZMM]

post the logs from the upload script - did you wait 30 mins as it won't load anything newer than that

[NewDisplayName]

2 minutes ago, DZMM said:

post the logs from the upload script - did you wait 30 mins as it won't load anything newer than that

Quote

 

Script location: /tmp/user.scripts/tmpScripts/rclone upload/script
Note that closing this window will abort the execution of this script
10.11.2018 15:29:57 INFO: rclone installed successfully - proceeding with upload.
2018/11/10 15:29:57 DEBUG : --min-age 30m0s to 2018-11-10 14:59:57.940824115 +0100 CET m=-1799.994284176
2018/11/10 15:29:57 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "30m"]
2018/11/10 15:29:57 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2018/11/10 15:29:57 INFO : Starting bandwidth limiter at 9.277MBytes/s
2018/11/10 15:29:57 INFO : Starting HTTP transaction limiter: max 3 transactions/s with burst 1
2018/11/10 15:29:59 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for checks to finish
2018/11/10 15:29:59 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for transfers to finish
2018/11/10 15:29:59 INFO : 
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 1.4s

2018/11/10 15:29:59 DEBUG : 6 go routines active
2018/11/10 15:29:59 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" finishing with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "30m"]
 

 

 

Yeah it must be some hours now.

 

root@Unraid-Server:~# ls -l /mnt/user/mount_unionfs/Filme/moviename\ \(2015\).mkv
-rwxr-xr-x 1 root root 3135406858 Nov 10 12:44 /mnt/user/mount_unionfs/Filme/moviename\ (2015).mkv*

Edited November 10, 2018 by nuhll

[DZMM]

you need to add files to /mnt/user/mount_unionfs/google_vfs/Filme/ not /mnt/user/mount_unionfs/Filme/.  I created a sub-directory in /mnt/user/mount_unionfs for two reasons:

 

1 - might do other mounts in the future

2 - things seemed to go wrong when mounted at top-level

[NewDisplayName]

Ok, then i understand your instructions wrong, sorry, i thought i need to do it that way. 

Edited November 10, 2018 by nuhll

[NewDisplayName]

Okay, now it seems to do things, buit i gate google error?

 

Script location: /tmp/user.scripts/tmpScripts/rclone upload/script
Note that closing this window will abort the execution of this script
10.11.2018 15:37:27 INFO: rclone installed successfully - proceeding with upload.
2018/11/10 15:37:27 DEBUG : --min-age 30m0s to 2018-11-10 15:07:27.300550781 +0100 CET m=-1799.992295632
2018/11/10 15:37:27 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "30m"]
2018/11/10 15:37:27 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2018/11/10 15:37:27 INFO : Starting bandwidth limiter at 9.277MBytes/s
2018/11/10 15:37:27 INFO : Starting HTTP transaction limiter: max 3 transactions/s with burst 1
2018/11/10 15:37:29 DEBUG : Filme/Minions (2015).mkv: Excluded
2018/11/10 15:37:29 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for checks to finish
2018/11/10 15:37:29 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for transfers to finish
2018/11/10 15:37:29 DEBUG : Filme: Making directory
2018/11/10 15:37:29 DEBUG : Filme/Filme: Making directory
2018/11/10 15:37:30 DEBUG : pacer: Rate limited, sleeping for 1.982966287s (1 consecutive low level retries)
2018/11/10 15:37:30 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 15:37:30 DEBUG : pacer: Rate limited, sleeping for 2.300215383s (2 consecutive low level retries)
2018/11/10 15:37:30 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 15:37:32 DEBUG : pacer: Rate limited, sleeping for 4.269526966s (3 consecutive low level retries)
2018/11/10 15:37:32 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 15:37:34 DEBUG : pacer: Rate limited, sleeping for 8.799628569s (4 consecutive low level retries)
2018/11/10 15:37:34 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 15:37:39 DEBUG : pacer: Resetting sleep to minimum 10ms on success
2018/11/10 15:37:48 DEBUG : Encrypted drive 'gdrive_media_vfs:': copied 2 directories
2018/11/10 15:37:48 DEBUG : Filme/Filme: Removing directory
2018/11/10 15:37:48 DEBUG : Filme: Removing directory
2018/11/10 15:37:48 DEBUG : Filme: Failed to Rmdir: remove /mnt/user/rclone_upload/google_vfs/Filme: directory not empty
2018/11/10 15:37:48 DEBUG : Local file system at /mnt/user/rclone_upload/google_vfs: failed to delete 1 directories
2018/11/10 15:37:48 DEBUG : Local file system at /mnt/user/rclone_upload/google_vfs: deleted 1 directories
2018/11/10 15:37:48 INFO : 
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 21.2s

2018/11/10 15:37:48 DEBUG : 6 go routines active
2018/11/10 15:37:48 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" finishing with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "30m"]

[NewDisplayName]

Sorry, its now working, i forgot to change the modified thing. Its uploading now, but still get 403 google errors is this normal!?

[DZMM]

you're getting API errors which shouldn't be happening - I think you've created your rclone remotes wrong.  Post your rclone config - go to settings/rclone-beta to get it

[NewDisplayName]

[gdrive]
type = drive
scope = drive
token = {"access_token":"..."}

[gdrive_media_vfs]
type = crypt
remote = gdrive:crypt
filename_encryption = standard
directory_name_encryption = true
password = ...
password2 = ...
 

 

How would you transfer the files into the remote thing? I have currenlty one share added to unraid called "Archiv" which has all the "movies" directorys and so on...? (I would still like to keep that structure?!) Is that possible?

 

Btw im currenlty only on the free 15gb account, does that change anything!?

Edited November 10, 2018 by nuhll

[DZMM]

8 minutes ago, nuhll said:

[gdrive]
type = drive
scope = drive
token = {"access_token":"..."}

[gdrive_media_vfs]
type = crypt
remote = gdrive:crypt
filename_encryption = standard
directory_name_encryption = true
password = ...
password2 = ...
 

 

How would you transfer the files into the remote thing? I have currenlty one share added to unraid called "Archiv" which has all the "movies" and so on...? (I would still like to keep that structure?!)

Hmm all looks ok - maybe when you had the settings wrong something happened.

 

Just treat the unionfs mount like you would any other folder and just move files between shares using Krusader, mc etc.  You can copy direct to the rclone mount, but this isn't a good idea for large files as they will get copied straightaway and if they fail in anyway, the transfer will just give up - if the rclone move script has a problem (i.e. for files added to the unionfs mount), it will retry the file.

[NewDisplayName]

So secure way is adding it to /mnt/user/mount_unionfs/folder/ ? Bc then rclone handles everything!?

 

If i upload to rclone_upload its immediatly getting uploaded?

 

Is there any way i can keep my current file structure?

 

Is there anything other then chaning /mnt/user/mount_unionfs/ in your files to my currently share? I need to do? [and changing remote]

 

Did you thought about if you could help me with my little feature? If i woud pay for it? Check if 2 local ips are reachable, if so, dont upload, if not upload.

Edited November 10, 2018 by nuhll

[NewDisplayName]

Im confused, i wanna test upload and playback and such things.

 

I click mount script.

 

I click upload script.

 

I see it erroring and then transfering.

I stop upload.

 

I click unmount.

 

I click mount and it wont work...???

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
10.11.2018 22:53:44 INFO: mounting rclone vfs.
10.11.2018 22:53:44 CRITICAL: rclone_vfs mount failed - please check for problems.
2018/11/10 22:53:44 NOTICE: Serving remote control on http://192.168.86.2:5572/

If i manually touch the file you mentioned on first post, then mount works again....? What im doin wrong?

 

Really dont get it bc the file is there...

 

root@Unraid-Server:~# rclone copy mountcheck gdrive_media_vfs: -vv --no-traverse
2018/11/10 22:49:51 NOTICE: --no-traverse is obsolete and no longer needed - please remove
2018/11/10 22:49:51 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "copy" "mountcheck" "gdrive_media_vfs:" "-vv" "--no-traverse"]
2018/11/10 22:49:51 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2018/11/10 22:49:51 DEBUG : pacer: Rate limited, sleeping for 1.181963476s (1 consecutive low level retries)
2018/11/10 22:49:51 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:51 DEBUG : pacer: Rate limited, sleeping for 2.594804229s (2 consecutive low level retries)
2018/11/10 22:49:51 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:52 DEBUG : pacer: Rate limited, sleeping for 4.995846331s (3 consecutive low level retries)
2018/11/10 22:49:52 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:55 DEBUG : pacer: Rate limited, sleeping for 8.990207945s (4 consecutive low level retries)
2018/11/10 22:49:55 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:50:00 DEBUG : pacer: Resetting sleep to minimum 10ms on success
2018/11/10 22:50:10 DEBUG : mountcheck: Modification times differ by -10h59m11.287699484s: 2018-11-10 22:49:46.555699484 +0100 CET, 2018-11-10 10:50:35.268 +0000 UTC
2018/11/10 22:50:11 INFO  : mountcheck: Copied (replaced existing)
2018/11/10 22:50:11 INFO  :
Transferred:            32 / 32 Bytes, 100%, 1 Bytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            1 / 1, 100%
Elapsed time:       20.2s

BTW it seems like the APi Sleep time need to be 10ms, how to adjust this so i dont get these errors?

Edited November 10, 2018 by nuhll

[DZMM]

28 minutes ago, nuhll said:

So secure way is adding it to /mnt/user/mount_unionfs/folder/ ? Bc then rclone handles everything!?

 

If i upload to rclone_upload its immediatly getting uploaded?

if you add files to :

 

- mount_rclone: the file will get transferred immediately.  rclone isn't too smart about this, so if the transfer fails the file can get lost

- rclone_upload: the file will get moved using the rclone move script.  This is more intelligent and will retry files if there's a problem

- mount_unionfs: the file gets moved to the rclone_upload folder and gets moved as above

 

31 minutes ago, nuhll said:

Is there any way i can keep my current file structure?

- if you want to upload an existing folder, just substitute it for rclone_upload in the mount and upload scripts.

 

31 minutes ago, nuhll said:

Did you thought about if you could help me with my little feature? If i woud pay for it? Check if 2 local ips are reachable, if so, dont upload, if not upload.

Sorry, beyond my skill level

[DZMM]

15 minutes ago, nuhll said:

Im confused, i wanna test upload and playback and such things.

 

I click mount script.

 

I click upload script.

 

I see it erroring and then transfering.

I stop upload.

 

I click unmount.

 

I click mount and it wont work...???

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
10.11.2018 22:53:44 INFO: mounting rclone vfs.
10.11.2018 22:53:44 CRITICAL: rclone_vfs mount failed - please check for problems.
2018/11/10 22:53:44 NOTICE: Serving remote control on http://192.168.86.2:5572/

If i manually touch the file you mentioned on first post, then mount works again....? What im doin wrong?

 

Really dont get it bc the file is there...

 

root@Unraid-Server:~# rclone copy mountcheck gdrive_media_vfs: -vv --no-traverse
2018/11/10 22:49:51 NOTICE: --no-traverse is obsolete and no longer needed - please remove
2018/11/10 22:49:51 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "copy" "mountcheck" "gdrive_media_vfs:" "-vv" "--no-traverse"]
2018/11/10 22:49:51 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2018/11/10 22:49:51 DEBUG : pacer: Rate limited, sleeping for 1.181963476s (1 consecutive low level retries)
2018/11/10 22:49:51 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:51 DEBUG : pacer: Rate limited, sleeping for 2.594804229s (2 consecutive low level retries)
2018/11/10 22:49:51 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:52 DEBUG : pacer: Rate limited, sleeping for 4.995846331s (3 consecutive low level retries)
2018/11/10 22:49:52 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:49:55 DEBUG : pacer: Rate limited, sleeping for 8.990207945s (4 consecutive low level retries)
2018/11/10 22:49:55 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/10 22:50:00 DEBUG : pacer: Resetting sleep to minimum 10ms on success
2018/11/10 22:50:10 DEBUG : mountcheck: Modification times differ by -10h59m11.287699484s: 2018-11-10 22:49:46.555699484 +0100 CET, 2018-11-10 10:50:35.268 +0000 UTC
2018/11/10 22:50:11 INFO  : mountcheck: Copied (replaced existing)
2018/11/10 22:50:11 INFO  :
Transferred:            32 / 32 Bytes, 100%, 1 Bytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            1 / 1, 100%
Elapsed time:       20.2s

BTW it seems like the APi Sleep time need to be 10ms, how to adjust this so i dont get these errors?

rclone move works independently of the mount - you can run that script at any time if rclone is installed.

 

I'm struggling to understand how you're getting API errors as that normally only happens when you really hammer google or when you try to upload more than 750GB/day - given you've only got a handful of files up there, something must be wrong in your scripts.

 

Can you post your rclone config and your scripts and I'll have a look

[NewDisplayName]

I guess its limitation bc its a free account till now. I only try it atm with one file actually.

 

I unmount bc i cant restart upload bc its not "normal" ended bc i abort it. Bc if it doenst friendly exit, it doesnt delete that check file... ^^

Edited November 10, 2018 by nuhll

[NewDisplayName]

 

MOUNT:

 

#!/bin/bash

#######  Check if script already running  ##########

if [[ -f "/mnt/user/appdata/other/rclone/rclone_mount_running" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Exiting script already running."

exit

else

touch /mnt/user/appdata/other/rclone/rclone_mount_running

fi

#######  End Check if script already running  ##########

#######  Start rclone_vfs mounted  ##########

# create directories for rclone mount and unionfs mount

mkdir -p /mnt/user/mount_rclone/google_vfs
mkdir -p /mnt/user/mount_unionfs/google_vfs

# check if rclone mount already created

if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs mount success."

else

echo "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs."

rclone mount --rc --rc-addr=192.168.86.2:5572 --allow-other --buffer-size 64M --dir-cache-time 72h --drive-chunk-size 64M --fast-list --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs &

# check if mount successful

if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs mount success."

else

echo "$(date "+%d.%m.%Y %T") CRITICAL: rclone_vfs mount failed - please check for problems."

rm /mnt/user/appdata/other/rclone/rclone_mount_running

exit

fi

fi

#######  End rclone_vfs mount  ##########

#######  Start unionfs mount   ##########

if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted."

else

# Unmount before remounting to be safe

fusermount -uz /mnt/user/mount_unionfs/google_vfs

unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs

if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted."

else

echo "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed."

rm /mnt/user/appdata/other/rclone/rclone_mount_running

exit

fi

fi

#######  End Mount unionfs   ##########

############### starting dockers that need unionfs mount ######################

# only start dockers once

if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: dockers already started"

else

touch /mnt/user/appdata/other/rclone/dockers_started

echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers."

echo keine Docker gestartet

fi

############### end dockers that need unionfs mount ######################

# populate rclone dir-cache 

echo "$(date "+%d.%m.%Y %T") Info: populating dir cache - this could take a while."

rclone rc --timeout=1h vfs/refresh recursive=true

echo "$(date "+%d.%m.%Y %T") Info: populating dir cache complete."

rm /mnt/user/appdata/other/rclone/rclone_mount_running

exit

 

 

UPLOAD

 

 

#!/bin/bash

#######  Check if script already running  ##########

if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: Exiting as script already running."

exit

else

touch /mnt/user/appdata/other/rclone/rclone_upload

fi

#######  End Check if script already running  ##########

#######  check if rclone installed  ##########

if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then

echo "$(date "+%d.%m.%Y %T") INFO: rclone installed successfully - proceeding with upload."

else

echo "$(date "+%d.%m.%Y %T") INFO: rclone not installed - will try again later."

rm /mnt/user/appdata/other/rclone/rclone_upload

exit

fi

#######  end check if rclone installed  ##########

# move files

rclone move /mnt/user/rclone_upload/google_vfs/ gdrive_media_vfs: -vv --drive-chunk-size 64M --checkers 3 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~*  --delete-empty-src-dirs --fast-list --bwlimit 9500k --tpslimit 3 --min-age 3m 

# remove dummy file

rm /mnt/user/appdata/other/rclone/rclone_upload

exit

 

 

I cant mount anymore even if i manually touich and upload....

 

Could you maybe upload your scripts somewhere? It seems like if u copy out of forum its fugged up, github or something?

 

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
11.11.2018 00:37:30 INFO: mounting rclone vfs.
11.11.2018 00:37:30 CRITICAL: rclone_vfs mount failed - please check for problems.
2018/11/11 00:37:30 NOTICE: Serving remote control on http://192.168.86.2:5572/

 

 

 

 

Edited November 11, 2018 by nuhll

[DZMM]

29 minutes ago, nuhll said:

Could you maybe upload your scripts somewhere? It seems like if u copy out of forum its fugged up 

good idea - https://github.com/BinsonBuzz/unraid_rclone_mount

 

Spotted one difference in your scripts that maybe was created by me with the multiple cut & pastes - github definitely easier.  Delete the

 

rm /mnt/user/appdata/other/rclone/rclone_mount_running

 

at the end of the mount script

[NewDisplayName]

I dont know whats wrong. I removed all scripts and copied it from github, only chaning my ip and all MB and GB to 64MB (or M)

 

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
mkdir: cannot create directory '/mnt/user/mount_rclone/google_vfs': File exists
11.11.2018 01:45:04 INFO: mounting rclone vfs.
11.11.2018 01:45:04 CRITICAL: rclone_vfs mount failed - please check for problems.
2018/11/11 01:45:04 NOTICE: Serving remote control on http://192.168.86.2:5572/
2018/11/11 01:45:06 Fatal error: Can not open: /mnt/user/mount_rclone/google_vfs: open /mnt/user/mount_rclone/google_vfs: transport endpoint is not connected

But atleast im not getting any encoding errors now... ^^

 

After unmount, im getting now:

Script location: /tmp/user.scripts/tmpScripts/rclone mount/script
Note that closing this window will abort the execution of this script
11.11.2018 01:48:50 INFO: mounting rclone vfs.
11.11.2018 01:48:50 CRITICAL: rclone_vfs mount failed - please check for problems.
2018/11/11 01:48:50 NOTICE: Serving remote control on http://192.168.86.2:5572/

 

Even i removed all files from google drive and did:

 

root@Unraid-Server:~# touch mountcheck
root@Unraid-Server:~# rclone copy mountcheck gdrive_media_vfs: -vv --no-traverse
2018/11/11 01:47:55 NOTICE: --no-traverse is obsolete and no longer needed - please remove
2018/11/11 01:47:55 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "copy" "mountcheck" "gdrive_media_vfs:" "-vv" "--no-traverse"]
2018/11/11 01:47:55 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2018/11/11 01:47:55 DEBUG : pacer: Rate limited, sleeping for 1.286076833s (1 consecutive low level retries)
2018/11/11 01:47:55 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/11 01:47:55 DEBUG : pacer: Rate limited, sleeping for 2.490673565s (2 consecutive low level retries)
2018/11/11 01:47:55 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/11/11 01:47:57 DEBUG : pacer: Resetting sleep to minimum 10ms on success
2018/11/11 01:48:00 DEBUG : mountcheck: Couldn't find file - need to transfer
2018/11/11 01:48:03 INFO  : mountcheck: Copied (new)
2018/11/11 01:48:03 INFO  :
Transferred:            32 / 32 Bytes, 100%, 4 Bytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            1 / 1, 100%
Elapsed time:        7.6s

2018/11/11 01:48:03 DEBUG : 4 go routines active
2018/11/11 01:48:03 DEBUG : rclone: Version "v1.44-071-g9322f4ba-beta" finishing with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "copy" "mountcheck" "gdrive_media_vfs:" "-vv" "--no-traverse"]

 

 

root@Unraid-Server:~# ls -l /mnt/user/mount_rclone/google_vfs/mountcheck
/bin/ls: cannot access '/mnt/user/mount_rclone/google_vfs/mountcheck': No such file or directory

 

I didnt changed any folders bc i want to try if and how it works before i change anything...

Edited November 11, 2018 by nuhll

[DZMM]

not sure why, but your rclone mount is failing. 

 

In the mount command try removing '--rc' and at the end of the script, comment out the:

 

rclone rc --timeout=1h vfs/refresh recursive=true

Also, when you unmount manually check no files are left in /mnt/user/mount_rclone/google_vfs and /mnt/user/mount_unionfs/google_vfs as this will stop the initial mount working

[NewDisplayName]

22 minutes ago, DZMM said:

not sure why, but your rclone mount is failing. 

 

In the mount command try removing '--rc' and at the end of the script, comment out the:

 

rclone rc --timeout=1h vfs/refresh recursive=true

Also, when you unmount manually check no files are left in /mnt/user/mount_rclone/google_vfs and /mnt/user/mount_unionfs/google_vfs as this will stop the initial mount working

Sorry, now im completly confused. Didnt you said thats where i should put my files and point plex to? (/mnt/user/mount_unionfs/google_vfs)?

 

root@Unraid-Server:~# touch /mnt/user/mount_rclone/google_vfs/mountcheck
touch: failed to close '/mnt/user/mount_rclone/google_vfs/mountcheck': Operation not permitted

 

(i tried to manually add the file hes looking for)

Edited November 11, 2018 by nuhll