KeyBoardDabbler

#!/bin/bash ####### Check if script already running ########## if [[ -f "/mnt/user/appdata/other/rclone/rclone_upload" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Exiting as script already running." exit else touch /mnt/user/appdata/other/rclone/rclone_upload fi ####### End Check if script already running ########## ####### check if rclone installed ########## if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: rclone installed successfully - proceeding with upload." else echo "$(date "+%d.%m.%Y %T") INFO: rclone not installed - will try again later." rm /mnt/user/appdata/other/rclone/rclone_upload exit fi ####### end check if rclone installed ########## # move files rclone move /mnt/user/rclone_upload/google_vfs/ gdrive_media_vfs: -vv --drive-chunk-size 512M --checkers 3 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --bwlimit 9500k --tpslimit 3 --min-age 5m # remove dummy file rm /mnt/user/appdata/other/rclone/rclone_upload exit Just the default script for now, nothing has showed up in any of my mounted drives or in GD and there is no trace of the deleted folders Just tried in the rclone_upload and the same thing happened Script Starting Mon, 30 Dec 2019 23:31:10 +1300 Full logs for this script are available at /tmp/user.scripts/tmpScripts/rClone_Upload/log.txt 30.12.2019 23:31:10 INFO: rclone installed successfully - proceeding with upload. 2019/12/30 23:31:10 DEBUG : --min-age 1m0s to 2019-12-30 23:30:10.886125095 +1300 NZDT m=-59.989107918 2019/12/30 23:31:10 DEBUG : rclone: Version "v1.50.2-094-g207474ab-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "1m"] 2019/12/30 23:31:10 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf" 2019/12/30 23:31:10 INFO : Starting bandwidth limiter at 9.277MBytes/s 2019/12/30 23:31:10 INFO : Starting HTTP transaction limiter: max 3 transactions/s with burst 1 2019/12/30 23:31:13 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for checks to finish 2019/12/30 23:31:13 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for transfers to finish 2019/12/30 23:31:13 DEBUG : GD - TV: Removing directory 2019/12/30 23:31:13 DEBUG : GD - Music: Removing directory 2019/12/30 23:31:13 DEBUG : GD - Movies: Removing directory 2019/12/30 23:31:13 DEBUG : Local file system at /mnt/user/rclone_upload/google_vfs/: deleted 3 directories 2019/12/30 23:31:13 INFO : Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA - Elapsed time: 0s 2019/12/30 23:31:13 DEBUG : 9 go routines active 2019/12/30 23:31:13 DEBUG : rclone: Version "v1.50.2-094-g207474ab-beta" finishing with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "1m"] Script Finished Mon, 30 Dec 2019 23:31:13 +1300 Full logs for this script are available at /tmp/user.scripts/tmpScripts/rClone_Upload/log.txt Will it be because of the below line in the upload script; --delete-empty-src-dirs EDIT Seems to be working now, it is because i had empty folders. Again thanks for all your help

That is what i thought, Second time i have tried now and both times it clears the main dir. In mount_unionfs/google_vfs/ i created some subfolders. Waited 5min and ran the upload script. It seems to just delete them? Should i not see the folder in my GD, ready to move files in Script Starting Mon, 30 Dec 2019 23:05:22 +1300 Full logs for this script are available at /tmp/user.scripts/tmpScripts/rClone_Upload/log.txt 30.12.2019 23:05:22 INFO: rclone installed successfully - proceeding with upload. 2019/12/30 23:05:22 DEBUG : --min-age 5m0s to 2019-12-30 23:00:22.231062207 +1300 NZDT m=-299.989311656 2019/12/30 23:05:22 DEBUG : rclone: Version "v1.50.2-094-g207474ab-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "5m"] 2019/12/30 23:05:22 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf" 2019/12/30 23:05:22 INFO : Starting bandwidth limiter at 9.277MBytes/s 2019/12/30 23:05:22 INFO : Starting HTTP transaction limiter: max 3 transactions/s with burst 1 2019/12/30 23:05:24 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for checks to finish 2019/12/30 23:05:24 INFO : Encrypted drive 'gdrive_media_vfs:': Waiting for transfers to finish 2019/12/30 23:05:24 DEBUG : GD - TV/TV - Comic Book: Removing directory 2019/12/30 23:05:24 DEBUG : GD - TV: Removing directory 2019/12/30 23:05:24 DEBUG : GD - Music: Removing directory 2019/12/30 23:05:24 DEBUG : GD - Movies: Removing directory 2019/12/30 23:05:24 DEBUG : Local file system at /mnt/user/rclone_upload/google_vfs/: deleted 4 directories 2019/12/30 23:05:24 INFO : Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA - Elapsed time: 0s 2019/12/30 23:05:24 DEBUG : 8 go routines active 2019/12/30 23:05:24 DEBUG : rclone: Version "v1.50.2-094-g207474ab-beta" finishing with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "move" "/mnt/user/rclone_upload/google_vfs/" "gdrive_media_vfs:" "-vv" "--drive-chunk-size" "512M" "--checkers" "3" "--fast-list" "--transfers" "2" "--exclude" ".unionfs/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--delete-empty-src-dirs" "--fast-list" "--bwlimit" "9500k" "--tpslimit" "3" "--min-age" "5m"] Script Finished Mon, 30 Dec 2019 23:05:24 +1300 Full logs for this script are available at /tmp/user.scripts/tmpScripts/rClone_Upload/log.txt

I did do the step first time around until it stopped working. I have just repeated step 2 and now it mounted and working again, maybe i deleted it? Just to confirm what folder should i create sub folders in and manually drop media files in to start uploading to GD? is it mount_rclone? I did it in mount_unionfs first time around and the upload script deleted them all Thankyou for your help, all the best going into the New Year

My mount script is taken from the github. Also yes it is completly empty, i deleted it to make sure and had the script re create the dir. [gdrive] type = drive client_id = *** client_secret = *** scope = drive token = {"access_token":""} root_folder_id = *** [gdrive_media_vfs] type = crypt remote = gdrive:crypt filename_encryption = standard directory_name_encryption = true password = *** password2 = *** #!/bin/bash ####### Check if script is already running ########## if [[ -f "/mnt/user/appdata/other/rclone/rclone_mount_running" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Exiting script already running." exit else touch /mnt/user/appdata/other/rclone/rclone_mount_running fi ####### End Check if script already running ########## ####### Start rclone gdrive mount ########## # check if gdrive mount already created if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone vfs already mounted." else echo "$(date "+%d.%m.%Y %T") INFO: mounting rclone vfs." # create directories for rclone mount and unionfs mount mkdir -p /mnt/user/appdata/other/rclone mkdir -p /mnt/user/mount_rclone/google_vfs mkdir -p /mnt/user/mount_unionfs/google_vfs mkdir -p /mnt/user/rclone_upload/google_vfs rclone mount --allow-other --buffer-size 256M --dir-cache-time 72h --drive-chunk-size 512M --fast-list --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off gdrive_media_vfs: /mnt/user/mount_rclone/google_vfs & # check if mount successful # slight pause to give mount time to finalise sleep 5 if [[ -f "/mnt/user/mount_rclone/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check rclone gdrive vfs mount success." else echo "$(date "+%d.%m.%Y %T") CRITICAL: rclone gdrive vfs mount failed - please check for problems." rm /mnt/user/appdata/other/rclone/rclone_mount_running exit fi fi ####### End rclone gdrive mount ########## ####### Start unionfs mount ########## if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs already mounted." else unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs if [[ -f "/mnt/user/mount_unionfs/google_vfs/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Check successful, unionfs mounted." else echo "$(date "+%d.%m.%Y %T") CRITICAL: unionfs Remount failed." rm /mnt/user/appdata/other/rclone/rclone_mount_running exit fi fi ####### End Mount unionfs ########## ############### starting dockers that need unionfs mount ###################### # only start dockers once if [[ -f "/mnt/user/appdata/other/rclone/dockers_started" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: dockers already started" else touch /mnt/user/appdata/other/rclone/dockers_started echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers." docker start plex docker start ombi docker start tautulli docker start radarr docker start sonarr fi ############### end dockers that need unionfs mount ###################### exit

Thank you for making this guide and supplying the user scripts. Setup was straight forward and i had it working for 2 hours while i tested individual files, everything was encrypted and uploading to my drive. I must of done something wrong though, I decided that i should start bulk uploading my content that i wanted to be stored on GD account. First i started by testing and creating the directory folders within mount_unionfs/google_vfs. Upload script ran and it deleted all the directories that i just created in that folder, nothing showed up on my drive either ( a little confused as this is the folder sonarr is meant to create/move and rename files in) I did the same but this time in the rclone_upload/google_vfs. They uploaded to my drive encrypted. Now anytime i try to run the mount script i get the below error in the log, nothing else to go off. I have searched and someone posted the same issue couple pages ago but with no reply. Also tried deleting remaining files as i read this can stop it mounting? 30.12.2019 19:38:50 INFO: mounting rclone vfs. 30.12.2019 19:38:55 CRITICAL: rclone gdrive vfs mount failed - please check for problems. Script Finished Mon, 30 Dec 2019 19:38:55 +1300