Stinkpickle

January 2, 2021

I want to download my media back from google drive onto local storage, what is the best way to do this?

December 27, 2020

I want to mount my mergefs share on an Ubuntu Desktop machine, what is the best way to achieve this? I tried to export it as NFS and mount it that way, but it does not seem to be working.

Thanks.

April 14, 2020

54 minutes ago, DZMM said:

@drogg if you are certain there's not an upgrade instance running, go into /mnt/user/appdata/other/rclone and your upload remote folder and manually delete the upload running checker file, or run the cleanup script. Basically the upload script didn't exit properly at some point.

I am not sure if the current cleanup script is deleting the proper check file.

This is the cleanup script I have,

#!/bin/bash

#######################
### Cleanup Script ####
#######################
#### Version 0.9.1 ####
#######################

echo "$(date "+%d.%m.%Y %T") INFO: *** Starting rclone_cleanup script ***"

####### Cleanup Tracking Files #######

echo "$(date "+%d.%m.%Y %T") INFO: *** Removing Tracking Files ***"

find /mnt/user/appdata/other/rclone/remotes -name dockers_started -delete
find /mnt/user/appdata/other/rclone/remotes -name mount_running -delete
find /mnt/user/appdata/other/rclone/remotes -name upload_running -delete
echo "$(date "+%d.%m.%Y %T") INFO: ***Finished Cleanup! ***"

exit

And it appears the upload check file is called "/mnt/user/appdata/other/rclone/remotes/%remotename%/upload_running_daily_upload", that has held up my upload script from running previously.

Just a thought.

April 13, 2020

7 hours ago, DZMM said:

@Stinkpickle I updated #3 as you should always use the mergerfs mount in dockers

Thank you

April 12, 2020

22 hours ago, DZMM said:

Oh I see. I would do the following:

LocalFilesShare2="/mnt/user/Media" in the mount script so that files from /mnt/user/Media just appear in /mnt/user/sgdrive_media/sgdrive_media.

Make sure plex has empty trash automatically off

In plex add the new /mnt/user/sgdrive_media_rclone/sgdrive_media folders and remove the old /mnt/user/Media

Also update sonarr, radarr locations etc

Do a full plex scan - it will update all the file locations and keep all your existing metadata

Once scan complete, check all looks ok, then manually empty trash

Move files from /mnt/user/Media to /mnt/user/sgdrive_media_local

Remove /mnt/user/Media from LocalFilesShare2 as shouldn't need it now

use /mnt/user/sgdrive_media_local going forwards

Edit: Personally I also would use this as opportunity to change MergerfsMountShare="/mnt/user/sgdrive_media" to MergerfsMountShare="/mnt/user/sgdrive_media_mergerfs" to make things easier to follow

Thank you, this got me going.

Do you happen to know why none of this traffic shows on the beta rclone webui? Was looking for a way to track transfer progress.

April 11, 2020

9 minutes ago, DZMM said:

Unless I'm missing something, just do LocalFilesShare="/mnt/user/Media/" and then those files will get moved to google

My concern was the "sgdrive_media" folder residing in the localshare folder, would the script not be looking at /mnt/user/Media/sgdrive_media?

April 11, 2020

I am looking for a clean way to migrate my Movie collection without causing issues. I don't have enough free space on my array to duplicate my Movie directory into the google drive mergefs share.

I was going to point my Local directory for these scripts to my current Media share on Unraid, would that be an ok way to upload my files without moving them?

I noticed the currently directory structure gets kind of embedded twice with the RcloneRemoteName.

My current mount/upload scripts look like this;

#!/bin/bash

######################
#### Mount Script ####
######################
### Version 0.96.6 ###
######################

####### EDIT ONLY THESE SETTINGS #######

# INSTRUCTIONS
# 1. Change the name of the rclone remote and shares to match your setup
# 2. NOTE: enter RcloneRemoteName WITHOUT ':'
# 3. Optional: include custom command and bind mount settings
# 4. Optional: include extra folders in mergerfs mount

# REQUIRED SETTINGS
RcloneRemoteName="sgdrive_media" # Name of rclone remote mount WITHOUT ':'. NOTE: Choose your encrypted remote for sensitive data
RcloneMountShare="/mnt/user/sgdrive_media_rclone" # where your rclone remote will be located without trailing slash  e.g. /mnt/user/mount_rclone
MergerfsMountShare="/mnt/user/sgdrive_media" # location without trailing slash  e.g. /mnt/user/mount_mergerfs. Enter 'ignore' to disable
DockerStart="PlexMediaServer NZBGet sonarr radarr radarr4k ombi tautulli" # list of dockers, separated by space, to start once mergerfs mount verified. Remember to disable AUTOSTART for dockers added in docker settings page
LocalFilesShare="/mnt/user/sgdrive_media_local" # location of the local files and MountFolders you want to upload without trailing slash to rclone e.g. /mnt/user/local. Enter 'ignore' to disable
MountFolders=\{"Movies,Movies-UHD,Music,Other,Personal,TV,TV-Kids"\} # comma separated list of folders to create within the mount

#!/bin/bash

######################
### Upload Script ####
######################
### Version 0.95.6 ###
######################

####### EDIT ONLY THESE SETTINGS #######

# INSTRUCTIONS
# 1. Edit the settings below to match your setup
# 2. NOTE: enter RcloneRemoteName WITHOUT ':'
# 3. Optional: Add additional commands or filters
# 4. Optional: Use bind mount settings for potential traffic shaping/monitoring
# 5. Optional: Use service accounts in your upload remote
# 6. Optional: Use backup directory for rclone sync jobs

# REQUIRED SETTINGS
RcloneCommand="move" # choose your rclone command e.g. move, copy, sync
RcloneRemoteName="sgdrive_media" # Name of rclone remote mount WITHOUT ':'.
RcloneUploadRemoteName="sgdrive_media" # If you have a second remote created for uploads put it here.  Otherwise use the same remote as RcloneRemoteName.
LocalFilesShare="/mnt/user/sgdrive_media_local" # location of the local files without trailing slash you want to rclone to use
RcloneMountShare="/mnt/user/sgdrive_media_rclone" # where your rclone mount is located without trailing slash  e.g. /mnt/user/mount_rclone
MinimumAge="15m" # sync files suffix ms|s|m|h|d|w|M|y
ModSort="ascending" # "ascending" oldest files first, "descending" newest files first

And I noticed this resulted in the following share directories,

/mnt/user/sgdrive_media_local/sgdrive_media

/mnt/user/sgdrive_media_rclone/sgdrive_media

/mnt/user/sgdrive_media/sgdrive_media

My current Media share is;

/mnt/user/Media/

My concern is if I point my local directory at that, it's going to look for /mnt/user/Media/sgdrive_media/ - Which does not exsist/emtpy.

What is the best way to accomplish this?

Thank you.

April 10, 2020

50 minutes ago, DZMM said:

mountcheck file either doesn't exist in the source folder to be copied to gdrive, or the target folder doesn't exist

I didn't add the service accounts to the Team Drive, seemed to have resolved it

April 10, 2020

Alright, so I think I have an issue with my service accounts. This is all very new to me, but I did my best to follow documentation. I followed the instructions to create service accounts from here; https://rclone.org/drive/#1-create-a-service-account-for-example-com. I created 5 of them yesterday, I did it manually because I was unable to get the AutoRclone to work on my Windows machine.

I put the following command in terminal, and it seemed to work properly and list the folders in the root of my Shared Drive.

# rclone -v --drive-impersonate [email protected] lsf gdrive:
Media/
Test/

This is the log from the mount script;

10.04.2020 08:32:26 INFO: Creating local folders.
10.04.2020 08:32:26 INFO: *** Starting mount of remote sgdrive_media
10.04.2020 08:32:26 INFO: Checking if this script is already running.
10.04.2020 08:32:26 INFO: Script not running - proceeding.
10.04.2020 08:32:26 INFO: Mount not running. Will now mount sgdrive_media remote.
10.04.2020 08:32:26 INFO: Recreating mountcheck file for sgdrive_media remote.
2020/04/10 08:32:26 DEBUG : rclone: Version "v1.51.0-151-gfc663d98-beta" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone-beta/.rclone.conf" "copy" "mountcheck" "sgdrive_media:" "-vv" "--no-traverse"]
2020/04/10 08:32:26 DEBUG : Using config file from "/boot/config/plugins/rclone-beta/.rclone.conf"
2020/04/10 08:32:27 DEBUG : mountcheck: Need to transfer - File not found at Destination
2020/04/10 08:32:27 ERROR : mountcheck: Failed to copy: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
2020/04/10 08:32:27 ERROR : Attempt 1/3 failed with 1 errors and: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
2020/04/10 08:32:28 DEBUG : mountcheck: Need to transfer - File not found at Destination
2020/04/10 08:32:29 ERROR : mountcheck: Failed to copy: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
2020/04/10 08:32:29 ERROR : Attempt 2/3 failed with 1 errors and: failed to make directory: googleapi: Error 404: File not found: REMOVEDD., notFound
2020/04/10 08:32:29 DEBUG : mountcheck: Need to transfer - File not found at Destination
2020/04/10 08:32:29 ERROR : mountcheck: Failed to copy: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
2020/04/10 08:32:29 ERROR : Attempt 3/3 failed with 1 errors and: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
2020/04/10 08:32:29 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 1.9s

2020/04/10 08:32:29 DEBUG : 10 go routines active
2020/04/10 08:32:29 Failed to copy: failed to make directory: googleapi: Error 404: File not found: REMOVED., notFound
10.04.2020 08:32:29 INFO: *** Creating mount for remote sgdrive_media
10.04.2020 08:32:29 INFO: sleeping for 5 seconds
2020/04/10 08:32:30 INFO : Google drive root 'Media': Failed to get StartPageToken: googleapi: Error 403: The attempted action requires shared drive membership., teamDriveMembershipRequired
10.04.2020 08:32:34 INFO: continuing...
10.04.2020 08:32:35 CRITICAL: sgdrive_media mount failed - please check for problems.
Script Finished Fri, 10 Apr 2020 08:32:35 -0500

Edit:

Rclone Config

gdrive:Media - Media is the folder residing in my Shared Drive

[gdrive]
type = drive
scope = drive
service_account_file = /mnt/user/appdata/other/rclone/service_accounts/unraid_sa1.json
team_drive = REMOVED
server_side_across_configs = true

[sgdrive_media]
type = crypt
remote = gdrive:Media
filename_encryption = standard
directory_name_encryption = true
password = REMOVED
password2 = REMOVED

April 10, 2020

I am in the early stages of this process, and didn't fully understand the standard Drive vs Team Drive. I have < 1tb of data currently uploaded, and roughly 4tb pending upload on my local share that I am migrating to that share. If I was to move my existing stuff into the team drive, would I just need to just re-do my rclone config with the same names but this time as a Team Drive? Would my data currently only on my local gdrive share be ok?

November 28, 2019

Anyone have this running and an available template?

December 30, 2016

looks to be an unraid problem to me

Yes I agree.

I did what user creon did on page 12;

"/mnt/disk1/appdata/unifi/

was

/mnt/user/appdata/unifi/"

and it fixed it. Unraid version 6.2.4

December 29, 2016

Having issues with this docker, I have it running on a 2nd Unraid server fine. Having issues on this server. Docker is started and appears running ok, however I cannot access WebGUI via port 8443.

Config:

Unifi Log:

_{[s6-init] making user provided files available at /var/run/s6/etc...exited 0.}

_{[s6-init] ensuring user provided files have correct perms...exited 0.}

_{[fix-attrs.d] applying ownership & permissions fixes...}

_{[fix-attrs.d] done.}

_{[cont-init.d] executing container initialization scripts...}

_{[cont-init.d] 10-adduser: executing...}

_{-------------------------------------}

_{_ _ _}

_{| |___| (_) ___}

_{| / __| | |/ _ \}

_{| \__ \ | | (_) |}

_{|_|___/ |_|\___/}

_{|_|}

_{Brought to you by linuxserver.io}

_{We gratefully accept donations at:}

_{https://www.linuxserver.io/index.php/donations/}

_{-------------------------------------}

_GID/UID

_{-------------------------------------}

_{User uid: 99}

_{User gid: 100}

_{-------------------------------------}

_{[cont-init.d] 10-adduser: exited 0.}

_{[cont-init.d] 20-config: executing...}

_{[cont-init.d] 20-config: exited 0.}

_{[cont-init.d] 30-keygen: executing...}

_{[cont-init.d] 30-keygen: exited 0.}

_{[cont-init.d] done.}

_{[services.d] starting services}

_{[services.d] done.}

_{[cont-finish.d] executing container finish scripts...}

_{[cont-finish.d] done.}

_{[s6-finish] syncing disks.}

_{[s6-finish] sending all processes the TERM signal.}

_{[s6-finish] sending all processes the KILL signal and exiting.}

_{[s6-init] making user provided files available at /var/run/s6/etc...exited 0.}

_{[s6-init] ensuring user provided files have correct perms...exited 0.}

_{[fix-attrs.d] applying ownership & permissions fixes...}

_{[fix-attrs.d] done.}

_{[cont-init.d] executing container initialization scripts...}

_{[cont-init.d] 10-adduser: executing...}

_{usermod: no changes}

_{-------------------------------------}

_{_ _ _}

_{| |___| (_) ___}

_{| / __| | |/ _ \}

_{| \__ \ | | (_) |}

_{|_|___/ |_|\___/}

_{|_|}

_{Brought to you by linuxserver.io}

_{We gratefully accept donations at:}

_{https://www.linuxserver.io/index.php/donations/}

_{-------------------------------------}

_GID/UID

_{-------------------------------------}

_{User uid: 99}

_{User gid: 100}

_{-------------------------------------}

_{[cont-init.d] 10-adduser: exited 0.}

_{[cont-init.d] 20-config: executing...}

_{[cont-init.d] 20-config: exited 0.}

_{[cont-init.d] 30-keygen: executing...}

_{[cont-init.d] 30-keygen: exited 0.}

_{[cont-init.d] done.}

_{[services.d] starting services}

_{[services.d] done.}

Unraid Log:

_{Dec 29 15:08:03 Tech_Server shfs/user: err: shfs_write: write: (22) Invalid argument}

_{Dec 29 15:08:07 Tech_Server shfs/user: err: shfs_write: write: (22) Invalid argument}

_{Dec 29 15:08:11 Tech_Server shfs/user: err: shfs_write: write: (22) Invalid argument}

_{Dec 29 15:08:15 Tech_Server shfs/user: err: shfs_write: write: (22) Invalid argument}

Any help appreciated, thanks!

May 31, 2016

Did you ever get this to work?

May 30, 2016

Hello,

Does anyone know how I can get this docker to run as a docker in unraid?

https://hub.docker.com/r/sidesplitter/musicbot/

Thanks.

May 11, 2016

Any thought as to why I see a large difference between my browser and the unraid plugin?

Local browser is the faster of the two

--

--

There's a known flaw with connections as fast as yours and the speedtest python script, mainly the upload speed. The author of the script is aware and it's on his todo list. That said there will always be a differences which is stated in the op right before the change log.

Thank you for responding!

May 11, 2016

Any thought as to why I see a large difference between my browser and the unraid plugin?

Local browser is the faster of the two

May 2, 2016

I am getting the following error on all downloads after update,

Unrar: Could not start unrar: No such file or directory

Ideas?

December 14, 2015

you... you sexy beast, I could kiss you! That was it, came up no problem!

Thank you so much!

December 13, 2015

I think I tried them all

December 13, 2015

Alright, I am fairly sure it must be a compatibility issue in the PC's hardware and/or driver issues. I plugged the USB stick into another PC and it got an address immediately and I was able to access the Web GUI...

Dang, a bummer this is!

December 13, 2015

Just the 1 on board port. I have verified cabling too.

December 13, 2015

Alright, I'm stumped. I tried my very basic ISP router and the server is not getting an IP via DHCP still. Occasionally the system boots up and does not recognize my keyboard, I am starting to think I have a hardware incompatibility issue, whether it is my PC or USB stick (I will try a different one). I was really hoping I could try UNRAID

December 13, 2015

Alright, so it is most likely a network issue that I cannot identify yet.

It seems to be a hit/miss if the server binds an address to eth0 via DHCP. Lastnight I had a dang Television reserve the manual IP I set so I was receiving a ping back (caused troubleshooting headaches). I have set UNRAID back to DHCP, when it gets an address I can see it listed. However my router will show a lease too it, but it shows offline. I cannot ping it either, I am going to try a different router now - maybe I can see what is causing this.

December 13, 2015

I have tried to access it via web browser (192.168.1.100) and Telnet, both are unable to connect.

It is odd, I setup a DHCP static lease on my router for it and reconfigured UNRAID to use DHCP. While the server is booting I see it is offered an IP from the DHCP server, however when I view "ifconfig eht0" it does not list an IP.

EDIT: Also, when I powerdown I get a "mount: can't find / in /etc/fstab or /etc/mtab" message that it hangs on for a few minutes before shutting down.

Stinkpickle

Posts

Joined

Last visited

Content Type

Profiles

Forums

Downloads

Store

Gallery

Bug Reports

Documentation

Landing

Posts posted by Stinkpickle

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

Guide: How To Use Rclone To Mount Cloud Drives And Play Files

[support] Spants - Kerberos.io template

[Support] Linuxserver.io - Unifi

[Support] Linuxserver.io - Unifi

Musicbot for Discord

Discord (VOIP) Bot

Speedtest.net for unRAID 6.1+

Speedtest.net for unRAID 6.1+

[Support] Linuxserver.io - NZBGet

New UNRAID - Unable to load

New UNRAID - Unable to load

New UNRAID - Unable to load

New UNRAID - Unable to load

New UNRAID - Unable to load

New UNRAID - Unable to load

New UNRAID - Unable to load