[Plugin] rclone


Waseh

906 posts in this topic Last Reply

Recommended Posts

Hey Guys, I am new to rclone and looked some guides up, for syncing to cloud servers.

I added one server and I am able to sync. but for some reason the script section is missing within the rclone plugin on my end.

Any ideas what I have to do? Did something changed lately?

 

https://prnt.sc/w0q90w

 

Oh nevermind, found the explaination here:

 

Edited by acidburn666
Link to post
  • Replies 905
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

rclone Plugin   Hey everyone   This is a simple plugin which installs rclone on your unraid system. The plugins have now been merged so both the stable and beta branch are

Hey guys Sorry for the lack of updates in a (long) while ? Real life has been taking up a lot of time and my own install of rclone has been sufficient for my needs. However both the stable branch

Someone beat me to it. And probably explained it in a nicer way than i would have Reinstalling the plugin will also result in the newest version being pulled Take a look at the change log

Posted Images

Hi all,

 

I am installing the plugin and it shows on the settings tab but nothing happens when i run the following command from terminal.

 

rclone config

 

plugin: installing: https://raw.githubusercontent.com/Waseh/rclone-unraid/master/plugin/rclone.plg
plugin: downloading https://raw.githubusercontent.com/Waseh/rclone-unraid/master/plugin/rclone.plg
plugin: downloading: https://raw.githubusercontent.com/Waseh/rclone-unraid/master/plugin/rclone.plg ... done

+==============================================================================
| Installing new package /boot/config/plugins/rclone/install/rclone-2020.09.29-bundle.txz
+==============================================================================

Verifying package rclone-2020.09.29-bundle.txz.
Installing package rclone-2020.09.29-bundle.txz:
PACKAGE DESCRIPTION:
Package rclone-2020.09.29-bundle.txz installed.
No internet - Skipping download - Trying to install existing binary
Install failed - No binary found - Please try installing/updating the plugin again
plugin: run failed: /bin/bash retval: 1

Updating Support Links



Finished Installing. If the DONE button did not appear, then you will need to click the red X in the top right corner
 

Edited by Greygoose
Link to post

@Greygoose
The error might be a clue ;) 

Quote

No internet - Skipping download - Trying to install existing binary
Install failed - No binary found - Please try installing/updating the plugin again

 

The plugin tries to ping 8.8.8.8, 1.1.1.1 and the rclone server only pinging the next in line if no answer was recieved from the former.
So the installer can't reach the internet.

Do you get an answer if you ping the above adresses from command line?

Edited by Waseh
Link to post

Hey everyone, I am looking to setup something similar to what I have seen used for Plex servers etc, however I only want to offload data to my google drive. That said, I done even need access to the data on my server once its uploaded nor do I want it encrypted.  Does any one have a guide or can point me in the right direction? 

 

IE.  Share on my server call "gdrive". Whenever I drop a file in said share, it uploads it to my google drive with no encryption then deletes it from the "gdrive" share. 

Link to post
1 hour ago, Archemedees said:

Hey everyone, I am looking to setup something similar to what I have seen used for Plex servers etc, however I only want to offload data to my google drive. That said, I done even need access to the data on my server once its uploaded nor do I want it encrypted.  Does any one have a guide or can point me in the right direction? 

 

IE.  Share on my server call "gdrive". Whenever I drop a file in said share, it uploads it to my google drive with no encryption then deletes it from the "gdrive" share. 

Research a github project called cloudplow. It does exactly what you want. I will NOT walk you through setup for it. Review the readme carefully.

 

You MAY have to use a docker version of cloudplow if Unraid has issues installing it the standard way.

Link to post

Hi, I am currently facing some issue with the rclone's mounted Google Drive which is shared on Windows OS as SMB Share (Mapped Network Drive).

 

Issue: If I try to copy or do any action on this drive, it gives me a permission error “You need permission to perform this action”.

 

Screenshot: https://i.imgur.com/sAnLaeu.png

 

Please if you could take a look at this thread as I have in-detail mentioned the issue with all the logs/screenshots/commands. Thanks.

 

Thread: https://forums.unraid.net/topic/100567-rclone-permission-and-writefilehandlewrite-issue/

 

Thanks!

 

P.S.: If you want, I can post the whole content on this thread too just in case if you cannot provide support over there in General Support Section. Please do mention!

 

Edited by learningunraid
Link to post
  • 2 weeks later...

Hey All

 

Having an issue with rclone, using: 

 

Unraid Nvidia 6.8.3

Rclone 1.53.3

 

Have a simple user script which is set to rclone sync -v /mnt/user/Media/ /mnt/disks/offload

 

This syncs my media to a synlogy backup box, which is mounted with unassigned devices to the offload folder

 

Error is pretty obvious as Failed to copy write, no space left on device.

 

However the device has 29TB free

 

Any thoughts would be much appreciated. 

 

This has been working great for a few years since this month.

Edited by purplechris
Link to post
  • 2 weeks later...
  • 2 weeks later...

Hey,

 

I've been using rclone for a while on Google Drive (Encrypted), and have now decided to take it all locally -- ~50TB in total.

 

What's the right way to think about copying all of this locally? I know the 750GB/day limit will make this take forever, so thinking about the correct way to set up rclone to copy data from a remote to local.

 

Presumably the plan would need to handle internet downtime / happen automatically, so I guess that I'd want the reverse of rclone/mergerfs.

 

 

So the setup seems like it'd be:

 

1. stop uploading data to google drive

2. long-running rclone ? script to copy to a local directory

 

My config looks like

 

[gdrive]
type = drive
client_id = x
client_secret = x
scope = drive
root_folder_id =
service_account_file =
token = x

[gcrypt]
type = crypt
remote = gdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x

 

and my unraid script is https://pastebin.com/uKWECVSx

Link to post
11 minutes ago, willm said:

Hey,

 

I've been using rclone for a while on Google Drive (Encrypted), and have now decided to take it all locally -- ~50TB in total.

 

What's the right way to think about copying all of this locally? I know the 750GB/day limit will make this take forever, so thinking about the correct way to set up rclone to copy data from a remote to local.

 

Presumably the plan would need to handle internet downtime / happen automatically, so I guess that I'd want the reverse of rclone/mergerfs.

 

 

So the setup seems like it'd be:

 

1. stop uploading data to google drive

2. long-running rclone ? script to copy to a local directory

 

My config looks like

 

[gdrive]
type = drive
client_id = x
client_secret = x
scope = drive
root_folder_id =
service_account_file =
token = x

[gcrypt]
type = crypt
remote = gdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = x
password2 = x

 

and my unraid script is https://pastebin.com/uKWECVSx

  1. 750 GB/Day is for UPLOADS to Google. It's about 10 TB/Day for DOWNLOADS from Google.
  2. You can workaround these limits with the use of Google Service Accounts (no I won't explain how you set that up)
  3. There are scripts on github such as sasync to help you download to local. These scripts are capable of performing service account cycling so you can download/upload a lot per day. Google to find this in github.
Link to post

Thanks for the suggestion Stupifier. I didn't realize the download limit was 10TB -- I had been thinking about the service account approach, but actually I think with the 10TB limit, it's not needed. I could fully saturate my gigabit down connection and not hit 10TB a day.

 

I've started a typical rclone sync from my decrypted mount to a new directory. It seems to be running fine ATM, weeks to go :)

Link to post
18 minutes ago, willm said:

Thanks for the suggestion Stupifier. I didn't realize the download limit was 10TB -- I had been thinking about the service account approach, but actually I think with the 10TB limit, it's not needed. I could fully saturate my gigabit down connection and not hit 10TB a day.

 

I've started a typical rclone sync from my decrypted mount to a new directory. It seems to be running fine ATM, weeks to go :)

50TB of total data. I'd do your transfer in chunks...I'd also do it in a tmux/screen terminal session to avoid disconnects

Link to post

Thank you so much for this. It is running great syncing to an offiste minio unraid server. I just need some help please with --backup-dir

 

I want to set this up as a true backup so if I get crypto and the script runs every night after crypto, I want to still get my files back..

 

Right now I have it set up as --backup-dir remotename:deleted So all of the files that have changed go there. I will periodically purge this directory.

 

But I want something more specific, I would like to be able to create a folder in the "deleted" backup directory that has the date the file was changed as part of its name, and then put that file in there. So every time a file is changed a subdirectory with the date of the change is created within the "deleted" back up directory.

This would make it easier to sort through and figure out the date of the file that I should revert to.

 

I understand that this is possible, and I've read the docs over at rclone.org, but I'm a newbie and it looks like there are some weird symbols involved and I just don't know how to add it to my script.

Can you guys pls help me out with this?

 

Thanks so much!

Link to post

Hi...  this thread is 32 pages long.. so not sure if this has been discussed, I am sure it has but I couldn't find it....

 

I watched SpaceInvaders rClone tutorial - 

 

 

In it he tells us to boot into GUI mode, but my server is completely headless and I am not able to put a monitor and keyboard on it with out a ton of effort...

 

I was hoping there is a way to install rclone without GUI mode.... he dose mention briefly that there is but dose not actually show how to do it.

 

TL;DR How do I install and setup the plugin with out GUI Mode turned on?

 

Link to post
9 hours ago, questionbot said:

Hi...  this thread is 32 pages long.. so not sure if this has been discussed, I am sure it has but I couldn't find it....

 

I watched SpaceInvaders rClone tutorial - 

 

 

In it he tells us to boot into GUI mode, but my server is completely headless and I am not able to put a monitor and keyboard on it with out a ton of effort...

 

I was hoping there is a way to install rclone without GUI mode.... he dose mention briefly that there is but dose not actually show how to do it.

 

TL;DR How do I install and setup the plugin with out GUI Mode turned on?

 

Type "rclone config" in a terminal session and follow along with all the prompts. When you reach a prompt which asks if you are Headless, say YES. And just follow the prompt. It'll ask you to go to a link, auth your account, and paste some code back in the terminal. That's all.

 

And for FWIW, this is the exact same procedure for any headless device. Unraid is not special. So you can Google any setup tutorial for help on this. I'm not exactly sure why SpaceInvaderOne had all the GUI mode discussion stuff in his video...but his video there is very old.

Edited by Stupifier
Link to post
No idea what you are trying to do.

I’m trying to copy files from my Unraid server to Google Drive using a VPN without having to route all the traffic of my Unraid box through a VPN.


Verzonden vanaf mijn iPhone met Tapatalk
Link to post
1 hour ago, JNCK said:


I’m trying to copy files from my Unraid server to Google Drive using a VPN without having to route all the traffic of my Unraid box through a VPN.


Verzonden vanaf mijn iPhone met Tapatalk

No idea how to do that but seriously.....upload the files to Google Drive without the VPN. Google truly does NOT care. This isn't like you are seeding torrents, you don't need a VPN in this instance.

Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.