Jump to content

[Support] binhex - Rclone

binhex

By binhex
in Docker Containers

Recommended Posts

Recommended

Posted by binhex,

hi guys, this feature is now in, please pull down latest image then create new variable with key name 'RCLONE_DIRECTION', valid values are 'localtoremote', 'remotetolocal', or 'both', if you dont know how to create a variable for unraid then see Q8 :- https://github.com/binhex/documentation/blob/master/docker/faq/unraid.md   if you dont define the variable then the default will be 'localtoremote' (as it currently was on the previous image).   One word of warning for everybody

New Feature - 2 Way Sync

Recommended by binhex

  • Thanks

1 reaction

Go to this post
  • 2 weeks later...
  • Replies 165
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

MyPoorUnraid
MyPoorUnraid

Hello, thanks for this docker. I've just finished setting it up, and wanted to share a possible workaround for the issue mentioned here: https://github.com/binhex/arch-rclone/issues/1   Note

binhex
binhex

hmm so you dont have the message:- RCLONE_CONFIG_PATH '/config/rclone/config/rclone.conf' does not exist, please run 'rclone config --config /config/rclone/config/rclone.conf' from within the cont

binhex
binhex

hi guys, this feature is now in, please pull down latest image then create new variable with key name 'RCLONE_DIRECTION', valid values are 'localtoremote', 'remotetolocal', or 'both', if you dont know

Posted Images

wgstarks Mentor

wgstarks

Posted
Posted

Does this docker have a built in web browser that appears to be needed for authentication with Google Drive?
 

I run my Unraid server headless and I see two different sets of instructions for the authentication process just not sure which instructions to use for this?

Link to comment
binhex Mentor

binhex

Posted
  • Author
Posted
54 minutes ago, wgstarks said:

I see two different sets of instructions for the authentication process

please link to both so i can fix that.

 

54 minutes ago, wgstarks said:

Does this docker have a built in web browser that appears to be needed for authentication with Google Drive?

no built in web browser, nope, if creation of the config file for the cloud provider requires a web browser then i would advise running through the creation of the config first on a machine that has rclone and a web browser installed, maybe i need to reword Q1/A1 to be clearer:- https://github.com/binhex/documentation/blob/master/docker/faq/rclone.md

Link to comment
wgstarks Mentor

wgstarks

Posted
Posted
2 hours ago, binhex said:

please link to both so i can fix that.

 

no built in web browser, nope, if creation of the config file for the cloud provider requires a web browser then i would advise running through the creation of the config first on a machine that has rclone and a web browser installed, maybe i need to reword Q1/A1 to be clearer:- https://github.com/binhex/documentation/blob/master/docker/faq/rclone.md

Thx. Figured out the authentication and got that set but still missing something somewhere. Almost everything is default but I get an error failed to open log file. I also see that the media shares path isn't being created in the shares tab. Also no webui (failed to connect).

 

dockerrun.txtrclonelog.txt

Link to comment
wgstarks Mentor

wgstarks

Posted
Posted
2 hours ago, wgstarks said:

Thx. Figured out the authentication and got that set but still missing something somewhere. Almost everything is default but I get an error failed to open log file. I also see that the media shares path isn't being created in the shares tab. Also no webui (failed to connect).

 

dockerrun.txt 1.07 kB · 0 downloads rclonelog.txt 5.84 kB · 0 downloads

The webui started working after I changed the WEBUI_PASS to rclone. Now I'm getting an error that RCLONE_MEDIA_SHARES path does not exist. The share does exist. I created it manually.

 

Screenshot2024-07-04at7_30_16PM.thumb.png.dfa2555744d1f25de826e47799c8a222.png

 

New docker run

Quote

docker run
  -d
  --name='binhex-rclone'
  --net='bridge'
  -e TZ="America/New_York"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="Brunnhilde"
  -e HOST_CONTAINERNAME="binhex-rclone"
  -e 'RCLONE_CONFIG_PATH'='/config/rclone/config/rclone.conf'
  -e 'RCLONE_MEDIA_SHARES'='/googledrive_backup/'
  -e 'RCLONE_REMOTE_NAME'='remote'
  -e 'RCLONE_SLEEP_PERIOD'='168h'
  -e 'RCLONE_USER_FLAGS'=''
  -e 'RCLONE_OPERATION'='copy'
  -e 'RCLONE_DIRECTION'='remotetolocal'
  -e 'RCLONE_POST_CHECK'='yes'
  -e 'ENABLE_WEBUI'='yes'
  -e 'WEBUI_USER'='admin'
  -e 'WEBUI_PASS'='rclone'
  -e 'UMASK'='000'
  -e 'PUID'='99'
  -e 'PGID'='100'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:5572]/'
  -l net.unraid.docker.icon='https://raw.githubusercontent.com/binhex/docker-templates/master/binhex/images/rclone-icon.png'
  -p '53682:53682/tcp'
  -p '5572:5572/tcp'
  -v '/mnt/user':'/media':'rw'
  -v '/mnt/cache/appdata/binhex-rclone':'/config':'rw' 'binhex/arch-rclone' 

900eb1f3c25b75abc2377654e521e923932183c1c258d9ce06c5b687e02b04e8

The command finished successfully!

 

Log

Quote

text  error  warn  system  array  login  

Created by...
___.   .__       .__
\_ |__ |__| ____ |  |__   ____ ___  ___
 | __ \|  |/    \|  |  \_/ __ \\  \/  /
 | \_\ \  |   |  \   Y  \  ___/ >    <
 |___  /__|___|  /___|  /\___  >__/\_ \
     \/        \/     \/     \/      \/
  https://hub.docker.com/u/binhex/

2024-07-04 19:36:39.325859 [info] Host is running unRAID
2024-07-04 19:36:39.353929 [info] System information Linux 900eb1f3c25b 6.1.79-Unraid #1 SMP PREEMPT_DYNAMIC Fri Mar 29 13:34:03 PDT 2024 x86_64 GNU/Linux
2024-07-04 19:36:39.380359 [info] PUID defined as '99'
2024-07-04 19:36:39.432454 [info] PGID defined as '100'
2024-07-04 19:36:39.491350 [info] UMASK defined as '000'
2024-07-04 19:36:39.515203 [info] Permissions already set for '/config'
2024-07-04 19:36:39.541518 [info] Deleting files in /tmp (non recursive)...
2024-07-04 19:36:39.568132 [info] RCLONE_CONFIG_PATH defined as '/config/rclone/config/rclone.conf'
2024-07-04 19:36:39.595382 [info] RCLONE_MEDIA_SHARES defined as '/googledrive_backup/'
2024-07-04 19:36:39.619600 [info] RCLONE_REMOTE_NAME defined as 'remote'
2024-07-04 19:36:39.644036 [info] RCLONE_SLEEP_PERIOD defined as '168h'
2024-07-04 19:36:39.668349 [info] RCLONE_OPERATION defined as 'copy'
2024-07-04 19:36:39.691999 [info] RCLONE_DIRECTION defined as 'remotetolocal'
2024-07-04 19:36:39.716268 [info] RCLONE_POST_CHECK defined as 'yes'
2024-07-04 19:36:39.740628 [info] RCLONE_POST_REPORT not defined (via -e RCLONE_POST_REPORT), defaulting to 'combined'
2024-07-04 19:36:39.767115 [info] ENABLE_WEBUI defined as 'yes'
2024-07-04 19:36:39.791520 [info] WEBUI_USER defined as 'admin'
2024-07-04 19:36:39.816127 [warn] WEBUI_PASS defined as 'rclone' is weak, please consider using a stronger password
2024-07-04 19:36:39.842523 [info] Starting Supervisor...
2024-07-04 19:36:40,044 INFO Included extra file "/etc/supervisor/conf.d/rclone.conf" during parsing
2024-07-04 19:36:40,044 INFO Set uid to user 0 succeeded
2024-07-04 19:36:40,046 INFO supervisord started with pid 7
2024-07-04 19:36:41,047 INFO spawned: 'start-script' with pid 108
2024-07-04 19:36:41,048 INFO reaped unknown pid 8 (exit status 0)
2024-07-04 19:36:41,056 DEBG 'start-script' stdout output:
[info] Waiting for Rclone Web UI process to start listening on port 5572...

2024-07-04 19:36:41,056 INFO success: start-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
2024-07-04 19:36:42,550 DEBG 'start-script' stdout output:
[info] Rclone Web UI process listening on port 5572

2024-07-04 19:36:42,557 DEBG 'start-script' stdout output:
[warn] Media share '/googledrive_backup/' does not exist, skipping
[info] rclone finished, sleeping 168h before re-running...

 

Maybe I missed a forward slash somewhere or something but I'm not seeing it???

Link to comment
wgstarks Mentor

wgstarks

Posted
Posted (edited)

I've tried many different paths but they all seem not to exist. My guess is that I'm misunderstanding something somewhere. Not sure why RCLONE_MEDIA_SHARES is a variable rather than a path?

 

Regardless, I am trying to do a remotetolocal copy of two folders on my GoogleDrive. 

Screenshot2024-07-04at11_04_07PM.thumb.png.a2ba80902d35e560f4d24af2f5c7ac5b.png

 

I want to copy them to /mnt/user/googledrive_backup/. I have /media path set to /mnt/user/googledrive_backup/ which is maybe correct??? I can't figure out what to set for RCLONE_MEDIA_SHARES though? Everything I have tried so far results in a does not exist error. Currently it is "Home Assistant Snapshots","WP STAGING Backups" because I seem to remember a comment about comma separating multiple folders.

Edited by wgstarks
Link to comment
wgstarks Mentor

wgstarks

Posted
Posted

Update

I think I’ve made some progress after reading back through early posts here I realized that I needed to manually create folders in my Unraid share with names matching the folders on my google drive. Doing that results in /media path of /mnt/user/googledrive_backup and RCLONE_MEDIA_SHARES is set to Home Assistant Snapshots (no quotes). This appears to function properly in the container log but I get an error in the rclone log and nothing is being synced/copied.


IMG_0051.thumb.png.c246670c12bf4ec77c91f2843f84e7c0.png

 

I think this is due to the spaces in the folder name but if I escape the spaces with single or double quotes I get a directory not found error in the container log.

 

rclone.log

 

 

Link to comment
wgstarks Mentor

wgstarks

Posted
Posted
1 hour ago, wgstarks said:

Update

I think I’ve made some progress after reading back through early posts here I realized that I needed to manually create folders in my Unraid share with names matching the folders on my google drive. Doing that results in /media path of /mnt/user/googledrive_backup and RCLONE_MEDIA_SHARES is set to Home Assistant Snapshots (no quotes). This appears to function properly in the container log but I get an error in the rclone log and nothing is being synced/copied.


IMG_0051.thumb.png.c246670c12bf4ec77c91f2843f84e7c0.png

 

I think this is due to the spaces in the folder name but if I escape the spaces with single or double quotes I get a directory not found error in the container log.

 

rclone.log 396 B · 0 downloads

 

 

Adding supervisord log and current docker run.

 

docker run

Quote

docker run
  -d
  --name='binhex-rclone'
  --net='bridge'
  -e TZ="America/New_York"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="Brunnhilde"
  -e HOST_CONTAINERNAME="binhex-rclone"
  -e 'RCLONE_CONFIG_PATH'='/config/rclone/config/rclone.conf'
  -e 'RCLONE_MEDIA_SHARES'='/media/Home_Assistant_Snapshots'
  -e 'RCLONE_REMOTE_NAME'='remote'
  -e 'RCLONE_SLEEP_PERIOD'='168h'
  -e 'RCLONE_USER_FLAGS'=''
  -e 'RCLONE_OPERATION'='copy'
  -e 'RCLONE_DIRECTION'='remotetolocal'
  -e 'RCLONE_POST_CHECK'='yes'
  -e 'ENABLE_WEBUI'='yes'
  -e 'WEBUI_USER'='admin'
  -e 'WEBUI_PASS'='rclone'
  -e 'UMASK'='000'
  -e 'PUID'='99'
  -e 'PGID'='100'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:5572]/'
  -l net.unraid.docker.icon='https://raw.githubusercontent.com/binhex/docker-templates/master/binhex/images/rclone-icon.png'
  -p '53682:53682/tcp'
  -p '5572:5572/tcp'
  -v '/mnt/user/googledrive_backup':'/media':'rw'
  -v '/mnt/cache/appdata/binhex-rclone':'/config':'rw' 'binhex/arch-rclone' 

f94b884d4987e4b2b563706ab9db2bf15ad151cfad6c64ba7aeefb974036a140

The command finished successfully!

 

supervisord.log

 

Link to comment
wgstarks Mentor

wgstarks

Posted
Posted (edited)
6 hours ago, wgstarks said:

Adding supervisord log and current docker run.

 

docker run

 

supervisord.log 98.77 kB · 0 downloads

 

Finally got it working. Didn’t realize I needed to enclose everything on my google drive in a /media folder so that the file structure on the gdrive was the same as RCLONE_MEDIA_SHARES (should have though I think). Not sure what the path would have been to just copy everything from the root of the gdrive but this is working and it’s really just backups of backups so navigating through a few extra directories doesn’t really matter. All automated anyway.😁

Edited by wgstarks
Link to comment
binhex Mentor

binhex

Posted
  • Author
Posted
2 hours ago, dickesW said:

Hi @binhex,

 

thank you for all your work!

 

Is it possible for you to update to the latest rclone version that was released a few weeks ago? It solves an issue which i have with my remote backup prodiver.

 

https://github.com/rclone/rclone/releases/tag/v1.67.0

 

Thanks!

I'm waiting on up stream changes, once this is updated the new image will be built:- https://archlinux.org/packages/extra/x86_64/rclone/

Link to comment
binhex Mentor

binhex

Posted
  • Author
Posted
On 7/6/2024 at 12:57 AM, wgstarks said:

@binhex

One question that I didn’t find any info for. What are the increment options for sleep cycle? Obviously h is hours. Can I also use w for week and maybe m for month.

it is simply a bash 'sleep' command, from the manual:-
 

Quote

Pause for NUMBER seconds. SUFFIX may be 's' for seconds (the default), 'm' for minutes, 'h' for hours or 'd' for days. NUMBER need not be an integer. Given two or more arguments, pause for the amount of time specified by the sum of their values.


 

Link to comment
  • 1 month later...
Chester Noob

Chester

Posted
Posted (edited)

Edit:

I think I bumbled into a fix, reading through the issue page.  (Config issue with an authentication problem.)

 

So I understand why the fix is working - could someone explain the variable mapping below? 

 

Path: /media:  (Container to server share location?)

 

Variable: RCLONE_MEDIA_SHARES:  (Container to cloud host directory?)

 

--------------------------

Hey folks:

 

Hoping someone can help me out.  Been messing with this for a few hours and getting frustrated.  Trying to backup an URAID share (testbackup) to Idrive.

 

First I was getting this:

 

2024-08-25 18:01:58,166 DEBG 'start-script' stdout output:
[warn] Media share '/testbackup' does not exist, skipping
[info] rclone finished, sleeping 24h before re-running...

 

 

 

I figured I had the RCLONE_MEDIA_SHARE variable wrong, so I tried a couple changes.  Now I receive:

 

2024-08-25 19:16:46,690 DEBG 'start-script' stdout output:
{
        "error": "AccessDenied: Access Denied\n\tstatus code: 403, request id: XXXXXXX, host id: XXXXX=",
        "input": {
                "dstFs": "idrive:media",
                "srcFs": "/media"
        },
        "path": "sync/copy",
        "status": 500

 

Idrive uses buckets - if that matters.  Did I screw around too much and DDoS myself?

 

image.thumb.png.bccd6beeadac7daee232f07c29ed0a84.png

Edited by Chester
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing
×
×
  • Create New...