[Support] binhex - Rclone

[nitrosont]

Thank you very much for this great idea!
With the "RCLONE_USER_FLAGS" it worked like a charm!

[nitrosont]

A follow-up-question regarding the bwlimit-option:

In the rclone-documentation it stated, that it's possible to use time-tables: i.e.

--bwlimit "08:00,512k 12:00,10M 13:00,512k 18:00,30M 23:00,off"

When I try to do that,

--bwlimit "07:00,500K:100M 23:00,off:100M"

it gives me the following error:

Error: invalid argument "\"07:00,500K:100M" for "--bwlimit" flag: invalid time specification (hh:mm): "\"07:00"

 

I'm assuming, I need to write it in a other way? In brackets maybe?

[binhex]

A follow-up-question regarding the bwlimit-option:
In the rclone-documentation it stated, that it's possible to use time-tables: i.e.

--bwlimit "08:00,512k 12:00,10M 13:00,512k 18:00,30M 23:00,off"

When I try to do that,

--bwlimit "07:00,500K:100M 23:00,off:100M"

it gives me the following error:

Error: invalid argument "\"07:00,500K:100M" for "--bwlimit" flag: invalid time specification (hh:mm): "\"07:00"

 
I'm assuming, I need to write it in a other way? In brackets maybe?

Try removing the quotes

Sent from my 22021211RG using Tapatalk

[nitrosont]

Ok, thanks for the idea.

The container started and the logs didn't show any error - so it ssems the argument went in smoothly.

BUT: the logs stated, that all transfer-jobs had finished

[info] rclone sync finished
[info] rclone post check finished
[info] rclone finished, sleeping 1h before re-running...

But that's definetly not the case! So I guess the argument go miss-interpreted?!

 

Also: It seems the web-UI wasn't reachable.

Edited June 11, 2023 by nitrosont

[Revan335]

Hello,

 

how can i used rclone with restic for example for Versioning/Incremental .... Encrypted Backups from the Unraid Server to a Nextcloud (SSH, WebDAV...)?

 

Restic have a Unraid Template, when i see correct: https://forums.unraid.net/topic/115646-support-restic-rest-server

 

For example: https://www.hosting.de/blog/verschluesselte-backups-mit-rclone-und-restic-in-nextcloud/

 

Many Thanks!

 

Greetings

 

Revan335

[nitrosont]

9 hours ago, Revan335 said:

Hello,

 

how can i used rclone with restic for example for Versioning/Incremental .... Encrypted Backups from the Unraid Server to a Nextcloud (SSH, WebDAV...)?

...

Maybe this ("BackupScripts with Restic and Rclone" on GitHub) helps?

[Revan335]

On 6/13/2023 at 4:55 PM, nitrosont said:

Maybe this ("BackupScripts with Restic and Rclone" on GitHub) helps?

Looks very cool!

I tried!

 

The Scripts downloaded to the Unraid Shares?

Can I used the linked restic Unraid Template for that?

[nitrosont]

Honestly: I don’t know!

I haven’t tried this myself. I just stumbled across it some days ago. But it was here in the forum! Maybe you could ask there!?

[Revan335]

Great!

 

I tried there!

[Billwin]

Hi sorry if it turns out to be a total newb question.   But trying to use the Binhex Rclone docker to back up my family pics to one of the 1TB onedrive allocations from an office 365 family sub.  

 

I have managed what seems to be the tricky bit of getting the token to connect.   in the Rclone GUI i can go to the Explorer and see the mounted Onedrive, and browse existing files on the Onedrive account.   But i am becoming confused at this point, i think i need to do something in the mounts tab?

 

How ive got it set up  (do let me know if more information is needed)

 

On Container Config

Host Path 2  (/media)   is /mnt/user/Pictures  (pictures being the unraid share with er pictures in)

 

Key 2: i am not sure what i am supposed to put in there  its titled  Container Variable: RCLONE_MEDIA_SHARES,   ive tried mirroring the path on OneDrive , but us that correct  (see screenshots)

 

In the WebGui when its up and running,  Explorer the (see screenshots)  theres a drive called OneD:/  with some folders in

 

What i want to do is copy everything in the  unraid share called Pictures into a  folder called Pictures which is in Onedrive  under /media/picture    (the root level pictures folder is the one from the users Windows Pictures folder)

 

example  the share has year folders

 

/pictures/2005

/pictures/2006

etc

 

i want these copied into the /media/pictures folder in the Onedrive. 

 

Hopeing some kind sole could point me into where i am going wrong?

 

Whats the correct line to put in Key 2: (Container Variable: RCLONE_MEDIA_SHARES)

What if anything am i supposed to do on the Mounts tab in Gui? 

 

Thank you in advance for any guidance given

 

 

Edited July 19, 2023 by Billwin

[wallypop]

@Billwin I believe I can help you a bit --

 

/media should be the path to where the folder lives that you want to backup. You have it set to /mnt/user/Pictures/

 

Then you have RCLONE_MEDIA_SHARES set to /media/Pictures

 

That would mean it is looking for a folder called /mnt/user/Pictures/Pictures

 

Does such a folder exist? Perhaps you should set /media to /mnt/user/ and then it would find your Pictures directory.

 

As far as getting the files to upload automatically, I don't know. I just finished getting mine setup and authed to Google Drive (bit of a headache because I just ran rclone config without telling it what config file to use, so I couldn't figure out why the web GUI was not matching the command line. Once I gave it the path to the conf file I was good to go). However, nothing has started uploading. Perhaps I just haven't waited long enough? I also can explore to my Google Drive and see the files there, so I don't know for sure what's going on there.

[wallypop]

Figured out my issue - I hadn't named my remote config "remote" and I didn't set the RCLONE_REMOTE_NAME to match the name of my remote. Once I did that and restarted, it began syncing immediately.

[Billwin]

29 minutes ago, wallypop said:

Figured out my issue - I hadn't named my remote config "remote" and I didn't set the RCLONE_REMOTE_NAME to match the name of my remote. Once I did that and restarted, it began syncing immediately.

Cool good pointers thank you..  I'd I'm understanding then for my remote name I would be putting oneD. Which is the name showing for the onedrive when looking at it in the explorer in gui

[wallypop]

Yes, you'd want to make that match the name in the explorer, or if you go to the configs section of the web GUI, it will list your remote name as the "name". That should be what you enter into the RCLONE_REMOTE_NAME variable.

[Billwin]

Up and Running,  had one hitch,  for some reason i couldnt figure getting it to go to OneD:/media/Pictures and start checking what was there and start uploading the newly added,  but i could get it to go to OneD:/media.    So to end my headscratching i figured leave it configured like that,  turned it off,  popped onto the 365 account for that OneDrive and got Onedrive to move all the folders in media/Pictures to  to be in /media.     Restarted and were off.

 

Thank you for you help Wallypop,  it was enough for me to get to the finish line and is much appreciated.

[InhaledPlane]

Hi friends, thanks and apologies for what I know to be an embarrassing request for assistance.

I'm trying to run a simple sync command from an SMB share to the local array. The SMB share is mounted successfully and browsable in unraid and midnight commander. When I run the sync command, rclone cannot access the directory.

 

Does the rclone docker have a permissions issue in being able to see outside of itself to mounted SMB shares? Is there a simple formatting error with the file path?

Your help in sending me on my way is much appreciated, thanks

 

[minhio]

hello, i'm having trouble setting up binhex-rclone, need some help with pin pointing what i'm doing wrong

 

here's my log output, what might be causing the permission denied? none of my other containers has issues with writing to /mnt/cache/appdata

 

2024-02-04 11:52:28.460720 [info] Host is running unRAID
2024-02-04 11:52:28.470643 [info] System information Linux 01f456771fad 6.1.64-Unraid #1 SMP PREEMPT_DYNAMIC Wed Nov 29 12:48:16 PST 2023 x86_64 GNU/Linux
2024-02-04 11:52:28.481616 [info] PUID defined as '99'
2024-02-04 11:52:28.493650 [info] PGID defined as '100'
2024-02-04 11:52:28.507385 [info] UMASK defined as '000'
2024-02-04 11:52:28.518079 [info] Permissions already set for '/config'
2024-02-04 11:52:28.529511 [info] Deleting files in /tmp (non recursive)...
2024-02-04 11:52:28.541359 [info] RCLONE_CONFIG_PATH defined as '/config/rclone/config/rclone.conf'
2024-02-04 11:52:28.553515 [info] RCLONE_MEDIA_SHARES defined as '/media'
2024-02-04 11:52:28.564509 [info] RCLONE_REMOTE_NAME defined as 'remote'
2024-02-04 11:52:28.575295 [info] RCLONE_SLEEP_PERIOD defined as '24h'
2024-02-04 11:52:28.586261 [info] RCLONE_OPERATION defined as 'copy'
2024-02-04 11:52:28.597348 [info] RCLONE_DIRECTION defined as 'localtoremote'
2024-02-04 11:52:28.608135 [info] RCLONE_POST_CHECK defined as 'yes'
2024-02-04 11:52:28.618959 [info] RCLONE_POST_REPORT not defined (via -e RCLONE_POST_REPORT), defaulting to 'combined'
2024-02-04 11:52:28.631071 [info] ENABLE_WEBUI defined as 'no'
2024-02-04 11:52:28.643140 [info] Starting Supervisor...
2024-02-04 11:52:28,720 INFO Included extra file "/etc/supervisor/conf.d/rclone.conf" during parsing
2024-02-04 11:52:28,720 INFO Set uid to user 0 succeeded
2024-02-04 11:52:28,720 INFO supervisord started with pid 7
2024-02-04 11:52:29,722 INFO spawned: 'start-script' with pid 98
2024-02-04 11:52:29,722 INFO reaped unknown pid 8 (exit status 0)
2024-02-04 11:52:29,726 DEBG 'start-script' stderr output:
mkdir: cannot create directory ‘/config/rclone/logs’: Permission denied

2024-02-04 11:52:29,726 INFO success: start-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
2024-02-04 11:52:29,729 DEBG 'start-script' stdout output:
[info] Running rclone copy for local media share '/media' to remote 'remote'...

2024-02-04 11:52:29,756 DEBG 'start-script' stderr output:
2024/02/04 11:52:29 Failed to open log file: open /config/rclone/logs/rclone.log: no such file or directory

2024-02-04 11:52:29,759 DEBG 'start-script' stdout output:
[info] rclone copy finished

2024-02-04 11:52:29,759 DEBG 'start-script' stdout output:
[info] Running rclone post check, report located at '/config/rclone/reports/local-to-remote-remote-combined-media.txt'...

2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
mkdir: cannot create directory ‘/config/rclone/reports’
2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
: Permission denied

2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
/home/nobody/start.sh: line 52: /config/rclone/reports/local-to-remote-remote-combined-media.txt: No such file or directory

2024-02-04 11:52:29,760 DEBG 'start-script' stdout output:
[info] rclone post check finished

2024-02-04 11:52:29,760 DEBG 'start-script' stdout output:
[info] rclone finished, sleeping 24h before re-running...

 

 

[trurl]

2 minutes ago, minhio said:

pin pointing what i'm doing wrong

Post docker run 

[minhio]

3 hours ago, trurl said:

Post docker run 

docker run
  -d
  --name='binhex-rclone'
  --net='bridge'
  -e TZ="America/Chicago"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="damascus"
  -e HOST_CONTAINERNAME="binhex-rclone"
  -e 'RCLONE_CONFIG_PATH'='/config/rclone/config/rclone.conf'
  -e 'RCLONE_MEDIA_SHARES'='/media'
  -e 'RCLONE_REMOTE_NAME'='remote'
  -e 'RCLONE_SLEEP_PERIOD'='24h'
  -e 'RCLONE_USER_FLAGS'=''
  -e 'RCLONE_OPERATION'='copy'
  -e 'RCLONE_DIRECTION'='localtoremote'
  -e 'RCLONE_POST_CHECK'='yes'
  -e 'ENABLE_WEBUI'='no'
  -e 'UMASK'='000'
  -e 'PUID'='99'
  -e 'PGID'='100'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:5572]/'
  -l net.unraid.docker.icon='https://raw.githubusercontent.com/binhex/docker-templates/master/binhex/images/rclone-icon.png'
  -p '53682:53682/tcp'
  -p '5572:5572/tcp'
  -v '/mnt/user/memories/':'/media':'rw'
  -v '/mnt/cache_nvme/appdata/binhex-rclone':'/config':'rw' 'binhex/arch-rclone'
7711f6f54455efda394275ab61ff0093e59d90878917d583bce61b56b4cc18fc

 

[minhio]

strange...just tried it again just now and it seems to be working? strange

[Masterwishx]

Have error when trying to mount s3 Minio bucket to /media/Backups/.../... :  

 

ERROR : rc: "mount/mount": error: failed to mount FUSE fs: fusermount: exec: "fusermount3": executable file not found in $PATH

 

Edited March 24 by Masterwishx