Thank you very much for this great idea!
With the "RCLONE_USER_FLAGS" it worked like a charm!

A follow-up-question regarding the bwlimit-option:

In the rclone-documentation it stated, that it's possible to use time-tables: i.e.

--bwlimit "08:00,512k 12:00,10M 13:00,512k 18:00,30M 23:00,off"

When I try to do that,

--bwlimit "07:00,500K:100M 23:00,off:100M"

it gives me the following error:

Error: invalid argument "\"07:00,500K:100M" for "--bwlimit" flag: invalid time specification (hh:mm): "\"07:00"

 

I'm assuming, I need to write it in a other way? In brackets maybe?

A follow-up-question regarding the bwlimit-option:
In the rclone-documentation it stated, that it's possible to use time-tables: i.e.

--bwlimit "08:00,512k 12:00,10M 13:00,512k 18:00,30M 23:00,off"

When I try to do that,

--bwlimit "07:00,500K:100M 23:00,off:100M"

it gives me the following error:

Error: invalid argument "\"07:00,500K:100M" for "--bwlimit" flag: invalid time specification (hh:mm): "\"07:00"

 
I'm assuming, I need to write it in a other way? In brackets maybe?

Try removing the quotes

Sent from my 22021211RG using Tapatalk

Ok, thanks for the idea.

The container started and the logs didn't show any error - so it ssems the argument went in smoothly.

BUT: the logs stated, that all transfer-jobs had finished

[info] rclone sync finished
[info] rclone post check finished
[info] rclone finished, sleeping 1h before re-running...

But that's definetly not the case! So I guess the argument go miss-interpreted?!

 

Also: It seems the web-UI wasn't reachable.

Edited June 11, 20233 yr by nitrosont

Hello,

 

how can i used rclone with restic for example for Versioning/Incremental .... Encrypted Backups from the Unraid Server to a Nextcloud (SSH, WebDAV...)?

 

Restic have a Unraid Template, when i see correct: https://forums.unraid.net/topic/115646-support-restic-rest-server

 

For example: https://www.hosting.de/blog/verschluesselte-backups-mit-rclone-und-restic-in-nextcloud/

 

Many Thanks!

 

Greetings

 

Revan335

9 hours ago, Revan335 said:

Hello,

 

how can i used rclone with restic for example for Versioning/Incremental .... Encrypted Backups from the Unraid Server to a Nextcloud (SSH, WebDAV...)?

...

Maybe this ("BackupScripts with Restic and Rclone" on GitHub) helps?

On 6/13/2023 at 4:55 PM, nitrosont said:

Maybe this ("BackupScripts with Restic and Rclone" on GitHub) helps?

Looks very cool!

I tried!

 

The Scripts downloaded to the Unraid Shares?

Can I used the linked restic Unraid Template for that?

Honestly: I don’t know!

I haven’t tried this myself. I just stumbled across it some days ago. But it was here in the forum! Maybe you could ask there!?

Great!

 

I tried there!

Hi sorry if it turns out to be a total newb question.   But trying to use the Binhex Rclone docker to back up my family pics to one of the 1TB onedrive allocations from an office 365 family sub.  

 

I have managed what seems to be the tricky bit of getting the token to connect.   in the Rclone GUI i can go to the Explorer and see the mounted Onedrive, and browse existing files on the Onedrive account.   But i am becoming confused at this point, i think i need to do something in the mounts tab?

 

How ive got it set up  (do let me know if more information is needed)

 

On Container Config

Host Path 2  (/media)   is /mnt/user/Pictures  (pictures being the unraid share with er pictures in)

 

Key 2: i am not sure what i am supposed to put in there  its titled  Container Variable: RCLONE_MEDIA_SHARES,   ive tried mirroring the path on OneDrive , but us that correct  (see screenshots)

 

In the WebGui when its up and running,  Explorer the (see screenshots)  theres a drive called OneD:/  with some folders in

 

What i want to do is copy everything in the  unraid share called Pictures into a  folder called Pictures which is in Onedrive  under /media/picture    (the root level pictures folder is the one from the users Windows Pictures folder)

 

example  the share has year folders

 

/pictures/2005

/pictures/2006

etc

 

i want these copied into the /media/pictures folder in the Onedrive. 

 

Hopeing some kind sole could point me into where i am going wrong?

 

Whats the correct line to put in Key 2: (Container Variable: RCLONE_MEDIA_SHARES)

What if anything am i supposed to do on the Mounts tab in Gui? 

 

Thank you in advance for any guidance given

 

 

Edited July 19, 20232 yr by Billwin

@Billwin I believe I can help you a bit --

 

/media should be the path to where the folder lives that you want to backup. You have it set to /mnt/user/Pictures/

 

Then you have RCLONE_MEDIA_SHARES set to /media/Pictures

 

That would mean it is looking for a folder called /mnt/user/Pictures/Pictures

 

Does such a folder exist? Perhaps you should set /media to /mnt/user/ and then it would find your Pictures directory.

 

As far as getting the files to upload automatically, I don't know. I just finished getting mine setup and authed to Google Drive (bit of a headache because I just ran rclone config without telling it what config file to use, so I couldn't figure out why the web GUI was not matching the command line. Once I gave it the path to the conf file I was good to go). However, nothing has started uploading. Perhaps I just haven't waited long enough? I also can explore to my Google Drive and see the files there, so I don't know for sure what's going on there.

Figured out my issue - I hadn't named my remote config "remote" and I didn't set the RCLONE_REMOTE_NAME to match the name of my remote. Once I did that and restarted, it began syncing immediately.

29 minutes ago, wallypop said:

Figured out my issue - I hadn't named my remote config "remote" and I didn't set the RCLONE_REMOTE_NAME to match the name of my remote. Once I did that and restarted, it began syncing immediately.

Cool good pointers thank you..  I'd I'm understanding then for my remote name I would be putting oneD. Which is the name showing for the onedrive when looking at it in the explorer in gui

Yes, you'd want to make that match the name in the explorer, or if you go to the configs section of the web GUI, it will list your remote name as the "name". That should be what you enter into the RCLONE_REMOTE_NAME variable.

Up and Running,  had one hitch,  for some reason i couldnt figure getting it to go to OneD:/media/Pictures and start checking what was there and start uploading the newly added,  but i could get it to go to OneD:/media.    So to end my headscratching i figured leave it configured like that,  turned it off,  popped onto the 365 account for that OneDrive and got Onedrive to move all the folders in media/Pictures to  to be in /media.     Restarted and were off.

 

Thank you for you help Wallypop,  it was enough for me to get to the finish line and is much appreciated.

Hi friends, thanks and apologies for what I know to be an embarrassing request for assistance.

I'm trying to run a simple sync command from an SMB share to the local array. The SMB share is mounted successfully and browsable in unraid and midnight commander. When I run the sync command, rclone cannot access the directory.

 

Does the rclone docker have a permissions issue in being able to see outside of itself to mounted SMB shares? Is there a simple formatting error with the file path?

Your help in sending me on my way is much appreciated, thanks

 

hello, i'm having trouble setting up binhex-rclone, need some help with pin pointing what i'm doing wrong

 

here's my log output, what might be causing the permission denied? none of my other containers has issues with writing to /mnt/cache/appdata

 

2024-02-04 11:52:28.460720 [info] Host is running unRAID
2024-02-04 11:52:28.470643 [info] System information Linux 01f456771fad 6.1.64-Unraid #1 SMP PREEMPT_DYNAMIC Wed Nov 29 12:48:16 PST 2023 x86_64 GNU/Linux
2024-02-04 11:52:28.481616 [info] PUID defined as '99'
2024-02-04 11:52:28.493650 [info] PGID defined as '100'
2024-02-04 11:52:28.507385 [info] UMASK defined as '000'
2024-02-04 11:52:28.518079 [info] Permissions already set for '/config'
2024-02-04 11:52:28.529511 [info] Deleting files in /tmp (non recursive)...
2024-02-04 11:52:28.541359 [info] RCLONE_CONFIG_PATH defined as '/config/rclone/config/rclone.conf'
2024-02-04 11:52:28.553515 [info] RCLONE_MEDIA_SHARES defined as '/media'
2024-02-04 11:52:28.564509 [info] RCLONE_REMOTE_NAME defined as 'remote'
2024-02-04 11:52:28.575295 [info] RCLONE_SLEEP_PERIOD defined as '24h'
2024-02-04 11:52:28.586261 [info] RCLONE_OPERATION defined as 'copy'
2024-02-04 11:52:28.597348 [info] RCLONE_DIRECTION defined as 'localtoremote'
2024-02-04 11:52:28.608135 [info] RCLONE_POST_CHECK defined as 'yes'
2024-02-04 11:52:28.618959 [info] RCLONE_POST_REPORT not defined (via -e RCLONE_POST_REPORT), defaulting to 'combined'
2024-02-04 11:52:28.631071 [info] ENABLE_WEBUI defined as 'no'
2024-02-04 11:52:28.643140 [info] Starting Supervisor...
2024-02-04 11:52:28,720 INFO Included extra file "/etc/supervisor/conf.d/rclone.conf" during parsing
2024-02-04 11:52:28,720 INFO Set uid to user 0 succeeded
2024-02-04 11:52:28,720 INFO supervisord started with pid 7
2024-02-04 11:52:29,722 INFO spawned: 'start-script' with pid 98
2024-02-04 11:52:29,722 INFO reaped unknown pid 8 (exit status 0)
2024-02-04 11:52:29,726 DEBG 'start-script' stderr output:
mkdir: cannot create directory ‘/config/rclone/logs’: Permission denied

2024-02-04 11:52:29,726 INFO success: start-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
2024-02-04 11:52:29,729 DEBG 'start-script' stdout output:
[info] Running rclone copy for local media share '/media' to remote 'remote'...

2024-02-04 11:52:29,756 DEBG 'start-script' stderr output:
2024/02/04 11:52:29 Failed to open log file: open /config/rclone/logs/rclone.log: no such file or directory

2024-02-04 11:52:29,759 DEBG 'start-script' stdout output:
[info] rclone copy finished

2024-02-04 11:52:29,759 DEBG 'start-script' stdout output:
[info] Running rclone post check, report located at '/config/rclone/reports/local-to-remote-remote-combined-media.txt'...

2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
mkdir: cannot create directory ‘/config/rclone/reports’
2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
: Permission denied

2024-02-04 11:52:29,760 DEBG 'start-script' stderr output:
/home/nobody/start.sh: line 52: /config/rclone/reports/local-to-remote-remote-combined-media.txt: No such file or directory

2024-02-04 11:52:29,760 DEBG 'start-script' stdout output:
[info] rclone post check finished

2024-02-04 11:52:29,760 DEBG 'start-script' stdout output:
[info] rclone finished, sleeping 24h before re-running...

 

 

2 minutes ago, minhio said:

pin pointing what i'm doing wrong

Post docker run 

3 hours ago, trurl said:

Post docker run 

docker run
  -d
  --name='binhex-rclone'
  --net='bridge'
  -e TZ="America/Chicago"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="damascus"
  -e HOST_CONTAINERNAME="binhex-rclone"
  -e 'RCLONE_CONFIG_PATH'='/config/rclone/config/rclone.conf'
  -e 'RCLONE_MEDIA_SHARES'='/media'
  -e 'RCLONE_REMOTE_NAME'='remote'
  -e 'RCLONE_SLEEP_PERIOD'='24h'
  -e 'RCLONE_USER_FLAGS'=''
  -e 'RCLONE_OPERATION'='copy'
  -e 'RCLONE_DIRECTION'='localtoremote'
  -e 'RCLONE_POST_CHECK'='yes'
  -e 'ENABLE_WEBUI'='no'
  -e 'UMASK'='000'
  -e 'PUID'='99'
  -e 'PGID'='100'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:5572]/'
  -l net.unraid.docker.icon='https://raw.githubusercontent.com/binhex/docker-templates/master/binhex/images/rclone-icon.png'
  -p '53682:53682/tcp'
  -p '5572:5572/tcp'
  -v '/mnt/user/memories/':'/media':'rw'
  -v '/mnt/cache_nvme/appdata/binhex-rclone':'/config':'rw' 'binhex/arch-rclone'
7711f6f54455efda394275ab61ff0093e59d90878917d583bce61b56b4cc18fc

 

strange...just tried it again just now and it seems to be working? strange

Have error when trying to mount s3 Minio bucket to /media/Backups/.../... :  

 

ERROR : rc: "mount/mount": error: failed to mount FUSE fs: fusermount: exec: "fusermount3": executable file not found in $PATH

 

Edited March 24, 20242 yr by Masterwishx

Will this keep copy data each time changes happens to the configured shares?
And if I read the default config right, it wont delete files from remote if files gets deleted locally?

Edit: think I understood it now, its the sleep timer
So if I change it from 24h to 1h, it should run every hour.

Edited May 7, 20242 yr by isvein

Thanks binhex for another fab docker.

I have this up and running backing up various to google drive. Its working fine but I see the below (below) error as the copy process is finishes and before the post check.

I gather it relates to EOF service being unavailable.

Report states:

2024/06/18 00:28:20 NOTICE: Google drive root 'Audio': 0 differences found
2024/06/18 00:28:20 NOTICE: Google drive root 'Audio': 14042 matching files

But assume no corruption check has been carried out.

Is this something on the rclone or GDrive side? Or just due to the large number of files copied as I'm only seeing the error after the initial bulk copy. Any subsequent checks after sleep when no files are copied, there's no error.

 

2024-06-17 20:42:13,830 DEBG 'start-script' stdout output:
[info] Running rclone copy for local media share '/Audio' to remote 'GoogleDrive'...

2024-06-17 23:58:18,017 DEBG 'start-script' stdout output:
{
        "error": "connection failed: Post \"http://localhost:5572/sync/copy\": EOF",
        "path": "sync/copy",
        "status": 503
}

2024-06-17 23:58:18,026 DEBG 'start-script' stdout output:
[info] rclone copy finished

2024-06-17 23:58:18,028 DEBG 'start-script' stdout output:
[info] Running rclone post check, report located at '/config/rclone/reports/local-to-remote-GoogleDrive-combined-audio.txt'...

2024-06-18 00:28:20,721 DEBG 'start-script' stdout output:
[info] rclone post check finished

2024-06-18 00:28:20,722 DEBG 'start-script' stdout output:
[info] rclone finished, sleeping 24h before re-running...

 

Any advice would be much appreciated.

Thanks

Edited June 18, 20242 yr by fka

Hey, I have this awesome container running and my initial sync worked like a charm. it syncs a dir on unraid to OneDrive.  Is there a way to get rclone to auto copy and newly created files in the unraid dir to onedrive?

It will automatically copy any new files from source to remote when it completes it's sleep period and re-runs the copy service.

It doesn't continuously look for and auto detect new files and transfer them.

 

What have you set in the container variable "RCLONE_SLEEP_PERIOD"? Default is 24h. i.e it runs the copy process once every 24hrs.

You can set this to 1m for example and it will run the copy service every minute. However if you're local and remote have large number of files, despite nothing being copied if there are no new files, it will still run the post check which will take a long time to complete and use a lot of system resources. Thus isn't practical.