Jump to content
nerdbot

Local and Cloud Backup advice

5 posts in this topic Last Reply

Recommended Posts

Hi all,

 

I've been evaluating Unraid for about a week now and, for my needs, I'm quite impressed.  I'll most likely be picking up a license soon.  I've already installed the Community Applications, Nerd Tools, CA Backup/Restore, and Unassigned Devices plugins and configured them.

 

About a decade back, I setup a simple home backup using rsnapshot on a Linux server and rsync installed on the Windows and Mac computers in my house.  I liked having daily, weekly, and monthly incremental backups, but I was missing the offsite portion of any good backup system.  Cloud storage was still relatively new/expensive for consumers, and I wasn't aware of any easy way to encrypt/decrypt what I stored in the cloud.  Fast forward to now and I see there are so many options, so I'm revisiting the idea, especially now with Unraid.

 

I plan to use rsnapshot again on my Unraid server, keeping daily, weekly, and monthly snapshots on the array.  I'd only be using this setup for really important files (family pictures, important documents, etc), so I don't expect this storage to grow too quickly in size (I'm looking at about 100GB right now).  With rsnapshot and local storage, these snapshots are space efficient by using hard links for files that haven't changed between backups, but it's not clear to me how I'd achieve the same thing in cloud storage.

 

From the research I've done so far, I should be able to just use something like Rclone, Duplicati, or Borg and upload the latest weekly backup (assuming the top level directory name remains unchanged).  Rclone/Duplicati/Borg will determine which files have changed and only upload those files to the cloud storage service like Backblaze or CrashPlan, and then Backblaze/Crashplan will handle versioning the file for me.  So  I won't explicitly have daily, weekly and monthly rsnapshot directories in cloud storage, but instead I'll be able to see different versions of files as they change over time.  Does that sound about right?  If so, will I be able to do this with any cloud storage service, or is there a particular feature I need to look for when choosing a company?  

 

Or maybe a better question is, is there a better way to achieve my goal? (I realize it's possible rsnapshot is a really old way of doing things)

Edited by nerdbot

Share this post


Link to post

Hey, sorry nobody has replied to you.  I've become very interested in the topic of the "best backup" solution for unRAID.

 

Duplicati on the surface seems pretty awesome.  However, a lot of users including myself had nothing but errors.  It still needs a lot of heavy development.  

 

I wrote a guide on combining RCLONE+BORG.  Borg does a really great job at creating your repos while utilzing compression, deduplication, encryption, pruning etc.  And you would then use RCLONE to push that BORG repo up to your offsite storage.  The guide is here https://www.reddit.com/r/unRAID/comments/9md2hh/tutorial_rclone_borg_for_your_awesome_backup_needs/

 

Lately though, I stumbled across Duplicacy.  This piece of software is pretty awesome as it's faster than BORG in some benchmarks AND it uploads to the cloud or locally without the need of using RCLONE.  @walle wrote a pretty cool guide here. https://forums.unraid.net/topic/73796-solved-install-duplicacy-install-binary/?tab=comments#comment-687737&searchlight=1

 

Let me know if you have any specific questions.

 

Share this post


Link to post

Hi xhaloz, thanks for the response.  I went back to working on my rsnapshot script to backup the devices in the house to the Unraid server, then got sidetracked with some other issues with Unraid as well as just busy in my regular day-to-day, so I haven't reached the off-site portion of my backup plan yet.  I'll definitely look into the links you provided.  Re: Duplicacy, I would just need the CLI license, which is $20/year for the license?

Share this post


Link to post
22 hours ago, nerdbot said:

Hi xhaloz, thanks for the response.  I went back to working on my rsnapshot script to backup the devices in the house to the Unraid server, then got sidetracked with some other issues with Unraid as well as just busy in my regular day-to-day, so I haven't reached the off-site portion of my backup plan yet.  I'll definitely look into the links you provided.  Re: Duplicacy, I would just need the CLI license, which is $20/year for the license?

 

Quote

Free for personal use or commercial trial

Source: https://github.com/gilbertchen/duplicacy#license

 

Just download the binary and you are good to go. My post about my installation doesn't include how to work with Duplicacy, but there are guides like this one that gives an idea how to work with it.

Share this post


Link to post
On 1/22/2019 at 7:00 AM, xhaloz said:

Hey, sorry nobody has replied to you.  I've become very interested in the topic of the "best backup" solution for unRAID.

 

Duplicati on the surface seems pretty awesome.  However, a lot of users including myself had nothing but errors.  It still needs a lot of heavy development.  

 

I wrote a guide on combining RCLONE+BORG.  Borg does a really great job at creating your repos while utilzing compression, deduplication, encryption, pruning etc.  And you would then use RCLONE to push that BORG repo up to your offsite storage.  The guide is here https://www.reddit.com/r/unRAID/comments/9md2hh/tutorial_rclone_borg_for_your_awesome_backup_needs/

 

Lately though, I stumbled across Duplicacy.  This piece of software is pretty awesome as it's faster than BORG in some benchmarks AND it uploads to the cloud or locally without the need of using RCLONE.  @walle wrote a pretty cool guide here. https://forums.unraid.net/topic/73796-solved-install-duplicacy-install-binary/?tab=comments#comment-687737&searchlight=1

 

Let me know if you have any specific questions.

 

Hi

 

I was looking into the borg+rclone setup and it looks like this is what I need.

 

Is it possible to change the script to get discord notifications and not email notifications when backups has error or is done?

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.