Jump to content
techsperion

Easy, Robust, unRAID Cloud backup using CloudBerry and BackBlaze

16 posts in this topic Last Reply

Recommended Posts

This tutorial is for a simple Backup solution for your entire unRAID box, flash drive and all.

 

Please note, it will involve paying money for things. I'm aware this can be accomplished with tools like rclone and @SpaceInvaderOne has done a brilliant tutorial on how to do that. However, my requirements were as follows:

  1. I just wanted a GUI solution that will offer the same fine grained control with minimum setup.
  2. I wanted something reliable as my data in invaluable.
  3. I didn't want to risk losing anything because I cheaped out on something.

 

Both the application I chose and the storage provider offer trial / free tier options so you can try this tutorial out.

 

If it's not for you, no harm no foul.

 

Some of you will also be averse to "Handing your data over to the corporations". I respect that, but I can't risk losing a lifetime of family photos so i'm willing to pay for a little piece of mind.

 


The Cost
1. CloudBerry Backup
This is the application that will be used to initiate, schedule, monitor, and track the backup.
It's a $29.99 one off cost and in my mind was well worth it. They are reputable and have a great suite of products.
If you don't want to use BackBlaze as I have, you can also connect CloudBerry to a host of other storage providers.
It also caters for encryption and in the event of a disaster it has restore functionality as well.
CloudBerry offer a 15 Day trail so you can test out the functionality and see if it fits your use case.

 

EDIT:

After some great sleuth work by @charlescc1000 , looks like the personal edition of CloudBerry is limited to 5TB worth of data. so this guide will work well if you're under that limit. Looks like if you're above that limit you will need to buy the Linux Ultimate Version which is $149.99. Please bear this in mind. Might be extortionate for some, but personally I think it's okay as a one off cost. You're able to upgrade and pay the difference once you hit the limit as well. 

 

2. BackBlaze
Another reputable company in the backup business, BackBlaze was my provider of choice.
It will cost you $0.005/GB/month so $5/TB/month.
It is much faster compared to offerings from CrashPlan and is cheaper than S3 (non-glacier), Azure, and Google Cloud.
There is no fee for getting your data into BackBlaze but there is a 0.01/GB cost for download.
They also integrate with many other vendors such so if you decide to switch to another NAS solution you can get your data onto there as well.
It's pay for what you use so I won't be capped / paying for anything I'm not using. BackBlaze give you the first 10GB Free for you to test.

 

The Solution
1. Buy CloudBerry
The variant you need to buy is CloudBerry Desktop Backup for Linux. After you've purchased it they will email you an activation code.
We'll keep this handy for the next step.

 

2. Install CloudBerry container.
Head over to the APPS tab in unRAID. If you can't see it you need to install the Community Applications plugin.
Search for CloudBerry and click the install button under it.

 

image.png.89b8c1d895bc3dfce961abc07d599b43.png

 

image.thumb.png.cb8f60aa463d56e9e719980a6853b604.png

 

You can keep all the default values and click apply.

Head to the Docker tab in unRAID, click the play icon on CloudBerryBackup followed by WebUI.

 

image.png.1e92f48d9589c94635071a01b39cbb0a.png

 

  1. Choose Activate (If you've purchased) or Trial
  2. Enter your details and click finish.
  3. Congratulations you've installed CloudBerry!

 

image.png.f8b1be97782d02fd4a49d6114cfbafd8.png

 

Click the Backup / Backup Files Button which will open the Cloud Storage window. Click on the little plus icon followed by BackBlaze B2.
We can leave this window as is and come back to it after we've setup BackBlaze.

 

 

image.png.086638fefb5a754813c0f04ae54a782c.png

3. Create BackBlaze account
You can sign up to BackBlaze free of charge and You can use a google account to sign in if that makes it easier.

  1. In your account click on Settings on the left and scroll down to Enabled Products.
  2. Next to B2 Cloud Storage, Click on the Link to Verify your Mobile Number.
  3. Once your number is verified enable B2 Cloud Storage.

 

image.png.962f1c4bf2917395c72c722b734470d0.png

 

4. Create a Bucket and Get the Keys
A bucket is just a container for keeping files or like a top level folder. Why would you want more than 1 bucket? In the case that you wanted a different
set of rules for backup schedules and wanted to keep your data separate this is how you'd do it. Also if you wanted to backup more than one device to it's own bucket
you could create multiple buckets to do so.
For me I just wanted all my data stored in a single bucket (your folder structure will remain in the bucket so not to worry).

 

  1. Click on create Bucket.
  2. Chose a unique name (this will need to be globally unique, meaning no one else in the world can have this bucket name)
  3. Click Create.

 

image.png.77b91ffea6bb9d45f04a324527f07df4.png

 

Now that we've created the bucket that will hold all the data we need the keys to it. For this we click on Show Account ID and Application Key.

 

image.png.5c85ff0c0ed9f40b71bd5ff04325be7c.png

 

Here again you have quite fine grained control over your bucket via multiple Application Keys. So if you had one of your friends backup up to your bucket.
you'd create an application key for them and not give them the master one. In the event you'd like to revoke access / change certain permissions without affecting
other keys you could do that.

For me, I've just got a single device backing up so I'm going to use the Master Application Key. Please note that Master Keys are only displayed once.
So once you click Create New Master Application Key keep the window open we're going to use it immediately.

Copy your application ID to your clipboard for bonus efficiency points.

 

5. Create The Backup Schedule
Head back to our CloudBerry Container WebUI and choose a display name for this Backup plan.
You can create multiple backup Plans if you wish but we're just creating a single one for now to backup the entire server.

The thing to note here is that we're VNCd into the containers WebUI so your computers clipboard isn't shared with it. The way we use the containers clipboard is
with the clipboard button on the top right in the Navbar. Click on the Clipboard button, paste your application ID into the box and click submit.

 

image.png.6422d351412c1a61f9367c108eacf9bb.png

 

You can now paste your Application ID into the CloudBerry dialog box.

Now Do the same for the Master Application Key.

 

Click the drop down box next to Bucket.
After 1 or 2 seconds you will see the Bucket name that we created in the previous step. Hoorah!

 

image.png.c0f8dbe002793192e349bea55f0ab220.png

 

Under Advanced Settings you can choose a prefix that this backup plan will use in the bucket. This is useful if you have more than one backup plan.
So in the BackBlaze you will see the structure:
 

Bucket > Prefix name > Folders-that-are-backed-up

 

Select Okay and click on the Plan we've just created and click Continue. Choose a Backup Plan Name and click Continue.

The next window shows a few drives. The one's you're interested in are the first two. The first one of which will just show up as "/".

 

image.png.ed3cca6ab495613cd3635f5b5e665e90.png

 

If you'd like to backup the contents of your flash drive click the tick box next to it. Expand the first drive and scroll down to the folder labeled "storage"

This should immediately look familiar to you. Yes! They are your shares.

Select the folders you want to backup or choose "storage" if you want to backup everything followed by Continue.

 

Now the next settings namely:

  • Advanced Filters
  • Encryption
  • Retention Policies
  • Schedule
  • Notifications

Are best answered by you alone. I personally Backup all the files in the storage folder, with encryption on, retain all the files, and backup daily at midnight.
The backup is an incremental backup so only files that have been added or changed will make their way up to BackBlaze.

That being said your options may vary.

To manually start your backup click on your backup plan in CloudBerry (myBackupPlan) and click Start. Your backup should immediately begin.

 

image.png.6ef9d5d60744ea9c104bb55e5e0f0be5.png

 

To see the fruits of your work head back to BackBlaze, Under B2 Cloud Storage click on Browse Files. You should see your bucket there and all your files under it.

 

image.png.265140b5fb96650308d359763f97f05c.png

 

Don't forget to set your container to AutoStart and you should be golden :)

 

 

 

 

 

image.png

Edited by yusuflimz
critical Information provided by user
  • Like 3
  • Upvote 2

Share this post


Link to post

Really well written and helpful thanks! Could you add a restore procedure as well?

Share this post


Link to post

Nice tutorial!  I just created a Windows VM and use regular Backblaze (unlimited storage, $50 a year) client on it to back my stuff up.  Map a drive(s) to the share(s) necessary on your unRAID box via a service account (so the Backblaze client will be able to process them like a system drive), selected what i wanted to back up, done.

 

Backups, restores, etc, all easy peasy, even from the Backblaze web interface.

  • Like 1
  • Upvote 1

Share this post


Link to post

This is a great write-up and should work well for many people with less than 5TB of data.

 

I previously used CloudBerry but quickly discovered that the backup software has a maximum of 5TB of data that it can manage unless you purchase the enterprise edition for $300.

 

So this is an important consideration as many unraid users probably have far more than 5TB of data they would like to backup.

Share this post


Link to post
4 minutes ago, charlescc1000 said:

This is a great write-up and should work well for many people with less than 5TB of data.

 

I previously used CloudBerry but quickly discovered that the backup software has a maximum of 5TB of data that it can manage unless you purchase the enterprise edition for $300.

 

So this is an important consideration as many unraid users probably have far more than 5TB of data they would like to backup.

Just checked:

 

5 TB Storage Limits [PRO]

Data volume you can manage with CloudBerry Backup is 5 TB in PRO version and 200 GB in freeware version. CloudBerry Lab doesn't offer storage, you need to buy from storage providers separately.

 

Goddamnitt...

Share this post


Link to post

about a year and a half ago I bought the linux standard edition, which shows up as "server edition." 

 

My license says server edition and I'm currently at 6tb and have gone up to 10 or so before without hitting any limit. 

 

also of note, there is a way to run dual installs (or as many as you want) on the same registered license. but really you should just give them your money.

Share this post


Link to post
1 hour ago, JasonK said:

Nice tutorial!  I just created a Windows VM and use regular Backblaze (unlimited storage, $50 a year) client on it to back my stuff up.  Map a drive(s) to the share(s) necessary on your unRAID box via a service account (so the Backblaze client will be able to process them like a system drive), selected what i wanted to back up, done.

 

Backups, restores, etc, all easy peasy, even from the Backblaze web interface.

 

This is a great idea! I don't have the extra horsepower on my machine to keep a windows VM up all the time though :(

But never the less good shout!

 

Share this post


Link to post
1 hour ago, charlescc1000 said:

This is a great write-up and should work well for many people with less than 5TB of data.

 

I previously used CloudBerry but quickly discovered that the backup software has a maximum of 5TB of data that it can manage unless you purchase the enterprise edition for $300.

 

So this is an important consideration as many unraid users probably have far more than 5TB of data they would like to backup.

Updated the post! However there is a server version avaiable are you aware of any limits there? I can't seem to find any :/

Share this post


Link to post

This is perfect timing as I am looking for ways to backup my server using cloudberry. 

Except that I don't want to back it up to the cloud, I want to back it up to another unraid server in a remote location.

Can someone make a tutorial on how to do that, or what's the best way to do that? I have another post about this in general and came to the conclusion to use cloudberry. I do not mind paying, but I don't quite yet know how to back up to the remote server. VPN? What are the logistics of that? Meaning is it something that will always be connected, or I can set it to connect just before cloudberry backs up and then disconnects? or is there another way? Would appreciate it

Share this post


Link to post

YUSUFLIMZ - OP, thanks for the fantastic write-up!
 

On 2/11/2019 at 10:16 AM, JasonK said:

Nice tutorial!  I just created a Windows VM and use regular Backblaze (unlimited storage, $50 a year) client on it to back my stuff up.  Map a drive(s) to the share(s) necessary on your unRAID box via a service account (so the Backblaze client will be able to process them like a system drive), selected what i wanted to back up, done.

 

Backups, restores, etc, all easy peasy, even from the Backblaze web interface.

definitely an interesting way to beat around the bush. just depends on which backup service you use. I'm assuming you did this because of the higher back blaze $ price tag for a server/nas box, right?...

Share this post


Link to post

...how to backup 42TB??? Backblaze takes $ 210/month - lel - i think its cheaper to buy a second server 🤣

Share this post


Link to post

Yeah, I'm sure many folks will be delighted when Cloudberry has a bulletproof way to backup to another unRaid server.  Share your server with some friends with no risk of exposing each others files.

 

At $139 per 8tb drive, you would need $1000 in drives.  That sounds better than $216 per month

Share this post


Link to post
Yeah, I'm sure many folks will be delighted when Cloudberry has a bulletproof way to backup to another unRaid server.  Share your server with some friends with no risk of exposing each others files.
 
At $139 per 8tb drive, you would need $1000 in drives.  That sounds better than $216 per month


...how to backup 42TB??? Backblaze takes $ 210/month - lel - i think its cheaper to buy a second server


Well, BackBlaze do have a $5 / month unlimited option that you could use.

You’d have to create a Windows VM and mount the drive in a way that Windows sees it as a native drive. I think you have to mount it through a service account.

See@JasonK message above

Share this post


Link to post
On 2/11/2019 at 6:16 PM, JasonK said:

Nice tutorial!  I just created a Windows VM and use regular Backblaze (unlimited storage, $50 a year) client on it to back my stuff up.  Map a drive(s) to the share(s) necessary on your unRAID box via a service account (so the Backblaze client will be able to process them like a system drive), selected what i wanted to back up, done.

 

Backups, restores, etc, all easy peasy, even from the Backblaze web interface.

How can you map the drives to windows so they are recognized by backblaze? I dont understand the 'via a service account' bit. Thanks in advance! Any who can help!

Share this post


Link to post
How can you map the drives to windows so they are recognized by backblaze? I dont understand the 'via a service account' bit. Thanks in advance! Any who can help!



Just add a sheduled task, insert "system" in the "run as" field and point the task to a batch file with the simple command

 net use z: /delete and net use z: \\servername\sharedfolder /user:username password



Then select "run at system startup" (or similar, I do not have an English version) and you are done.


Taken from stackoverflow http:// https://stackoverflow.com/questions/182750/map-a-network-drive-to-be-used-by-a-service#comment25569654_4763324


Sent from my iPhone using Tapatalk

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.