I would love this.

 

Name: Native Automated Backup Solution

 

Description: A means by which to schedule and run (unmanaged) a backup of selectable shares to a location of my choice over a selectable number of protocols.

 

Users: Non "Soho / Advanced Users" (So command line access / special Linux / Unraid tweaking or knowledge is not required).

 

Assumptions: Backing up Data is LT recommended/expected of ALL users who want to secure their data. Manageable from the GUI as LT only expects advanced / Soho users to access the command line. Would use of existing Linux tools / Software. A standard user would want: Multiple Backup Profiles, within that multiple sources to backup, the ability to select variables from dropdown lists (or similar), ability to select different types of local destinations, ability to select specific files (in single or multiple) or groups (e.g. file extensions) to exclude from the backup, a number of additional options (e.g. incremental, full backup, compression, archive), the ability to flexibly schedule the backup (hourly, daily, weekly, monthly etc etc).

 

Flow (With example):

 

Note: I use terms like "Profile", "Source"

 

Select Backup Tab in Unraid GUI

 

Add Profile and name it "Weekly"

Within Weekly Profile:

 

Add Source Type "Share"

Add Source "Movies"

Add Source "Television"

 

Add Source Type "Disk"

Add Source "Cache Drive"

 

Add Source Type "Folder"

Add Source "Unraid Config"

Add Source "Syslog Folder"

 

Select Files to exclude from each source.

Select FileTypes to exclude from each source.

 

Select Backup options:

Full backup off

Incremental on

Archive off

Compression off

Delete Files off

Validate File Transfer on

Retry Count 5

Detailed error log on

Take Array down on (perhaps faster)

 

Select Destination Type "Network" (But could be local - e.g. plugged in USB drive)

Browse Network Destination Types (could be similar to how you select a network location on Kodi)

Select "NFS Shares"

Select "Back-up Server"

Select "NAS"

Select "Weekly Incremental Backup"

 

Select Recurrence Type "Weekly"

Select Day "Sunday"

Select Time to Run "12:00"

 

Select "Enabled"

Select "Save Profile"

 

Review a Summary of Profile on Main Backup Tab in Unraid.

Add another Profile if you like.

 

Alternate Flow

 

The above is just a suggestion so I won't add "Alternates" here. I guess there are going to be many limitations not least of which is the GUI itself and what it is written with. But I guess users would have allot of input here and would be teased out through BETA's etc.

 

Exceptions

 

I was thinking of things like:

 

Conflicting Backups

Local Available Sources Only

Available Space

Local Hardware (e.g. Network Cards - dedicated??, USB# or eSATA ports etc)

Remote Hardware (e.g. Routers, cables)

Array Availability (only run if the array is "Up" at the time of schedule)

 

Output

 

Backup is executed.

Files Copied / Not Copied.

Status list of Backups on Summary Tab next to Profile (e.g. <Date><Duration><Status> <Errors> <Warnings><Log> - <12/12/2016> <5 Hours> <OK> <0> <2> <Download Here>

 

End.

 

 

Further Thoughts: I guess you could rig some of the status info into the Notification System in Unraid (e.g. Started, Aborted, Finished).

 

 

Anyway, this is my stab at a feature request I would really like. I guess it could be implemented through the integration of an existing solution into Unraid - but either way id like it to be part of and supported by Unraid.

Nice write up. Pretty comprehensive.

I agree 100% this is a #1 priority need for Unraid to integrate into the system GUI.

Everyday more and more users are asking for this means to have an automated backup with an integrated GUI in Unraid.

It would be fantastic if we could get an actual commitment from LT.

I know they once said they were considering it in the future.

After we release 6.0, we will revisit feature requests for future planning...this is high on my personal list, but not a small endeavor to get it right, and one where we would also be competing with other solutions (some of which can run on unraid itself).

 

Great write up!  Thank you for taking the time to do so!

Agree it'd be a nice feature to have integrated => but as jonp noted, there are many other solutions that can do virtually everything asked except they aren't natively incorporated in UnRAID.    Some even run in Linux (although I'm not a "Linux guy" so I can't suggest any).    If you have any "always on" clients running Windows, SyncBack works VERY nicely; does everything asked for (and more); and has a freeware version with all the features you really need [i use the paid SE version, but only because the freeware version didn't have a couple of features that it did -- but the current free version now has the specific features that motivated me to pay a few years ago].

 

With v6, you could simply set up a Windows VM on your UnRAID box, and use SyncBack, or any of the many other Windows-based utilities that do this.

 

@Jonp @thestewman: No worries. I figure if I am going to request a feature I should do it as reasonably good as I can.

 

Agree it'd be a nice feature to have integrated => but as jonp noted, there are many other solutions that can do virtually everything asked except they aren't natively incorporated in UnRAID.    Some even run in Linux (although I'm not a "Linux guy" so I can't suggest any).    If you have any "always on" clients running Windows, SyncBack works VERY nicely; does everything asked for (and more); and has a freeware version with all the features you really need [i use the paid SE version, but only because the freeware version didn't have a couple of features that it did -- but the current free version now has the specific features that motivated me to pay a few years ago].

 

With v6, you could simply set up a Windows VM on your UnRAID box, and use SyncBack, or any of the many other Windows-based utilities that do this.

 

@garycase: Yeah I know. We discussed this option in another thread some weeks ago. To be pretty honest its a good solution IMHO with the resources you mention. Trouble is, I don't have them.

 

In my scenario I only run 2 Mac's (Macbook and iMac), iPads and and iPhones. I really don't want to shell 100's $$'s on a Windows Licence just to run in a VM and for 1 Program (which I "might" have to pay for too"). I know I am reasonably competent with Linux and am comfortable on the command line - but I don't want to have to be. I know I could write a script, edit CRON and have rsync running. Back in the day when all I did was tinker that would be fine - but now Im older, for me, not so much. Even now "almost without me seeing it" Unraid has become a Hobby than an Appliance for me. When it was pointed* out to me I did wonder why? I remember a few years ago when using ReadyNAS and was playing with their GUI when I thought - Jeez, my Grandma could do this! OK - their product sucked for my needs but their integrated features and GUI were excellent!

 

Anyway, I know I will probably follow your lead and use that Windows Solution. I do like it and it provides as close to what I want that I am going to get right now! Fact is, I need a backup solution no matter what and this feature is not going to be developed overnight. But if you don't ask, you don't get. :-)

 

P.S. @ALL - it would be nice to see some + 1 or - 1 posts from people in the community. Would be interesting to see how they felt this feature (or similar) ranked.

 

*spending more personal time in front of the computer than "other more important things* LOL!

After we release 6.0, we will revisit feature requests for future planning...this is high on my personal list, but not a small endeavor to get it right, and one where we would also be competing with other solutions (some of which can run on unraid itself).

Great write up!  Thank you for taking the time to do so!

 

Thanks for the positive response Jon

I understand about not wanting to compete with any current systems out there.

Problem for the majority is.  How to get that system that works to backup your external source and most importantly get it to backup all or a selective part of your Unraid.

If you do not have a background in command line your dead in the water.

 

If someone did it as a Docker or plugin or showed us how to easily do it as a VM I would buy another Unraid license an another Unraid machine in an instant.

 

Agree it'd be a nice feature to have integrated => but as jonp noted, there are many other solutions that can do virtually everything asked except they aren't natively incorporated in UnRAID.    Some even run in Linux (although I'm not a "Linux guy" so I can't suggest any).    If you have any "always on" clients running Windows, SyncBack works VERY nicely; does everything asked for (and more); and has a freeware version with all the features you really need [i use the paid SE version, but only because the freeware version didn't have a couple of features that it did -- but the current free version now has the specific features that motivated me to pay a few years ago].

 

With v6, you could simply set up a Windows VM on your UnRAID box, and use SyncBack, or any of the many other Windows-based utilities that do this.

I understand how to use SyncBack but am lost with the Windows VM.

A Windows license doesn't need to cost anywhere close to $100 if you want to just build a VM.  You could even use XP ... you can buy media with COA's on e-bay for $10-15 for this, and that's all you need to run SyncBack (or most other backup utilities).

 

... I understand how to use SyncBack but am lost with the Windows VM.

 

v6 has a built-in hypervisor, so you can simply create a new virtual machine; load it with Windows [XP, Vista, '7, '8, etc.] ... and then run SyncBack in that virtual machine.

 

 

If someone did it as a Docker or plugin or showed us how to easily do it as a VM I would buy another Unraid license an another Unraid machine in an instant.

 

 

An officially supported LT Docker or VM for backup with a non assuming guide and set of instructions. There is an idea, and a bloody good one for an interim measure! +1 for that!!

Another thought r.e. a Windows VM ==> It's fairly likely that Windows 10 is going to free when it's released.  Not clear if that's really free, or only free as an upgrade for existing '7 and '8 systems.    If it's free for a clean install, then you could simply create a Windows 10 virtual machine, and there'd be no cost at all for a license.  [Assuming the hypervisor in UnRAID v6 will support '10]

 

 

Agree it'd be a nice feature to have integrated => but as jonp noted, there are many other solutions that can do virtually everything asked except they aren't natively incorporated in UnRAID.    Some even run in Linux (although I'm not a "Linux guy" so I can't suggest any).    If you have any "always on" clients running Windows, SyncBack works VERY nicely; does everything asked for (and more); and has a freeware version with all the features you really need [i use the paid SE version, but only because the freeware version didn't have a couple of features that it did -- but the current free version now has the specific features that motivated me to pay a few years ago].

 

With v6, you could simply set up a Windows VM on your UnRAID box, and use SyncBack, or any of the many other Windows-based utilities that do this.

 

@garycase: Yeah I know. We discussed this option in another thread some weeks ago. To be pretty honest its a good solution IMHO with the resources you mention. Trouble is, I don't have them.

 

In my scenario I only run 2 Mac's (Macbook and iMac), iPads and and iPhones. I really don't want to shell 100's $$'s on a Windows Licence just to run in a VM and for 1 Program (which I "might" have to pay for too"). I know I am reasonably competent with Linux and am comfortable on the command line - but I don't want to have to be. I know I could write a script, edit CRON and have rsync running. Back in the day when all I did was tinker that would be fine - but now Im older, for me, not so much. Even now "almost without me seeing it" Unraid has become a Hobby than an Appliance for me. When it was pointed* out to me I did wonder why? I remember a few years ago when using ReadyNAS and was playing with their GUI when I thought - Jeez, my Grandma could do this! OK - their product sucked for my needs but their integrated features and GUI were excellent!

 

Anyway, I know I will probably follow your lead and use that Windows Solution. I do like it and it provides as close to what I want that I am going to get right now! Fact is, I need a backup solution no matter what and this feature is not going to be developed overnight. But if you don't ask, you don't get. :-)

 

P.S. @ALL - it would be nice to see some + 1 or - 1 posts from people in the community. Would be interesting to see how they felt this feature (or similar) ranked.

 

*spending more personal time in front of the computer than "other more important things* LOL!

 

Danioj

 

If you do a Windows VM with Syncback it would be well appreciated if you detailed how step by step so the less able could duplicate it.

... An officially supported LT Docker or VM for backup with a non assuming guide and set of instructions. There is an idea, and a bloody good one for an interim measure! +1 for that!!

 

+1

 

Definitely a good idea !!

 

... I understand how to use SyncBack but am lost with the Windows VM.

 

v6 has a built-in hypervisor, so you can simply create a new virtual machine; load it with Windows [XP, Vista, '7, '8, etc.] ... and then run SyncBack in that virtual machine.

 

I almost didn't want to write this because you are one of the more helpful Mod's on any forum I've visited BUT I had to. Sorry!

 

I think that post in itself (EDIT: Highlights) is the problem. If I said that out loud in my household right now - I probably would be accused of speaking some foreign language, having a stroke and or drinking in the morning. I think such an important thing as backing up needs to be ..... "simpler". I think the Average User (as LT defines it) would not have a clue what you're talking about!!

 

Agree it'd be a nice feature to have integrated => but as jonp noted, there are many other solutions that can do virtually everything asked except they aren't natively incorporated in UnRAID.    Some even run in Linux (although I'm not a "Linux guy" so I can't suggest any).    If you have any "always on" clients running Windows, SyncBack works VERY nicely; does everything asked for (and more); and has a freeware version with all the features you really need [i use the paid SE version, but only because the freeware version didn't have a couple of features that it did -- but the current free version now has the specific features that motivated me to pay a few years ago].

 

With v6, you could simply set up a Windows VM on your UnRAID box, and use SyncBack, or any of the many other Windows-based utilities that do this.

 

@garycase: Yeah I know. We discussed this option in another thread some weeks ago. To be pretty honest its a good solution IMHO with the resources you mention. Trouble is, I don't have them.

 

In my scenario I only run 2 Mac's (Macbook and iMac), iPads and and iPhones. I really don't want to shell 100's $$'s on a Windows Licence just to run in a VM and for 1 Program (which I "might" have to pay for too"). I know I am reasonably competent with Linux and am comfortable on the command line - but I don't want to have to be. I know I could write a script, edit CRON and have rsync running. Back in the day when all I did was tinker that would be fine - but now Im older, for me, not so much. Even now "almost without me seeing it" Unraid has become a Hobby than an Appliance for me. When it was pointed* out to me I did wonder why? I remember a few years ago when using ReadyNAS and was playing with their GUI when I thought - Jeez, my Grandma could do this! OK - their product sucked for my needs but their integrated features and GUI were excellent!

 

Anyway, I know I will probably follow your lead and use that Windows Solution. I do like it and it provides as close to what I want that I am going to get right now! Fact is, I need a backup solution no matter what and this feature is not going to be developed overnight. But if you don't ask, you don't get. :-)

 

P.S. @ALL - it would be nice to see some + 1 or - 1 posts from people in the community. Would be interesting to see how they felt this feature (or similar) ranked.

 

*spending more personal time in front of the computer than "other more important things* LOL!

 

Danioj

 

If you do a Windows VM with Syncback it would be well appreciated if you detailed how step by step so the less able could duplicate it.

 

OK - I will. Not sure the licensing issues of distributing Windows (even un registered) in a VM but when I set one up I will document it step by step. If there are any licensing grey areas with Windows I doubt LT would host or support it and I've never seen a Windows VM hosted ANYWHERE before!

 

My Backup Rig is setup and waiting for my 8TB Seagates - now coming Mid April - but this is something I can do till then! Watch this space - will post as a separate project in another forum! Will PM when I do.

... I understand how to use SyncBack but am lost with the Windows VM.

 

v6 has a built-in hypervisor, so you can simply create a new virtual machine; load it with Windows [XP, Vista, '7, '8, etc.] ... and then run SyncBack in that virtual machine.

 

I almost didn't want to write this because you are one of the more helpful Mod's on any forum I've visited BUT I had to. Sorry!

 

I think that post in itself is the problem. If I said that out loud in my household right now - I probably would be accused of speaking some foreign language, having a stroke and or drinking in the morning. I think such an important thing as backing up needs to be ..... "simpler". I think the Average User (as LT defines it) would not have a clue what you're talking about!!

 

Again ! Absolutely right on target. I understand the terminology, but I, as well as many Unraid users are at a loss on where to start and how to do it.

I have looked but cannot find anything that approaches how to implement and use the hypervisor in Unraid 6.

Thanks for the offer to PM.

... I understand how to use SyncBack but am lost with the Windows VM.

 

v6 has a built-in hypervisor, so you can simply create a new virtual machine; load it with Windows [XP, Vista, '7, '8, etc.] ... and then run SyncBack in that virtual machine.

 

I almost didn't want to write this because you are one of the more helpful Mod's on any forum I've visited BUT I had to. Sorry!

 

I think that post in itself is the problem. If I said that out loud in my household right now - I probably would be accused of speaking some foreign language, having a stroke and or drinking in the morning. I think such an important thing as backing up needs to be ..... "simpler". I think the Average User (as LT defines it) would not have a clue what you're talking about!!

 

Again ! Absolutely right on target. I understand the terminology, but I, as well as many Unraid users are at a loss on where to start and how to do it.

I have looked but cannot find anything that approaches how to implement and use the hypervisor in Unraid 6.

Thanks for the offer to PM.

I've been working on new documentation for unRAID 6 which also includes a guide on creating VMs.

Sorry for speaking "greek" 

 

A hypervisor, in English, is simply a program that creates a "fake" computer (virtual) that you can load with an operating system just like you would if it was a real system.

 

You load it exactly as you would a new barebones PC.  This can, of course, be intimidating if you've never done that;  but the process is quite simple.  You just insert a CD/DVD with the operating system, boot to the CD/DVD, and follow the instructions.    In a virtual machine, "inserting a CD/DVD" may (in fact usually is) be another "virtual" operation, where you do it by pointing to an ISO image of the CD/DVD ... but it works the same way.

 

Once you've got it done, the virtual machine "boots" just like a real PC.  Using it is no different than using a second physical box running the same operating system ... it just has the advantage that it's actually running on the same hardware as your UnRAID server.

 

Hopefully the guide jonp is creating for v6's virtual machine manager will be easy to follow and you'll be much less intimidated [and won't feel like it's "Greek"  ]

 

 

 

Sorry for speaking "greek" 

 

...

 

Hopefully the guide jonp is creating for v6's virtual machine manager will be easy to follow and you'll be much less intimidated [and won't feel like it's "Greek"  ]

 

I actually tried it and said it out loud for grins. The response I got back was ... "Geek". Not quite, but close! :-)

IMO. All of the things requested can be accomplished with rsycn. All that really needs to be done is someone needs to create a rsync script that's generic (using variables) which can be defined by the user in a php form and saved to one or more config files which the script uses when it runs. 

IMO. All of the things requested can be accomplished with rsycn. All that really needs to be done is someone needs to create a rsync script that's generic (using variables) which can be defined by the user in a php form and saved to one or more config files.

 

Agree -- a nice Docker that provide a GUI interface to set up all the parameters would, I'm sure, be VERY popular 

IMO. All of the things requested can be accomplished with rsycn. All that really needs to be done is someone needs to create a rsync script that's generic (using variables) which can be defined by the user in a php form and saved to one or more config files.

 

Agree -- a nice Docker that provide a GUI interface to set up all the parameters would, I'm sure, be VERY popular 

 

Whatever solution LT choose to satisfy the requirement I guess is up to them. BUT, I would be VERY surprised if it is as simple as you are suggesting. What you are suggesting really is Trivial - the script could be rigged up in a matter of hours - the more difficult bit (I guess) would be capturing and managing the user interaction and state of the running jobs long with its impact on the array - but Array aside even that would not be Rocket Science for a trained and competent web application developer.

 

Given Jonp's comment above about this being non trivial, either LT have a solution to implement which is vastly different than what you are suggesting or they know something about implementing it that we don't!

 

Whatever solution LT choose to satisfy the requirement I guess is up to them. BUT, I would be VERY surprised if it is as simple as you are suggesting. What you are suggesting really is Trivial - the script could be rigged up in a matter of hours - the more difficult bit (I guess) would be capturing and managing the user interaction and state of the running jobs long with its impact on the array - but Array aside even that would not be Rocket Science for a trained and competent web application developer.

 

Given Jonp's comment above about this being non trivial, either LT have a solution to implement which is vastly different than what you are suggesting or they know something about implementing it that we don't!

 

90% of what you suggested can be implemented using rsync and a little scripting currently.

 

I am not saying that writing a good wrapper (excuse me if I misspeak, I am a hobbyist not a professional) which allows users to create their own config without breaking the script is trivial.  The thing that makes this far more complicated is setting up automated backups to remote locations, not impossible but adds an additional wrinkle in that it requires athentication with no user input. Again not trivial but also not imposible.

 

I would work on this, and really want to, but I am a noob when it comes scripting, and I don't know PHP or how to take a PHP web form and read / write to background files.