[Plugin] CA Appdata Backup / Restore v2

[brent3000 4]

Not sure if this has been covered at all in this long thread, but does anyone know if there is a password option for the compression or some form of protection of the backups at all? 

[Alex.b 12]

Thank you ! I use this plugin for months ! It saved me 2 times !

Just a request, able to create one zip file for each container instead of one big zip file (Mine is almost 20 gb!).

Edited January 14 by Alex.b

[HNGamingUK 13]

This has been requested atleast once before by @aptalca back in 2018 however this still doesn't seem to have been implemented?

 

Basically instead of one tarball of all the appdata directories, please could we have the option to have it seperated per directory? This will make a restore much easier for people who only want to restore one application. Currently they would have to manually untarball the file and move the directory.

 

So the feature request is:

 

Backup:

In the backup config page have a option called "Backup Directories Seperately"

If this option is selected it will backup each directory in the provided appdata directory into a time and dated folder within the provided backup directory.

In addition to this if the "Compression" option is ticked then compress each directory.

 

Restore:

When someone chooses the restore option, along with the date/time selection provide a directory selection to restore (using checkboxes to allow for multiple selections and an "all" option to restore everything)

 

Hopefully this is enough detail for the feature request to be actioned... @Squid

[Squid 2974]

I'm aware of it  

[HNGamingUK 13]

1 hour ago, Squid said:

I'm aware of it  

Appologies to sound like an annoying teenager, but do you have an ETA or maybe roadmap of features. Equally is there a github page for this so that maybe people can help develop the feature? 

[Squid 2974]

No development on anything is happening for at least 5 weeks do to real life constraints.

 

ETA, can't give a solid answer at this point

 

GitHub

https://github.com/Squidly271/ca.backup2

[Gunny 1]

On 1/11/2021 at 11:36 AM, Gunny said:

The Exclude Folders option does not seem to be working for me.  I'm trying to exclude some subfolders in one of my docker container's appdata area (Plex for reference).  I've tried both absolute paths and relative paths.
Relative:

Plex-Media-Server/Library/Application Support/Plex Media Server/Cache/ ,Plex-Media-Server/Library/Application Support/Plex Media Server/Media/ ,Plex-Media-Server/Library/Application Support/Plex Media Server/Metadata/

Absolute:

/mnt/cache/appdata/Plex-Media-Server/Library/Application Support/Plex Media Server/Cache/ ,/mnt/cache/appdata/Plex-Media-Server/Library/Application Support/Plex Media Server/Media/ ,/mnt/cache/appdata/Plex-Media-Server/Library/Application Support/Plex Media Server/Metadata/

 

@Squid I think I found the issue, I opened an issue on Github with the line and suggested fix:
https://github.com/Squidly271/ca.backup2/issues/2

[Moka 0]

Hi, is it possible to choose a specific files to restore in appdata?

[ur6969 2]

I have an uncommon issue and wanted to ask for help.  I run Backup & Restore every day at 3AM.  Works great.

 

However, I have recently begun using a Docker for Don Melton Video Transcoding scripts on some media to reduce sizes and convert to MP4.  This Docker doesn't run like normal and is initiated by a command line command, but it works fine.  I only utilize 1-2 cores to not overload my small server since the time to transcode doesn't matter to me.

 

But this is where I keep having the problem.  At 3:00 AM when Backup & Restore runs it stops the Docker and transcode.  In the Advanced Settings I have the "video-transcoding" Docker set to "Don't Stop".  What else can I do to allow the transcoding to continue?

[discojon 0]

Can we get an option to compress folders individually instead of one giant compressed file?  That would make it much easier to restore individual apps and be easier that a rewrite to allow individual app restoration.

 

Edit.. Nevermind requested above.

Edited January 17 by discojon

[nathan909 0]

I came here looking for an answer to what the above post are asking for. A way to restore only selected app(s). From the sounds off things thats not an option?

[Energen 83]

Extract the files you want manually...

[discojon 0]

1 hour ago, Energen said:

Extract the files you want manually...

I've resorted to that.  It just takes a while to extract a 35Gb rar file.  

[CS01-HS 31]

10 hours ago, discojon said:

I've resorted to that.  It just takes a while to extract a 35Gb rar file.  

 

Extract a Single File(s) From a Large Tarball

[comet424 12]

my sister had a recent flash drive failure and i learning to get a new flash. as i never had a failure so i new

 

but i noticed i set folders with the plugiin here  to set the destination  /backup files/appdata

it shows up as not a real folder.. there is no stamp date and in krusader  it shows up folder created by appdata backup was made in 1969  so i curious is flash drive really backed up as there is no type   why is it like that? i just wanna make sure its is really backed up ... if its nothing then no big deal i just curious i just made sure all the unraids i have have the appdata plugin  and backed up  but they all show  no date etc

 

[Squid 2974]

14 hours ago, comet424 said:

my sister had a recent flash drive failure and i learning to get a new flash. as i never had a failure so i new

 

but i noticed i set folders with the plugiin here  to set the destination  /backup files/appdata

it shows up as not a real folder.. there is no stamp date and in krusader  it shows up folder created by appdata backup was made in 1969  so i curious is flash drive really backed up as there is no type   why is it like that? i just wanna make sure its is really backed up ... if its nothing then no big deal i just curious i just made sure all the unraids i have have the appdata plugin  and backed up  but they all show  no date etc

 

 

Flash backup does work, but I don't know why you're seeing it like that.  All of my systems show it correctly so my first thought is some sort of corruption somewhere along the line on the array.

 

The flash backup is ultimately being deprecated, as it predates the GUI's own flash backup system (non-automated), and something else which is soon(tm)

[comet424 12]

i noticed the Backup of flash i didnt know about  till after i rebooted my sisters unraid where i posted a different thread  for help... but i do like the automatic Flash backup.  i set up Flash backup then set rysnc  to transfer me her 2nd unraid to mine.. so i have copy of her unraid flash and the libirt  etc

 

as for the blank its and the 69 year is on all my unraids... yesterday i setup appback up on my sisters other unraid  so it seems it automaticlly creates it 69 on everything.. so the pic is just a newly setup Appdata backup

 

i spoke with unraid.. and they told me a cloud based.. but told them i hope also still can send to one of my Unraid Servers as a cloud based server to send to my few unraids to back it up.. and i mentioned like windows be nice when Unraid pops up with that Fatal USB drive failure like windows does a Windows Dump  be nice  unraid automaticlly dump the usb configs... as a usb backup only as good from the last backup but if u done 100 changes since a backup  u loose all those..... so i hoping it still automatic  that it sends over the network or to the array  and uploads to (cloud)  to my unraid..

 

since really cloud based means different platforums contacting the same server.. so ur uploading to 1 server in the end.. so hopefully that be to my unraids and even when there is no internet.. if not  the the flash update shouldnt get depreciated...  as i  just got it setup  that least my sisters is rysnc over to mine.. i keep a OpenVPN connection to her house 24/7  even on slow internet connection  but easier to remote administrate her uunraids but thats how i found the Fatal error of the Flash

 

is there a way to get notification if there is a Fatal USB error to email me?  i have tried 2019 the notification for the email section but it never emailed daily my array status to my hot mail account.. so i gave up on that 

 

and i wish it would send me a text message  but i think i tried and it didnt work ..

so be nice if there is a USB Fatal error.. id get a text saying  USB Fatal Error do not reboot the unraid just backup flash...

 

as text be nice

Edited January 21 by comet424

[comet424 12]

so i noticed i didnt have the backup appdata for my Backup server..  so i set it up..  createed the folders.. once you hit the Backup Now thats when it messes up the Folder.. must be because its the Flash Drive

so is it possible then 3 possble array corruptions?   but least i gonna make it now that all my unraids will backup the Flash drives to my main Server.. and then to each of my 5 unraids  so i have redundant backups

 

[comet424 12]

what i wished was the backup of the flash with this app would also  do not on the array so

i could point my 5 Unraids to 1 server on the network.. and then it replicates to 4 other servers

as uploading to the internet cloud style  only works  for internet..

or an option  

where it saves to the Array.. Plus  it saves  to  \\mainserver\backup files\Unraid #4

so it will create on the array a backup  but ontop of it if it can Reach manin Server  it places\Flash into

as the one from Unraid coming out sounds like just works for internet

 

but id like to see

if Unraid 3 backss up it backs up to

/user/backup files/Flash

/user/backup files/appdata

/user/backup files/libvirt

 

but it also then same Time would backup to 

\\mainServer\Backupfiles\Unraid Backups\unraid3\Flash

\\mainServer\Backupfiles\Unraid Backups\unraid3\appdata

\\mainServer\Backupfiles\Unraid Backups\unraid3\libvirt

 

rightr now i starting to do this with rsync and cron .. but be nice  it automanticlly does this as soon as its backuping up  it contacts the main server to back up  if it can reach that computer at the time

 

just a suggestion

[Alex.b 12]

Hello,

What folders may I exclude on Plex to reduce the size of backup ?

[Energen 83]

10 hours ago, Alex.b said:

Hello,

What folders may I exclude on Plex to reduce the size of backup ?

 

At the moment the only folder I back up for Plex is /mnt/user/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Plug-in Support/Databases"

 

That directory contains your library data and watch state / history.. basically the important stuff.  Metadata can be recreated.

 

I use a user script for this and not the Appdata Backup plugin, but you may be able to simplify things by only excluding the metadata related folders

 

 

[toasti 4]

Very nice app! I use it everyday to backup my Docker data.

 

BUT there's one thing I want to ask: Would it be possible to implement an option if I want to have a TAR file or not?

 

With the TAR file we get a big file on every backup that the second backup software (to external drive) want to backup.

If the backup would be just a copy of "appdata" without to tar it afterwards, the other backup software would be able to use dedup to prevent to backup the same data multiple times.

 

[itimpi 887]

3 hours ago, toasti said:

With the TAR file we get a big file on every backup that the second backup software (to external drive) want to backup.

If the backup would be just a copy of "appdata" without to tar it afterwards, the other backup software would be able to use dedup to prevent to backup the same data multiple times.

I believe that the big problem with copying individual (typically small) files is that it takes MUCH longer than creating a tar file if the files are being copied to the array.

 

I think that the best compromise suggestion I have seen is to create a separate tar file for each folder under appdata.

[f3ger 0]

 

I have the problem that the first docker container does not start after the backup. in the backup status window, however, it says "starting ..."

[toasti 4]

On 1/28/2021 at 12:42 PM, itimpi said:

I believe that the big problem with copying individual (typically small) files is that it takes MUCH longer than creating a tar file if the files are being copied to the array.

 

I think that the best compromise suggestion I have seen is to create a separate tar file for each folder under appdata.

 

Knowing or believing?

 

As already described, a TAR file makes it nearly impossible to backup the backup to an external drive if you have not unlimited space on the external hard disk. Why not implementing this as an option?

 

I would really appreciate it.