[Plugin] CA Appdata Backup / Restore v2


Squid

719 posts in this topic Last Reply

Recommended Posts

  • Replies 718
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

CA Appdata Backup / Restore (v2)   Due to some fundamental problems with XFS / BTRFS, the original version of Appdata Backup / Restore became unworkable and caused lockups for many users.  D

Feature request: Instead of one giant tarball, could this app use separate tarballs for each folder in appdata? That way it would be much easier to restore a specific app's data (manually) or even pul

This has been requested atleast once before by @aptalca back in 2018 however this still doesn't seem to have been implemented?   Basically instead of one tarball of all the appdata directori

Posted Images

On 8/22/2020 at 11:09 AM, Squid said:

How do you know?  What shows up if you open the backup set with WinRAR on a windows box?

I just wanted to let you know that I'm a dumb-dumb and figured it out. My backup location had cache enabled. So when it would backup, the cache would get full after Plex (~60GB) and stop. I made a new backup share with no cache enabled and it's working well now. 

 

Sorry to waste your time, and thank you very much for your help. 

 

P.S. I bought you a beer for your trouble ;)

Edited by G3TG0T
Link to post

What is the protocol for restoring individual files/folders. Can you browse the .tar via unraid? If so, can someone help with commands to navigate it. My tar is ~50GB and I need to restore a folder that's probably under 10MB. Winrar doesn't seem to like trying to open it via SMB on my Windows 10 computer. Not sure what the best way to do this is.

Link to post

1 of the docker settings got messed up and failed to update etc so it was removed when i readd it all settings on the docker are gone.

 

I did a restore of yesterday and checked but still all settings of that docker are gone. i even tried the backup of the day before yesterday. Some problem..

 

How can i get those settings back, are they in a file or so.  the files it self in the docker are still there just not the settings when you edit the image.

Link to post

You're talking about reinstalling the app itself.  It sounds like you reinstalled from a regular search in CA (which uses default settings on the app) vs the Previous Apps section (which uses the last saved template)

Link to post
21 minutes ago, Squid said:

You're talking about reinstalling the app itself.  It sounds like you reinstalled from a regular search in CA (which uses default settings on the app) vs the Previous Apps section (which uses the last saved template)

i did use the previous apps section.

 

i found the file with some settings and did it manually

Link to post

Hi all,

I just started using this plugin again, and my first back up ran Monday night. It all seems to have worked, I'm seeing a dated TAR file for the app data as expected, however, my USB back up seems to just be a copy of the data - no TAR and no date-version. 

 

Is this expected behaviour? I was expecting TARs for both the "Use Compression: Yes" setting?

 

Thanks,

 

whiteatom

Link to post

Yup.  That's correct.  USB backup was just tacked onto the plugin as a feature req (realistically it changes very infrequently), and was done prior to the GUI even supporting any method of backup of the USB.

 

The USB backup will be removed completely in the future.  Waiting on a feature from LT being worked on...

Link to post
3 minutes ago, Squid said:

Yup.  That's correct.  USB backup was just tacked onto the plugin as a feature req (realistically it changes very infrequently), and was done prior to the GUI even supporting any method of backup of the USB.

 

The USB backup will be removed completely in the future.  Waiting on a feature from LT being worked on...

Ok sounds good.. is LT adding a USB backup tool? I think mine is on the way out, (very slow boot), so I'd just like to make sure I have a backup of the data!

Link to post
17 hours ago, Squid said:

Is the USB mounted?  Can you access it over the network?  What's the contents within the appdatabackup folder on it?

The USB is mounted and I can access it over the network-share

grafik.png.c5db87311738843e94c19a772fecfbde.png

This is the content and the schedule for backup was successful but I don't get the option to recover

When I am getting in the folder there are folders for every date and in there is a file like "CA_backup.tar.gz"

Link to post

I'll have to look at it.  Not sure why it won't work.  What you might try doing though is create a new share on the array, and copy the backup folder into that share.

 

Then on the Backup settings, change the destination to the array share and folder.  Reload the tab and see if it picks up the backup set on the restore tab

Link to post
23 hours ago, Squid said:

I'll have to look at it.  Not sure why it won't work.  What you might try doing though is create a new share on the array, and copy the backup folder into that share.

 

Then on the Backup settings, change the destination to the array share and folder.  Reload the tab and see if it picks up the backup set on the restore tab

Now it is working!

Thank you

Link to post

How does the line "Delete backups if they are this many days old:" work exactly? If I left that at it's default of 1, and set up a scheduled backup frequency of weekly, is that saying that the backup would be deleted a day later after it's creation, and I would go 6 days without a backup being saved anywhere until the next scheduled backup occurred? Does that apply to the appdata backup, USB backup, and libvirt backup?

 

I noticed that only the appdata backup is held in a dated/timestamped folder. I take that to mean that every backup will overwrite the USB and libvirt folders? Is it just the appdata backup that is "kept" until the deletion date is reached?

 

Does anyone have any ideas on how to best copy off the backup folders to the cloud (Google Drive, etc.) on a recurring basis? I'm thinking something that uses the "Path to Custom Start (or Pre-Start?) Script" field, so that it always makes a copy to the cloud once a new set of backups have been placed on my UnRaid 'backup' share? My goal is to ensure I can reach these backups, even if there is a more catastrophic failure of my server that makes reaching the 'backup' share difficult/impossible.

Edited by Magic815
Link to post
On 11/5/2017 at 5:05 AM, Squid said:

securityIcon-WithShadow.png

 

CA Appdata Backup / Restore (v2)

 

Due to some fundamental problems with XFS / BTRFS, the original version of Appdata Backup / Restore became unworkable and caused lockups for many users.  Development has ceased on the original version, and is now switched over to this replacement.

 

Fundamentally they are both the same and accomplish the same goals (namely, backing up your Appdata share and USB / libvirt), but this version is significantly faster at the job. 

 

This version uses tar instead of rsync (and offers optional compression of the archive - roughly 50% if not including any downloads in the archive - which you really shouldn't be anyways). 

 

Because of using tar, there is no longer any incremental backups.  Rather, every backup goes into its own separate dated subfolder.  Old backups can optionally be deleted after a successful backup.  Even without incremental backups, the speed increase afforded by tar means that there should be no real difference in the end.  (ie:  A full backup using my appdata on the old plugin takes ~1.5 hours.  This plugin can do the same thing uncompressed in about 10 minutes, and compressed in 20 minutes.  The optional verification of the archive takes a similar amount of time.  An incremental backup on the old plugin using my appdata averaged around 35 minutes).

 

The options for separate destination for USB / VM libvirt backups is changed so that if there is no destination set for those backup's then they will not be backed up.

 

Additionally, unlike the original plugin, no cache drive is necessary, and the appdata source can be stored on any device in your system (ie: unassigned devices).  The destination as usual can go to any mount point within your system.  Unfortunately because of no more incremental backups, this version may no longer be suitable for ultimately backing up offsite to a cloud service (ie: via rclone)

 

You can find this within the Apps tab (Search for Appdata Backup).

 

The original v1 plugin should be uninstalled if migrating to this version.

 

 

Love the plugin, use it all the time. however do you take requests?

 

If so here are my requests:

     1) Multiple Backup Settings. I want to backup some of my appdata daily, while there are others I want done weekly. Would be nice to be able to do so. Currently I exclude the weekly ones and back them up manually.

    2) Selective restore. I have had it that one os the db from an app goes bad and I need to restore it, but there is no way to just restore the one I need, its all or nothing. Currently I have to extract the backup, then copy only the files I need.

 

Thanks again for your hard work.

 

 

 

 

Link to post

When the plugin starts the containers back up - are the order & wait times still respected?
Every morning one of the services has gone bad, likely due to a dependent container not having started by the expected time.

No issue with system reboot though.

Link to post
1 hour ago, tuxbass said:

When the plugin starts the containers back up - are the order & wait times still respected?
Every morning one of the services has gone bad, likely due to a dependent container not having started by the expected time.

No issue with system reboot though.

Not currently.  On my todo list

Link to post

I know it's going to be an unpopular request, but could we have "Use tar?" option before "Use Comporession?", latter being disabled & defaulting to 'no' if user opts out of tarring.

There are use-cases when simply copying the files as-is can be preferred.

Edited by tuxbass
Link to post
15 hours ago, tuxbass said:

I know it's going to be an unpopular request, but could we have "Use tar?" option before "Use Comporession?", latter being disabled & defaulting to 'no' if user opts out of tarring.

There are use-cases when simply copying the files as-is can be preferred.

That's what v1 of the plugin did.  Worked for some people, but a fair proportion of users would wind up having their servers basically lockup while XFS / BTRFS chewed through the massive amount of changes caused by copying potentially a million files at a time.  You can still get it by enabling Show Deprecated Apps within CA's Settings

Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.