[Plugin] Appdata.Backup

[bunkermagnus]

7 hours ago, KluthR said:

 

 

Please share a debug log ID.

 

I hope this helps:

a6d9c169-56d4-477b-9989-be8cca8a8f6e

[Luke_Starkiller]

Hi 
I just updated to the new app. I have a problem where it only backs up 2 out of my 7 dockers.
For the 5 that doesn't work i get this message.

Debug Code: fe870bc2-9d17-4c2b-88e3-6b0882f98a4f

[09.09.2023 09:32:38][ℹ️][homeassistant] Stopping homeassistant... done! (took 5 seconds)
[09.09.2023 09:32:43][ℹ️][homeassistant] Should NOT backup external volumes, sanitizing them...
[09.09.2023 09:32:43][ℹ️][homeassistant] homeassistant does not have any volume to back up! Skipping
[09.09.2023 09:32:43][ℹ️][homeassistant] Starting homeassistant... (try #1) done!

The source path is \mnt\user\appdata and if i browse to the path i see data in all 7 docker folders so i have no clue why only some of the works.



 

[KluthR]

On 9/8/2023 at 9:04 AM, bunkermagnus said:

In the backup log it clearly states that the setting is to NOT include external folders but it will still go for the external folders unless I put them in the exclude list.

Cant confirm. In the cases krusader and Plex the debug log clearly states:

 

Calculated volumes to back up: /mnt/user/appdata/binhex-krusader

and

Calculated volumes to back up: /mnt/user/appdata/Plex-Media-Server

 

which is expected. Note, that at this point, any exclude is not yet processed.

[KluthR]

On 9/9/2023 at 9:46 AM, Luke_Starkiller said:

I just updated to the new app. I have a problem where it only backs up 2 out of my 7 dockers.

Please open the per docker setting and show me what you see as volumes there. I bet the actual dpcker mapping is /mnt/cache which is different from /mnt/user. Whats the content of Allowed Sources?

[Luke_Starkiller]

3 hours ago, KluthR said:

Please open the per docker setting and show me what you see as volumes there. I bet the actual dpcker mapping is /mnt/cache which is different from /mnt/user. Whats the content of Allowed Sources?

Didn't know you could click on each docker to see the mounts. 
Change the source to \mnt\"drivename"\appdata
Now everything gets backuped like it should. Thank you!

Edited September 12, 2023 by Luke_Starkiller

[Andiroo2]

Where are the logs for each backup stored?

[WarHawk8080]

Is there any way to get the appdata backup program to use pigz, so that way it can use multiple cpu's to compress the backup image, instead of a single cpu, it takes 20 minutes to backup some apps (like PLEX and audiobookshelf)

I know I have an "older" I7-7700 processor...but it shouldn't take it that long in most cases

https://stackoverflow.com/questions/12313242/utilizing-multi-core-for-targzip-bzip-compression-decompression
https://zlib.net/pigz/

[KluthR]

Checkout the „Compression: Yes, multicore“ setting

[Luke_Starkiller]

Would it be possible in the future to make the applicaton to use unraids notifications system? Im using pushover and would love to get notifications when backups have run or if they failed. 

[KluthR]

2 hours ago, Luke_Starkiller said:

Would it be possible in the future to make the applicaton to use unraids notifications system?

Of course, it uses it since the beginning. Have you issues getting those?

[jj_uk]

Is it possible to exclude folders everywhere that have a certain name?

 

I use the recycle bin plugin and I don't want to include .Recycle.Bin folders in my backups.

 

I'd like to globally exclude

.DS_Store,
*.tmp,
.Recycle.Bin

 

[Luke_Starkiller]

12 hours ago, KluthR said:

Of course, it uses it since the beginning. Have you issues getting those?

I only see the option to get a notification when an error / warning has occurred, not when the backup finished successfully. 

[-Daedalus]

Apologies if this has been asked before, but is there an option to exclude certain directories from the backup?

 

With the old plugin, I was backing up my Plex container, but I was excluding the thumbnails directory, which meant I was backing up 30GB instead of 500GB. That option appears to not exist here, unless I missed it.

 

Edit: Found it! You have to click the container name to get a bunch of extra settings, fantastic!

 

 

Edit2: Small feature requests as it's the first time I'm using this. Maybe not have the log output force the scrollbar to the bottom every few seconds. Makes reviewing the log while a backup is running pretty obnoxious.

Also, is there a reason single-core compression is the default? Or at least it is when importing settings from the 2.5 app. Makes backups horrendously slow (as in, a 33 minute backup gets reduced to 3 minutes with multi-core compression)

Edited September 18, 2023 by -Daedalus

[Andiroo2]

On 9/6/2023 at 3:05 PM, KluthR said:

Exactly. And check whats wrong with your backup by checking the backup log.

 

No errors that I can see in the backup log (regular and debug).  I created a debug log to share with you, ID 8eed7224-7ebd-4120-872c-6e3afb6c0459 in case you can see something I cannot.

[WarHawk8080]

On 9/16/2023 at 8:06 AM, KluthR said:

Checkout the „Compression: Yes, multicore“ setting

Boom...done...missed that!

Thanks!!!!!

[KluthR]

On 9/17/2023 at 10:38 PM, Luke_Starkiller said:

I only see the option to get a notification when an error / warning has occurred, not when the backup finished successfully. 

You are right, adding to the todo.

 

On 9/18/2023 at 8:02 AM, -Daedalus said:

Maybe not have the log output force the scrollbar to the bottom every few seconds.

If the backup stops, you can scroll up again.

On 9/18/2023 at 8:02 AM, -Daedalus said:

Also, is there a reason single-core compression is the default?

Because there is currently no limit setting. Some users observed decreased overall server perfoemance.

 

[almulder]

So I have moved to a new unraid system and needed to restore my appdata (fresh install of everything) I have my backupd from just before I decommissioned my old server, restore sees them and tried to restore them, but I get an error when I do.

I have tried one at a time also and get the same errors. Here is the log from when I tried to restore swag.

 

(it just repeats the same message for all the files.

 

Debug log ID: d4fa841f-c17f-4dd1-b7bc-d435c0372cb4

[almulder]

24 minutes ago, almulder said:

So I have moved to a new unraid system and needed to restore my appdata (fresh install of everything) I have my backupd from just before I decommissioned my old server, restore sees them and tried to restore them, but I get an error when I do.

I have tried one at a time also and get the same errors. Here is the log from when I tried to restore swag.

 

So I figured out my issue. My New setup is zfs and datasets not folders, renamed the dataset appdata to appdata1 and then ran the restore and it work great. 

 

So incase people run into the issue, you cant restore the folders if they were converted to datasets. (and I am sure vs versa)

[KluthR]

Interesting found. Is /mnt/user/appdata a symlink aka exclusive share? 

[Jorgensen]

Hi,

Is there a option for saving the backup in a single archive, and not a archive for each app data folder?

Thanks,

Jorgensen

[KluthR]

No. And I dont see any positive reason to make a single file with everything.

[jlw_4049]

Just started messing with this app today, looks really nice. Thank you very much!

[Luke_Starkiller]

22 hours ago, Jorgensen said:

Hi,

Is there a option for saving the backup in a single archive, and not a archive for each app data folder?

Thanks,

Jorgensen

You can just add a post backup script that zip the files.

[KluthR]

I add a feature which calls the script with some arguments soon, so you can target the current backup dir directly.

[NotHere]

Good day. I wanted to ask, when doing a restore, do I need to have the docker image (meaning, go to Apps, download radarr, set up the template, and apply) and then I can restore, or can I restore without anything as long as I pull the template and the files from the restore options? Thanks.

 

EDIT: I did the test, restored something I have yet to download from the apps tab. The appdata directory was restored but since I didnt download it before it was not under dockers. 

Edited September 26, 2023 by NotHere