[Plugin] Appdata.Backup

Beardiful42 · February 22

Need to try and restore a container. When I go into the restore section it has my backup location. I hit next. Step 2 with the drop down has nothing in it. what is wrong?

daithi · February 22

Last night I got an error on 4 of my containers (about 1/4).
Have never seen this error before:

[21.02.2024 23:31:24][ℹ️][recyclarr] Stopping recyclarr... done! (took 0 seconds)
[21.02.2024 23:31:24][ℹ️][recyclarr] Should NOT backup external volumes, sanitizing them...
[21.02.2024 23:31:24][⚠️][recyclarr] recyclarr does not have any volume to back up! Skipping. Please consider ignoring this container.
[21.02.2024 23:31:25][ℹ️][recyclarr] Starting recyclarr... (try #1) done!
...
[21.02.2024 23:41:26][ℹ️][Dozzle] No stopping needed for Dozzle: Not started!
[21.02.2024 23:41:26][ℹ️][Dozzle] Should NOT backup external volumes, sanitizing them...
[21.02.2024 23:41:26][⚠️][Dozzle] Dozzle does not have any volume to back up! Skipping. Please consider ignoring this container.
[21.02.2024 23:41:27][ℹ️][Dozzle] Installing planned update for Dozzle...
[21.02.2024 23:41:31][ℹ️][Dozzle] Starting Dozzle is being ignored, because it was not started before (or should not be started).
...
[21.02.2024 23:42:23][ℹ️][jellyfin] Stopping jellyfin... done! (took 4 seconds)
[21.02.2024 23:42:27][ℹ️][jellyfin] Should NOT backup external volumes, sanitizing them...
[21.02.2024 23:42:27][⚠️][jellyfin] jellyfin does not have any volume to back up! Skipping. Please consider ignoring this container.
[21.02.2024 23:42:27][ℹ️][jellyfin] Installing planned update for jellyfin...
[21.02.2024 23:42:42][ℹ️][jellyfin] Starting jellyfin... (try #1) done!
...
[21.02.2024 23:42:44][ℹ️][netdata] Stopping netdata... done! (took 2 seconds)
[21.02.2024 23:42:46][ℹ️][netdata] Should NOT backup external volumes, sanitizing them...
[21.02.2024 23:42:46][⚠️][netdata] netdata does not have any volume to back up! Skipping. Please consider ignoring this container.
[21.02.2024 23:42:46][ℹ️][netdata] Installing planned update for netdata...
[21.02.2024 23:42:57][ℹ️][netdata] Starting netdata... (try #1) done!

All my other containers backed up fine without error.
(Dozzle is not running, I haven't got around to fixing it since they changed the user format in the container)

KluthR · February 22

16 hours ago, joey911 said:

It looks like that didn't work as I expected. I was hoping it would just exclude that file.

You were right, but it seems, that the plugin does not respect the global exclusion list for Extra Files. Thsi should be fixed with an upcoming update.

15 hours ago, bastl said:

the available update for the mariadb container isn't applied when grouped together

I believe the latest beta fixes it, because I stumbled upon this on my own.

Yes, there it is: https://github.com/Commifreak/unraid-appdata.backup/commit/b0a99f12322a3e36978c9e261fb2d4808c513413

Will be fixed in next stable.

KluthR · February 22

13 hours ago, Beardiful42 said:

Need to try and restore a container. When I go into the restore section it has my backup location.

Did you set the directory containg the ab_ directories or did you selected it directly? the 1st way should be working.

14 minutes ago, daithi said:

Last night I got an error on 4 of my containers (about 1/4)

Please check the displayed volumes in the settings page. If all all marked external, consider to ignore the container.

Beardiful42 · February 22

55 minutes ago, KluthR said:

Did you set the directory containg the ab_ directories or did you selected it directly? the 1st way should be working.

I am not sure I follow, The directory that is populated that matches the location that I backup too populates automatically. You can see in the picture the step two has a drop down that contains nothing. But I can physically go to the location and see all my backups. I thought maybe it was FireFox so I tried Chrome and didn't make a difference.

jcofer555 · February 23

it would be great if there was a select all button for the restore templates and restore containers part of the restore process @KluthR

Edited February 23 by jcofer555

KluthR · February 23

18 hours ago, Beardiful42 said:

I thought maybe it was FireFox so I tried Chrome and didn't make a difference.

Please show the contents of the pre-filled directory path (via terminal or via file browser). Are the ab_ folder inside?

56 minutes ago, jcofer555 said:

it would be great if there was a select all button for the restore templates and restore containers

Yea, the restore function is kinda basic. I plan to enhance it more but time is a limited thing currently. The next step is to make the current beta stable with some more fixes in place.

jcofer555 · February 23

great thanks for the good work you do

WellThen · February 23

I see I haven't had a successful backup for quite a while, it seems Plex is the issue. Plex has been completely broken for a while and even restoring to the last successful backup didn't solve the issue, so might be something else going on as well. I managed to fix the Plex database last night so I was hoping that would get the backups stop failing, but I see it failed tonight as well. Any idea what the issue is?

SettingsRestoreStatus / Log
The backup is .
[23.02.2024 04:00:02][ℹ️][Main] 👋 WELCOME TO APPDATA.BACKUP!! :D
[23.02.2024 04:00:02][ℹ️][Main] Backing up from: /mnt/user/appdata, /mnt/cache/appdata
[23.02.2024 04:00:02][ℹ️][Main] Backing up to: /mnt/user/backups/appdatabackup/ab_20240223_040002
[23.02.2024 04:00:02][ℹ️][Main] Selected containers: FileZilla, Krusader, Plex-Media-Server
[23.02.2024 04:00:02][ℹ️][Main] Saving container XML files...
[23.02.2024 04:00:09][ℹ️][Main] Auto-Update for 'Plex-Media-Server' is enabled but no update is available.
[23.02.2024 04:00:09][ℹ️][Main] Auto-Update for 'Krusader' is enabled but no update is available.
[23.02.2024 04:00:09][ℹ️][Main] Auto-Update for 'FileZilla' is enabled but no update is available.
[23.02.2024 04:00:09][ℹ️][Main] Method: Stop/Backup/Start
[23.02.2024 04:00:09][ℹ️][Plex-Media-Server] Stopping Plex-Media-Server... done! (took 9 seconds)
[23.02.2024 04:00:18][ℹ️][Plex-Media-Server] '/mnt/user/appdata/Plex-Media-Server/transcode' is within mapped volume '/mnt/user/appdata/Plex-Media-Server'! Ignoring!
[23.02.2024 04:00:18][ℹ️][Plex-Media-Server] Should NOT backup external volumes, sanitizing them...
[23.02.2024 04:00:18][ℹ️][Plex-Media-Server] Calculated volumes to back up: /mnt/user/appdata/Plex-Media-Server
[23.02.2024 04:00:18][ℹ️][Plex-Media-Server] Backing up Plex-Media-Server...
[23.02.2024 04:18:16][ℹ️][Plex-Media-Server] Backup created without issues
[23.02.2024 04:18:16][ℹ️][Plex-Media-Server] Verifying backup...
[23.02.2024 04:21:43][❌][Plex-Media-Server] tar verification failed! Tar said: tar: Removing leading `/' from member names; mnt/user/appdata/Plex-Media-Server/Library/Application Support/Plex Media Server/Cache/PhotoTranscoder/ba/ba43998063e82b161fd112b6fc1cb8705c48c64b.jpg: Contents differ; mnt/user/appdata/Plex-Media-Server/Library/Application Support/Plex Media Server/Cache/PhotoTranscoder/fd/fd68c683e9314c8d25a6dad614b76da21094bd47.jpg: Contents differ; tar: Skipping to next header; tar: Exiting with failure status due to previous errors
[23.02.2024 04:23:05][ℹ️][Plex-Media-Server] Starting Plex-Media-Server... (try #1) done!
[23.02.2024 04:23:09][ℹ️][Krusader] Stopping Krusader... done! (took 2 seconds)
[23.02.2024 04:23:11][ℹ️][Krusader] Should NOT backup external volumes, sanitizing them...
[23.02.2024 04:23:11][ℹ️][Krusader] Calculated volumes to back up: /mnt/cache/appdata/krusader
[23.02.2024 04:23:11][ℹ️][Krusader] Backing up Krusader...
[23.02.2024 04:23:11][ℹ️][Krusader] Backup created without issues
[23.02.2024 04:23:11][ℹ️][Krusader] Verifying backup...
[23.02.2024 04:23:11][ℹ️][Krusader] Starting Krusader... (try #1) done!
[23.02.2024 04:23:14][ℹ️][FileZilla] Stopping FileZilla... done! (took 2 seconds)
[23.02.2024 04:23:16][ℹ️][FileZilla] Should NOT backup external volumes, sanitizing them...
[23.02.2024 04:23:16][ℹ️][FileZilla] Calculated volumes to back up: /mnt/user/appdata/FileZilla
[23.02.2024 04:23:16][ℹ️][FileZilla] Backing up FileZilla...
[23.02.2024 04:23:16][ℹ️][FileZilla] Backup created without issues
[23.02.2024 04:23:16][ℹ️][FileZilla] Verifying backup...
[23.02.2024 04:23:16][ℹ️][FileZilla] Starting FileZilla... (try #1) done!
[23.02.2024 04:23:18][ℹ️][Main] Backing up the flash drive.
[23.02.2024 04:23:40][ℹ️][Main] Flash backup created!
[23.02.2024 04:23:40][ℹ️][Main] VM meta backup enabled! Backing up...
[23.02.2024 04:23:40][ℹ️][Main] Done!
[23.02.2024 04:23:40][⚠️][Main] An error occurred during backup! RETENTION WILL NOT BE CHECKED! Please review the log. If you need further assistance, ask in the support forum.
[23.02.2024 04:23:40][ℹ️][Main] DONE! Thanks for using this plugin and have a safe day ;)
[23.02.2024 04:23:40][ℹ️][Main] ❤️

Beardiful42 · February 23

13 hours ago, KluthR said:

Please show the contents of the pre-filled directory path (via terminal or via file browser). Are the ab_ folder inside?

I believe this is what you are asking for. I find it strange that there are container backups for containers I am no longer run. Not sure why that is either. Thanks for the help!

Beardiful42 · February 23

DevXen · February 24

2 issues...

1. Starting with my backup last week I started getting errors for directories it says aren't there.

Event: Appdata Backup
Subject: [AppdataBackup] Error!
Description: Please check the backup log!
Importance: alert

'/mnt/disks/SSD/appdata/apache-php/logs' does NOT exist! Please check your mappings! Skipping it for now.



---

'/mnt/disks/SSD/www' does NOT exist! Please check your mappings! Skipping it for now.



---



'/dev/shfs' does NOT exist! Please check your mappings! Skipping it for now.



---



'/mnt/disks/Docker_SSD/plex-utills/logs' does NOT exist! Please check your mappings! Skipping it for now.



*Side note I've never had a docker_ssd mapping or drive*



---



'/tmp/xteve' does NOT exist! Please check your mappings! Skipping it for now.

----

2. Last week it took 4 and a half hours. Which is typical.. But that one last night took over 8 hours. Nothing has changed on my server in the last week.

Event: Appdata Backup
Subject: Appdata Backup
Description: Backup done [4h, 29m]!
Importance: normal

The backup was successful and took 4h, 29m!

---

Event: Appdata Backup
Subject: Appdata Backup
Description: Backup done [8h, 5m]!
Importance: normal

The backup was successful and took 8h, 5m!

BigMal · February 24

When attempting to restore appdata, I get an error: Invalide Sourec - The selected source seems invalid. I'm likely missing something obvious, but I cannot figure out what. Below is my log file number. Thank you for your help

2605837a-0e1d-4638-a6d5-7101d2336d12

trurl · February 24

I only run this plugin weekly. Something apparently changed since the last run because last night, this plugin sent these alerts for every one of my dockers:

Event: Appdata Backup
Subject: [AppdataBackup] Warning!
Description: Please check the backup log!
Importance: warning

transmission does not have any volume to back up! Skipping. Please consider ignoring this container.

I had not changed any settings, and I checked the settings just now and they seem correct.

trurl · February 24

3 minutes ago, trurl said:

Something apparently changed since the last run

I have the plugin configured to look for the appdata at /mnt/user/appdata. And this path definitely exists and contains the appdata for each of the containers.

However, the template for each container actually specifies /mnt/fast/appdata. Some time ago I reconfigured each of them to use that path for their appdata on my 'fast' pool. Of course, files at that path are also files in /mnt/user/appdata. And the appdata share definitely has no files that are not on /mnt/fast.

Has the plugin started looking at the templates instead of the Appdata source setting? I looked at the help for the Appdata source setting, but it wasn't clear if that could be the problem.

daithi · February 24

11 minutes ago, trurl said:

I only run this plugin weekly. Something apparently changed since the last run because last night, this plugin sent these alerts for every one of my dockers:

I had not changed any settings, and I checked the settings just now and they seem correct.

1 minute ago, trurl said:

I have the plugin configured to look for the appdata at /mnt/user/appdata. And this path definitely exists and contains the appdata for each of the containers.

However, the template for each container actually specifies /mnt/fast/appdata. Some time ago I reconfigured each of them to use that path for their appdata on my 'fast' pool. Of course, files at that path are also files in /mnt/user/appdata. And the appdata share definitely has no files that are not on /mnt/fast.

Has the plugin started looking at the templates instead of the Appdata source setting? I looked at the help for the Appdata source setting, but it wasn't clear if that could be the problem.

I think the same thing has happened to you as what I posted on Thursday. I haven't had a chance to do much digging, but I had a quick scan and some of my failed containers are at /mnt/cache/appdata whereas some of my successful containers are at /mnt/user/appdata. I need to clean them up before Wednesday night (next scheduled backup) and see if that makes a difference.

trurl · February 24

9 minutes ago, trurl said:

Has the plugin started looking at the templates instead of the Appdata source setting?

Not sure that makes sense either. If it used the templates instead of the Appdata source setting, it still should work.

Unless it is looking at the templates and refusing to do anything because they don't match the Appdata source setting.

KluthR · February 24

15 hours ago, Beardiful42 said:

I believe this is what you are asking for.

No, Iam talking about the folder that holds the ab_ folders.

11 hours ago, DevXen said:

I started getting errors for directories it says aren't there.

And they are there?

11 hours ago, DevXen said:

Last week it took 4 and a half hours. Which is typical.. But that one last night took over 8 hours. Nothing has changed on my server in the last week.

Cant tell. Please compare a logfile between a 4h run and a 8 hour run.

1 hour ago, BigMal said:

When attempting to restore appdata, I get an error: Invalide Sourec - The selected source seems invalid. I'm likely missing something obvious

Did you selected the folder that holds the ab_ folders?

1 hour ago, trurl said:

Has the plugin started looking at the templates instead of the Appdata source setting?

It always looked inside the tempate. It uses the allowed sources setting to check if the detected template mappings are internal or external volumes/mappings

KluthR · February 24

On 2/20/2024 at 5:02 PM, sir_storealot said:

Just one strange thing that I noticed: my backup reported an error d/t missing docker path (as described above), but the post-run-script still got called with TRUE as the 3rd argument, indicating a successful backup. Isn't that odd?

Just checked that. The fact that one volume within a container is not existing produces the error message but does not marks the whole backup run as failed. errors like tar backup/verification lead to changing the error flag.

I dont know if is worth changing.

paperblankets · February 24

During backup I get a version of this error for a few containers:

...
[24.02.2024 03:32:23][❌][unmanic] '/tmp/unmanic' does NOT exist! Please check your mappings! Skipping it for now.
...

But I have that, and the other failing directories in my global exclusion list.
Is there a config tweak I should be doing to ignore these tmp paths?

Thanks for maintaining and working on the backup plugin!

KluthR · February 24

Please add the mentioned volume path in the exclusion list directly inside its container config.

KluthR · February 24

On 2/23/2024 at 11:25 AM, WellThen said:

I see I haven't had a successful backup for quite a while, it seems Plex is the issue.

Please add some recommended Plex excludes (see 1st post)

trurl · February 24

1 hour ago, KluthR said:

It always looked inside the tempate. It uses the allowed sources setting to check if the detected template mappings are internal or external volumes/mappings

Not clear what the relevance is, and this is definitely new behavior.

As far as I understand your "help" on this entry, my templates are specifying internal, and I have specified internal for that entry as well. And they are both referencing the same files. They are just not literally the same path.

It was all working before. Do I need to specify /mnt/fast/appdata in your plugin to make this work again?

KluthR · February 24

12 minutes ago, trurl said:

and this is definitely new behavior.

No. It always worked like that. Maybe you disabled the setting to include external volumes?

13 minutes ago, trurl said:

Do I need to specify /mnt/fast/appdata in your plugin to make this work again?

Yes, that seems right.

please also read the help block for the allowed sources paths option.

KluthR · February 24

2 minutes ago, KluthR said:

No. It always worked like that.

@trurl Now I see what happened. I believe transmission never got backed up. I recently raised the loglevel for your posted warning to be warn instead just info. So maybe the plugin shows now an issue when it was silent before:

https://github.com/Commifreak/unraid-appdata.backup/commit/1d970a9ce0292b53b6c037ba18cad26b1e7ebb35

[Plugin] Appdata.Backup

Recommended Posts

Link to comment

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

KluthR

KluthR

KluthR

Posted Images

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Join the conversation