[Plugin] CA Appdata Backup / Restore v2

[Hasekura]

Hello,

How do I solve the permissions?
After the backup did its job I cant open the folder of the backup.
Only when I run the permissions on that share I am able to open it.

[Gunny]

Since installing the forked plugin (and uninstalling the original), the backup status is reporting an error occurred so it doesn't delete old backups, but there isn't an error displayed in the status window.  Any help diagnosing this?

[wgstarks]

10 minutes ago, Gunny said:

Since installing the forked plugin (and uninstalling the original), the backup status is reporting an error occurred so it doesn't delete old backups, but there isn't an error displayed in the status window.  Any help diagnosing this?

Post the contents of the Backup/Restore Status tab.

[KluthR]

2 hours ago, wgstarks said:

Post the contents of the Backup/Restore Status tab.

Yep, post the complete log please. A single verification error would trigger an error at the end.

[ultimz]

Hi all,

 

Ever since updating my backup is also failing. It seems to be the unifi-controller docker that fails to start up...

 

See logs attached. I did not have this issue previously and have not updated the unifi-controller docker recently. When I check in the morning the docker is stopped and I just normally start it so not sure why this plugin is having a hard time starting it?

AppDataBackupLog.txt

[KluthR]

6 hours ago, ultimz said:

why this plugin is having a hard time starting it?

Thanks for the log!

Your case is very interesting. I never saw the counter uses all 3 tries and still fails 😅

 

The thing: The plugin is telling docker simply „Start container please“, the rest is up to docker.

 

I would prepare an update which shows more details in case of failure, but it will take a few days, Iam not home rn.

 

I also have issues sometimes while starting containers within the plugin but with latest version (3 tries) it went away. 
 

Do you have IPv6 enabled and using for docker containers?

 

EDIT: Could you provide your unraid diagnostics?

Edited December 15, 2022 by KluthR
Diag

[MothyTim]

16 hours ago, Gunny said:

Since installing the forked plugin (and uninstalling the original), the backup status is reporting an error occurred so it doesn't delete old backups, but there isn't an error displayed in the status window.  Any help diagnosing this?

Hi, I have a similar problem to this, but the error I'm seeing is that the container is already started!?

Here is my log:

[15.12.2022 06:00:01] Backup of appData starting. This may take awhile
[15.12.2022 06:00:01] Stopping adminer... done! (took 0 seconds)
[15.12.2022 06:00:01] Stopping authelia... done! (took 0 seconds)
[15.12.2022 06:00:01] Stopping auto-m4b... done! (took 2 seconds)
[15.12.2022 06:00:03] Stopping bazarr... done! (took 5 seconds)
[15.12.2022 06:00:08] Stopping binhex-delugevpn... done! (took 3 seconds)
[15.12.2022 06:00:11] Not stopping binhex-krusader: Not started! [ / Exited (0) 10 days ago]
[15.12.2022 06:00:11] Stopping binhex-lidarr... done! (took 2 seconds)
[15.12.2022 06:00:13] Stopping binhex-prowlarr... done! (took 1 seconds)
[15.12.2022 06:00:14] Stopping binhex-radarr... done! (took 1 seconds)
[15.12.2022 06:00:15] Stopping binhex-readarr... done! (took 0 seconds)
[15.12.2022 06:00:15] Stopping binhex-readarr-2... done! (took 0 seconds)
[15.12.2022 06:00:15] Stopping binhex-sonarr... done! (took 1 seconds)
[15.12.2022 06:00:16] Stopping bitwarden... done! (took 0 seconds)
[15.12.2022 06:00:16] Stopping calibre... done! (took 11 seconds)
[15.12.2022 06:00:27] Not stopping code-server: Not started! [ / Exited (0) 2 days ago]
[15.12.2022 06:00:27] Stopping frigate... done! (took 3 seconds)
[15.12.2022 06:00:30] Not stopping HandBrake: Not started! [ / Exited (0) 4 months ago]
[15.12.2022 06:00:30] Stopping Home-Assistant-Core... done! (took 4 seconds)
[15.12.2022 06:00:34] Stopping mariadb... done! (took 4 seconds)
[15.12.2022 06:00:38] Stopping mosquitto... done! (took 1 seconds)
[15.12.2022 06:00:39] Not stopping Network-Speed-Test: Not started! [ / Created]
[15.12.2022 06:00:39] Stopping nextcloud... done! (took 4 seconds)
[15.12.2022 06:00:43] Stopping NodeRed... done! (took 0 seconds)
[15.12.2022 06:00:43] Stopping ombi... done! (took 5 seconds)
[15.12.2022 06:00:48] Stopping PASTA... done! (took 1 seconds)
[15.12.2022 06:00:49] Stopping PlexMediaServer... done! (took 6 seconds)
[15.12.2022 06:00:55] Stopping redis... done! (took 0 seconds)
[15.12.2022 06:00:55] Stopping swag... done! (took 5 seconds)
[15.12.2022 06:01:00] Stopping tautulli... done! (took 0 seconds)
[15.12.2022 06:01:00] Stopping unifi-controller... done! (took 7 seconds)
[15.12.2022 06:01:07] Backing up libvirt.img to /mnt/user/BackupVM/
[15.12.2022 06:01:07] Using Command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" "/mnt/user/system/libvirt/libvirt.img" "/mnt/user/BackupVM/" > /dev/null 2>&1
2022/12/15 06:01:07 [31666] building file list
2022/12/15 06:01:47 [31666] >f..tp..... libvirt.img
2022/12/15 06:01:47 [31666] sent 1,074,004,123 bytes received 35 bytes 26,518,621.19 bytes/sec
2022/12/15 06:01:47 [31666] total size is 1,073,741,824 speedup is 1.00
[15.12.2022 06:01:49] Backing Up appData from /mnt/user/appdata/ to /mnt/user/Backup Appdata/[email protected]
[15.12.2022 06:01:49] Separate archives disabled! Saving into one file.
[15.12.2022 06:01:49] Backing Up
[15.12.2022 06:21:39] Verifying Backup
./Home-Assistant-Core/home-assistant_v2.db: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db: Contents differ
./Home-Assistant-Core/.storage/evohome: Mod time differs
./Home-Assistant-Core/.storage/evohome: Contents differ
./Home-Assistant-Core/.storage/core.restore_state: Mod time differs
./Home-Assistant-Core/.storage/core.restore_state: Contents differ
./Home-Assistant-Core/home-assistant.log: Mod time differs
./Home-Assistant-Core/home-assistant.log: Size differs
./Home-Assistant-Core/home-assistant_v2.db-wal: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db-wal: Size differs
./Home-Assistant-Core/home-assistant_v2.db-shm: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db-shm: Contents differ
[15.12.2022 06:42:07] tar verify failed!
[15.12.2022 06:42:07] done
[15.12.2022 06:42:07] Searching for updates to docker applications
[15.12.2022 06:42:39] Starting redis... (try #1) done!
[15.12.2022 06:42:41] Starting mariadb... (try #1) done!
[15.12.2022 06:42:41] Waiting 10 seconds before carrying on
[15.12.2022 06:42:51] Starting adminer... (try #1) done!
[15.12.2022 06:42:54] Starting authelia... (try #1) done!
[15.12.2022 06:42:56] Starting swag... (try #1) done!
[15.12.2022 06:42:56] Waiting 10 seconds before carrying on
[15.12.2022 06:43:06] Starting bitwarden... (try #1) done!
[15.12.2022 06:43:09] Starting nextcloud... (try #1) done!
[15.12.2022 06:43:11] Starting unifi-controller... (try #1) done!
[15.12.2022 06:43:13] Starting mosquitto... (try #1) done!
[15.12.2022 06:43:15] Starting frigate... (try #1) done!
[15.12.2022 06:43:16] Waiting 20 seconds before carrying on
[15.12.2022 06:43:36] Starting Home-Assistant-Core... (try #1) Error while starting container! - Code: Container already started
[15.12.2022 06:43:41] Starting Home-Assistant-Core... (try #2) Error while starting container! - Code: Container already started
[15.12.2022 06:43:46] Starting Home-Assistant-Core... (try #3) Error while starting container! - Code: Container already started
[15.12.2022 06:43:46] Container did not started after multiple tries, skipping.
[15.12.2022 06:43:48] Starting NodeRed... (try #1) done!
[15.12.2022 06:43:50] Starting binhex-delugevpn... (try #1) done!
[15.12.2022 06:43:50] Waiting 45 seconds before carrying on
[15.12.2022 06:44:35] Starting binhex-prowlarr... (try #1) done!
[15.12.2022 06:44:37] Starting binhex-radarr... (try #1) done!
[15.12.2022 06:44:40] Starting binhex-sonarr... (try #1) done!
[15.12.2022 06:44:40] Waiting 60 seconds before carrying on
[15.12.2022 06:45:40] Starting binhex-lidarr... (try #1) done!
[15.12.2022 06:45:42] Starting bazarr... (try #1) done!
[15.12.2022 06:45:44] Starting binhex-readarr... (try #1) done!
[15.12.2022 06:45:46] Starting binhex-readarr-2... (try #1) done!
[15.12.2022 06:45:49] Starting PlexMediaServer... (try #1) done!
[15.12.2022 06:45:51] Starting ombi... (try #1) done!
[15.12.2022 06:45:53] Starting tautulli... (try #1) done!
[15.12.2022 06:45:55] Starting PASTA... (try #1) done!
[15.12.2022 06:45:58] Starting auto-m4b... (try #1) done!
[15.12.2022 06:46:00] Starting calibre... (try #1) done!
[15.12.2022 06:46:03] A error occurred somewhere. Not deleting old backup sets of appdata
[15.12.2022 06:46:03] Backup / Restore Completed

Is this a bug?

Cheers,

Tim

[KluthR]

21 minutes ago, MothyTim said:

Is this a bug?

I dont think so. I ask docker to stop the container, the answer you see (Stopped x months ago) is the answer coming right out of docker.

 

and those containers were running??

[orlando500]

plugin: updating: ca.backup2.plg
plugin: downloading: https://raw.github.com/Squidly271/ca.backup2/master/archive/ca.backup2-2022.12.13-x86_64-1.txz ... failed (Invalid URL / Server error response)
plugin: https://raw.github.com/Squidly271/ca.backup2/master/archive/ca.backup2-2022.12.13-x86_64-1.txz download failure (Invalid URL / Server error response)

 

anyone getting this trying to update?

[Kilrah]

Github having issues it seems

 

[Konni]

Can I somehow define different backup jobs with this plugin? It's enough for me to update my appdata from cache weekly, however, I want to backup/sync other files from the cache drive every 2 hours or so. Is this possible with the plugin?

[KluthR]

32 minutes ago, Konni said:

Is this possible with the plugin?

No. This would need a 2nd complete configuration, if I got you right (which stops/start different containers etc). Thats not supported.

[MothyTim]

On 12/15/2022 at 10:54 AM, KluthR said:

I dont think so. I ask docker to stop the container, the answer you see (Stopped x months ago) is the answer coming right out of docker.

 

and those containers were running??

Well it's happening everytime the backup runs and never happened before upgrading from Squids version!?

[Sanjiv Patel]

14 hours ago, MothyTim said:

Well it's happening everytime the backup runs and never happened before upgrading from Squids version!?

 

 

I am having the same issue too.  Everytime backup runs, It fails to start docker containers back up.

 

I can't abort the backup run.  Is there a way I can kill the process?

 

 

[KluthR]

21 hours ago, MothyTim said:

Well it's happening everytime the backup runs

 

6 hours ago, Sanjiv Patel said:

I am having the same issue too

Do you both have IPv6 enabled? Please post your diagnostics.

 

as said: the plugin just asks docker to start the specific container.

I had issues with squids version: 3 specific containers wont run randomly. I changed the method for starting the containers to use the unraid style, that fixed my issue. Together with some waiting and the new „3 tries“ method I never had any issues.

 

And yes: Stopping backup is currently broken and will be repaired soon.

 

please post your backup logs and diagnostics.

[MothyTim]

6 hours ago, KluthR said:

 

Do you both have IPv6 enabled? Please post your diagnostics.

 

as said: the plugin just asks docker to start the specific container.

I had issues with squids version: 3 specific containers wont run randomly. I changed the method for starting the containers to use the unraid style, that fixed my issue. Together with some waiting and the new „3 tries“ method I never had any issues.

 

And yes: Stopping backup is currently broken and will be repaired soon.

 

please post your backup logs and diagnostics.

Ok, here you go, logs and diagnostics attached!

 

My problem isn't that containers don't start, it's that it's trying to start a container that has already started!

 

Cheers

Tim 🙂

[18.12.2022 06:00:01] Backup of appData starting. This may take awhile
[18.12.2022 06:00:01] Stopping adminer... done! (took 0 seconds)
[18.12.2022 06:00:01] Stopping authelia... done! (took 1 seconds)
[18.12.2022 06:00:02] Stopping auto-m4b... done! (took 1 seconds)
[18.12.2022 06:00:03] Stopping bazarr... done! (took 6 seconds)
[18.12.2022 06:00:09] Stopping binhex-delugevpn... done! (took 2 seconds)
[18.12.2022 06:00:11] Not stopping binhex-krusader: Not started! [ / Exited (0) 13 days ago]
[18.12.2022 06:00:11] Stopping binhex-lidarr... done! (took 2 seconds)
[18.12.2022 06:00:13] Stopping binhex-prowlarr... done! (took 2 seconds)
[18.12.2022 06:00:15] Stopping binhex-radarr... done! (took 1 seconds)
[18.12.2022 06:00:16] Stopping binhex-readarr... done! (took 0 seconds)
[18.12.2022 06:00:16] Stopping binhex-readarr-2... done! (took 1 seconds)
[18.12.2022 06:00:17] Stopping binhex-sonarr... done! (took 0 seconds)
[18.12.2022 06:00:17] Stopping bitwarden... done! (took 0 seconds)
[18.12.2022 06:00:17] Stopping calibre... done! (took 11 seconds)
[18.12.2022 06:00:28] Not stopping code-server: Not started! [ / Created]
[18.12.2022 06:00:28] Stopping frigate... done! (took 3 seconds)
[18.12.2022 06:00:31] Not stopping HandBrake: Not started! [ / Exited (0) 5 months ago]
[18.12.2022 06:00:31] Stopping Home-Assistant-Core... done! (took 9 seconds)
[18.12.2022 06:00:40] Stopping mariadb... done! (took 4 seconds)
[18.12.2022 06:00:44] Stopping mosquitto... done! (took 1 seconds)
[18.12.2022 06:00:45] Not stopping Network-Speed-Test: Not started! [ / Created]
[18.12.2022 06:00:45] Stopping nextcloud... done! (took 4 seconds)
[18.12.2022 06:00:49] Stopping NodeRed... done! (took 0 seconds)
[18.12.2022 06:00:49] Stopping ombi... done! (took 5 seconds)
[18.12.2022 06:00:54] Stopping PASTA... done! (took 1 seconds)
[18.12.2022 06:00:55] Stopping PlexMediaServer... done! (took 6 seconds)
[18.12.2022 06:01:01] Stopping redis... done! (took 1 seconds)
[18.12.2022 06:01:02] Stopping swag... done! (took 4 seconds)
[18.12.2022 06:01:06] Stopping tautulli... done! (took 0 seconds)
[18.12.2022 06:01:06] Stopping unifi-controller... done! (took 7 seconds)
[18.12.2022 06:01:13] Backing up libvirt.img to /mnt/user/BackupVM/
[18.12.2022 06:01:13] Using Command: /usr/bin/rsync -avXHq --delete --log-file="/var/lib/docker/unraid/ca.backup2.datastore/appdata_backup.log" "/mnt/user/system/libvirt/libvirt.img" "/mnt/user/BackupVM/" > /dev/null 2>&1
2022/12/18 06:01:13 [23557] building file list
2022/12/18 06:01:14 [23557] sent 124 bytes received 19 bytes 95.33 bytes/sec
2022/12/18 06:01:14 [23557] total size is 1,073,741,824 speedup is 7,508,684.08
[18.12.2022 06:01:14] Backing Up appData from /mnt/user/appdata/ to /mnt/user/Backup Appdata/[email protected]
[18.12.2022 06:01:14] Separate archives disabled! Saving into one file.
[18.12.2022 06:01:14] Backing Up
[18.12.2022 06:31:58] Verifying Backup
./Home-Assistant-Core/home-assistant_v2.db: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db: Contents differ
./Home-Assistant-Core/.storage/core.config_entries: Mod time differs
./Home-Assistant-Core/.storage/core.config_entries: Size differs
./Home-Assistant-Core/.storage/hacs.repositories: Mod time differs
./Home-Assistant-Core/.storage/hacs.repositories: Size differs
./Home-Assistant-Core/.storage/core.device_registry: Mod time differs
./Home-Assistant-Core/.storage/core.device_registry: Size differs
./Home-Assistant-Core/.storage/evohome: Mod time differs
./Home-Assistant-Core/.storage/evohome: Contents differ
./Home-Assistant-Core/.storage/core.restore_state: Mod time differs
./Home-Assistant-Core/.storage/core.restore_state: Contents differ
./Home-Assistant-Core/home-assistant.log: Mod time differs
./Home-Assistant-Core/home-assistant.log: Size differs
./Home-Assistant-Core/home-assistant_v2.db-wal: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db-wal: Size differs
./Home-Assistant-Core/home-assistant_v2.db-shm: Mod time differs
./Home-Assistant-Core/home-assistant_v2.db-shm: Contents differ
[18.12.2022 08:23:10] tar verify failed!
[18.12.2022 08:23:10] done
[18.12.2022 08:23:10] Searching for updates to docker applications
[18.12.2022 08:23:38] Starting redis... (try #1) done!
[18.12.2022 08:23:40] Starting mariadb... (try #1) done!
[18.12.2022 08:23:40] Waiting 10 seconds before carrying on
[18.12.2022 08:23:50] Starting adminer... (try #1) done!
[18.12.2022 08:23:52] Starting authelia... (try #1) done!
[18.12.2022 08:23:55] Starting swag... (try #1) done!
[18.12.2022 08:23:55] Waiting 10 seconds before carrying on
[18.12.2022 08:24:05] Starting bitwarden... (try #1) done!
[18.12.2022 08:24:07] Starting nextcloud... (try #1) done!
[18.12.2022 08:24:10] Starting unifi-controller... (try #1) done!
[18.12.2022 08:24:12] Starting mosquitto... (try #1) done!
[18.12.2022 08:24:14] Starting frigate... (try #1) done!
[18.12.2022 08:24:14] Waiting 20 seconds before carrying on
[18.12.2022 08:24:34] Starting Home-Assistant-Core... (try #1) Error while starting container! - Code: Container already started
[18.12.2022 08:24:39] Starting Home-Assistant-Core... (try #2) Error while starting container! - Code: Container already started
[18.12.2022 08:24:44] Starting Home-Assistant-Core... (try #3) Error while starting container! - Code: Container already started
[18.12.2022 08:24:44] Container did not started after multiple tries, skipping.
[18.12.2022 08:24:46] Starting NodeRed... (try #1) done!
[18.12.2022 08:24:49] Starting binhex-delugevpn... (try #1) done!
[18.12.2022 08:24:49] Waiting 45 seconds before carrying on
[18.12.2022 08:25:34] Starting binhex-prowlarr... (try #1) done!
[18.12.2022 08:25:36] Starting binhex-radarr... (try #1) done!
[18.12.2022 08:25:38] Starting binhex-sonarr... (try #1) done!
[18.12.2022 08:25:39] Waiting 60 seconds before carrying on
[18.12.2022 08:26:39] Starting binhex-lidarr... (try #1) done!
[18.12.2022 08:26:41] Starting bazarr... (try #1) done!
[18.12.2022 08:26:43] Starting binhex-readarr... (try #1) done!
[18.12.2022 08:26:45] Starting binhex-readarr-2... (try #1) done!
[18.12.2022 08:26:48] Starting PlexMediaServer... (try #1) done!
[18.12.2022 08:26:50] Starting ombi... (try #1) done!
[18.12.2022 08:26:52] Starting tautulli... (try #1) done!
[18.12.2022 08:26:54] Starting PASTA... (try #1) done!
[18.12.2022 08:26:57] Starting auto-m4b... (try #1) done!
[18.12.2022 08:26:59] Starting calibre... (try #1) done!
[18.12.2022 08:27:02] A error occurred somewhere. Not deleting old backup sets of appdata
[18.12.2022 08:27:02] Backup / Restore Completed

 

tower-diagnostics-20221218-1613.zip

[KluthR]

3 hours ago, MothyTim said:

My problem isn't that containers don't start, it's that it's trying to start a container that has already started!

Ahh! Okay, that could be because you enabled auto update. Maybe it starts the containers.

 

the reason for the error then: squids version started containers without checking for success. I implemented checking and now the silent warning is being brought to attention. I should cover that case.

[MothyTim]

11 minutes ago, KluthR said:

Ahh! Okay, that could be because you enabled auto update. Maybe it starts the containers.

 

the reason for the error then: squids version started containers without checking for success. I implemented checking and now the silent warning is being brought to attention. I should cover that case.

Oh ok, I'll switch off auto update for now and monitor for a fix!

Thanks for your speedy response!

Cheers,

Tim

[KluthR]

Oh, you can safely leave it turned on, the behavior should be the same. Theres just the new error which was silently discarded before.

[Built2Succeed]

My 'Action Centre' shows V2 as deprecated, see attached image.  Is there a "newer" new version??  I'm confused.

[trurl]

28 minutes ago, Built2Succeed said:

Is there a "newer" new version??

See "Recommended Post" linked at the top of every page in this thread.

[Sanjiv Patel]

18 hours ago, KluthR said:

 

Do you both have IPv6 enabled? Please post your diagnostics.

 

as said: the plugin just asks docker to start the specific container.

I had issues with squids version: 3 specific containers wont run randomly. I changed the method for starting the containers to use the unraid style, that fixed my issue. Together with some waiting and the new „3 tries“ method I never had any issues.

 

And yes: Stopping backup is currently broken and will be repaired soon.

 

please post your backup logs and diagnostics.

1. I do not have ipv6 enabled.
2. Yes, I was having issue with one of the containers starting back up, that was most likely the culrit.  The docker container in question was most likely misconfigured.

 

 

My latest backup worked great and all the containers started back up.

 

 

 

Edited December 19, 2022 by Sanjiv Patel

[KluthR]

14 hours ago, KluthR said:

17 hours ago, MothyTim said:

My problem isn't that containers don't start, it's that it's trying to start a container that has already started!

Ahh! Okay, that could be because you enabled auto update. Maybe it starts the containers.

Your logs confirm my thoughts:

 

Dec 18 06:02:24 Tower Docker Auto Update: Restarting Home-Assistant-Core
Dec 18 06:02:25 Tower Docker Auto Update: Community Applications Docker Autoupdate finished

 

So, I have to catch that case.

[MothyTim]

1 hour ago, KluthR said:

Your logs confirm my thoughts:

 

Dec 18 06:02:24 Tower Docker Auto Update: Restarting Home-Assistant-Core
Dec 18 06:02:25 Tower Docker Auto Update: Community Applications Docker Autoupdate finished

 

So, I have to catch that case.

Ok, thanks, the only problem it causes for me anyway is that it doesn't delete the old backups!

 

Cheers,

Tim

[ich777]

1 hour ago, KluthR said:

Your logs confirm my thoughts:

Just my thoughts, wouldn't it be better to start a new thread and rename the plugin to CA Appdata Backup / Restore v3 or something like that because the plugin now has a new maintainer?