zstd is extremely fast, changing to that for my own script brought a backup from 10 minutes to less than 2... and saved a little space too. 

So referencing my previous post:

Setting the "Path To Custom Pre-start Script:" didn't work as expected...

 

[03.02.2023 05:00:45] Backing Up
/usr/bin/tar: ./binhex-qbittorrentvpn/qBittorrent/config/ipc-socket: socket ignored
[03.02.2023 05:02:48] Verifying Backup
./binhex-qbittorrentvpn/qBittorrent/config/qBittorrent.conf: Mod time differs
./binhex-qbittorrentvpn/qBittorrent/data/logs/qbittorrent.log: Mod time differs
./binhex-qbittorrentvpn/qBittorrent/data/logs/qbittorrent.log: Size differs
[03.02.2023 05:04:52] tar verify failed!
[03.02.2023 05:04:52] done
[03.02.2023 05:04:52] Executing custom pre-start script /mnt/user/data/scripts/backup-pre-start

 

My script kicked off successfully and killed the target processes as expected... Just a bit too late..

 

Looks like it's pre-start of dockers, not pre-start of backup as I was expecting/assuming. I couldn't find any documentation confirming what it's supposed to be, but from the code, looks like it's a pre-start of dockers:

https://github.com/Commifreak/ca.backup2/blob/master/source/ca.backup2/usr/local/emhttp/plugins/ca.backup2/scripts/backup.php#L323

 

I haven't touched php in a minute and don't have a good way to test, so I'd be hesitant to submit a PR, but anyway to get a pre-backup-start script option added in?

 

 

Actually I dont wanted to change anything not crucial for the old version, bit I will see what I can do.

 

I could tell you what to change to let it run earlier (manual patch it for you only).

Understood... I'll go a different route then - I'll schedule this as a user script to run 5 minutes before my scheduled back up. problem solved. Thanks!

I installed the new version and now it's saying 

 

Source Must Be Specified
Source cannot be /mnt/user or /mnt/disk

 

Destination is /mnt/user/CommunityApplicationsAppdataBackup

 

I don't think it ever did this on V2.

 

Where do I go from here? 

Didnt changed something there, so I think this warning must be there before.

 

if you have the old config file (flash backup) you could copy it over. /config/plugins/ca.backup/backupOptions.json I think, dont have the exact path in my head right now

Edited February 5, 20233 yr by KluthR

13 minutes ago, KluthR said:

Didnt changed something there, so I think this warning must be there before.

 

if you have the old config file (flash backup) you could copy it over. /config/plugins/ca.backup/backupOptions.json I think, dont have the exact path in my head right now

CRAP! I don't have a flash backup handy. Where do I go from here? 

Are you sure, that these paths are right?

30 minutes ago, KluthR said:

Are you sure, that these paths are right?

Positive. I never changed them as far as I can remember. 

It seems, that your source setting is empty. That tells me your quoted error "Source Must Be Specified". Please double check.

11 hours ago, KluthR said:

It seems, that your source setting is empty. That tells me your quoted error "Source Must Be Specified". Please double check.

Does this look correct now?

 

5 minutes ago, urbanracer34 said:

Does this look correct now?

Are you absolutely sure all of appdata is on your pool named cache? Just setting it cache:only doesn't necessarily mean it never got any files elsewhere. It only means new files will go to cache, and mover will ignore the share.

29 minutes ago, trurl said:

Are you absolutely sure all of appdata is on your pool named cache? Just setting it cache:only doesn't necessarily mean it never got any files elsewhere. It only means new files will go to cache, and mover will ignore the share.

 

 All of my docker containers and appdata are on the cache drive under pool devices (/mnt/cache/appdata). That is where I want to put it, unless this is the wrong way

Edited February 6, 20233 yr by urbanracer34

2 hours ago, urbanracer34 said:

All of my docker containers and appdata are on the cache drive under pool devices (/mnt/cache/appdata). That is where I want to put it, unless this is the wrong way

That is the right way. Do you know how to check that?

54 minutes ago, trurl said:

That is the right way. Do you know how to check that?

 

I don't think so, but I just looked under the cache drive and there was the appdata folder. 

5 hours ago, urbanracer34 said:

I don't think so, but I just looked under the cache drive and there was the appdata folder. 

The question is whether or not appdata is also anywhere else.

 

On the User Shares page, click Compute... for the appdata share. It will show you how much of each disk is used by the share.

Every time I run a backup with v3 of the plugin I get two errors:

 

CA Backup/Restore: tar verify failed!

 

and

 

CA Backup/Restore: A error occurred somewhere. Not deleting old backup sets of appdata

 

But there is no other information on what that "error occurred" is. Any ideas on how to correct this issue?

Something is accessing the backed up data during backup.

 

Please attach the logfile from the status tab.

57 minutes ago, KluthR said:

Something is accessing the backed up data during backup.

 

Please attach the logfile from the status tab.

I think this is what you want, if something else please let me know. Thank you.

 

[07.02.2023 10:56:57] Backup of appData starting. This may take awhile
[07.02.2023 10:56:57] Stopping 7DaysToDie-A20... done! (took 8 seconds)
[07.02.2023 10:57:05] Not stopping binhex-delugevpn: Not started! [ / Created]
[07.02.2023 10:57:05] Stopping binhex-sabnzbdvpn... done! (took 4 seconds)
[07.02.2023 10:57:09] Stopping bitwardenrs... done! (took 2 seconds)
[07.02.2023 10:57:11] Stopping Cloudflare-DDNS-Buhmonte... done! (took 5 seconds)
[07.02.2023 10:57:16] Stopping Cloudflare-DDNS-MB... done! (took 5 seconds)
[07.02.2023 10:57:21] Stopping duckdns... done! (took 7 seconds)
[07.02.2023 10:57:28] Stopping duplicati... done! (took 7 seconds)
[07.02.2023 10:57:35] Stopping Emby-Official... done! (took 6 seconds)
[07.02.2023 10:57:41] Stopping FoundryVTT... done! (took 12 seconds)
[07.02.2023 10:57:53] Stopping freshrss... done! (took 7 seconds)
[07.02.2023 10:58:00] Stopping homepage... done! (took 1 seconds)
[07.02.2023 10:58:01] Stopping Jellyfin... done! (took 3 seconds)
[07.02.2023 10:58:04] Not stopping Krusader: Not started! [ / Exited (143) 2 months ago]
[07.02.2023 10:58:04] Stopping linuxserver-bazarr... done! (took 7 seconds)
[07.02.2023 10:58:11] Stopping linuxserver-embystat... done! (took 8 seconds)
[07.02.2023 10:58:19] Stopping linuxserver-ombi... done! (took 7 seconds)
[07.02.2023 10:58:26] Stopping linuxserver-radarr... done! (took 7 seconds)
[07.02.2023 10:58:33] Stopping linuxserver-sonarr... done! (took 6 seconds)
[07.02.2023 10:58:39] Stopping mariadb... done! (took 7 seconds)
[07.02.2023 10:58:46] Stopping Minecraft-BanditLizardmen... done! (took 12 seconds)
[07.02.2023 10:58:58] Not stopping Minecraft-Pixelmon: Not started! [ / Exited (143) 6 weeks ago]
[07.02.2023 10:58:58] Not stopping Minecraft_BL: Not started! [ / Created]
[07.02.2023 10:58:58] Stopping nextcloud... done! (took 7 seconds)
[07.02.2023 10:59:05] Stopping NginxProxyManager... done! (took 6 seconds)
[07.02.2023 10:59:11] Stopping OnlyOfficeDocumentServer... done! (took 12 seconds)
[07.02.2023 10:59:23] Stopping PhotoPrism... done! (took 2 seconds)
[07.02.2023 10:59:25] Not stopping PhotoStructure: Not started! [ / Exited (0) 2 weeks ago]
[07.02.2023 10:59:25] Not stopping phpmyadmin: Not started! [ / Exited (0) 12 days ago]
[07.02.2023 10:59:25] Not stopping qdirstat: Not started! [ / Created]
[07.02.2023 10:59:25] Stopping speedtest-tracker... done! (took 6 seconds)
[07.02.2023 10:59:31] Not stopping syncthing: Not started! [ / Exited (0) 12 days ago]
[07.02.2023 10:59:31] Stopping tdarr... done! (took 6 seconds)
[07.02.2023 10:59:37] Stopping tdarr_node... done! (took 6 seconds)
[07.02.2023 10:59:43] Stopping Terraria... done! (took 3 seconds)
[07.02.2023 10:59:46] Stopping Valheim... done! (took 7 seconds)
[07.02.2023 10:59:53] Stopping whoogle-search... done! (took 13 seconds)
[07.02.2023 11:00:06] Stopping WireGuard-Easy... done! (took 1 seconds)
[07.02.2023 11:00:07] Stopping WordPress-Komina... done! (took 3 seconds)
[07.02.2023 11:00:10] Stopping WordPress-MB... done! (took 5 seconds)
[07.02.2023 11:00:15] Backing Up appData from /mnt/user/appdata/ to /mnt/user/nextcloud/data/marc/files/unraid-backup/appdata-backup/[email protected]
[07.02.2023 11:00:15] Separate archives disabled! Saving into one file.
[07.02.2023 11:00:15] Backing Up
[07.02.2023 11:41:09] Verifying Backup
./syslog-192.168.50.39.log: Mod time differs
./syslog-192.168.50.39.log: Size differs
[07.02.2023 11:56:24] tar verify failed!
[07.02.2023 11:56:24] done
[07.02.2023 11:56:24] Starting 7DaysToDie-A20... (try #1) done!
[07.02.2023 11:56:29] Starting binhex-sabnzbdvpn... (try #1) done!
[07.02.2023 11:56:34] Starting bitwardenrs... (try #1) done!
[07.02.2023 11:56:44] Starting Cloudflare-DDNS-Buhmonte... (try #1) done!
[07.02.2023 11:56:51] Starting Cloudflare-DDNS-MB... (try #1) done!
[07.02.2023 11:56:55] Starting duckdns... (try #1) done!
[07.02.2023 11:57:00] Starting duplicati... (try #1) done!
[07.02.2023 11:57:06] Starting Emby-Official... (try #1) done!
[07.02.2023 11:57:11] Starting FoundryVTT... (try #1) done!
[07.02.2023 11:57:17] Starting freshrss... (try #1) done!
[07.02.2023 11:57:21] Starting homepage... (try #1) done!
[07.02.2023 11:57:27] Starting Jellyfin... (try #1) done!
[07.02.2023 11:57:32] Starting linuxserver-bazarr... (try #1) done!
[07.02.2023 11:57:38] Starting linuxserver-embystat... (try #1) done!
[07.02.2023 11:57:44] Starting linuxserver-ombi... (try #1) done!
[07.02.2023 11:57:53] Starting linuxserver-radarr... (try #1) done!
[07.02.2023 11:58:07] Starting linuxserver-sonarr... (try #1) done!
[07.02.2023 11:58:18] Starting mariadb... (try #1) done!
[07.02.2023 11:58:28] Starting Minecraft-BanditLizardmen... (try #1) done!
[07.02.2023 11:58:36] Starting nextcloud... (try #1) done!
[07.02.2023 11:58:43] Starting NginxProxyManager... (try #1) done!
[07.02.2023 11:58:50] Starting OnlyOfficeDocumentServer... (try #1) done!
[07.02.2023 11:58:55] Starting PhotoPrism... (try #1) done!
[07.02.2023 11:59:02] Starting speedtest-tracker... (try #1) done!
[07.02.2023 11:59:06] Starting tdarr... (try #1) done!
[07.02.2023 11:59:11] Starting tdarr_node... (try #1) done!
[07.02.2023 11:59:18] Starting Terraria... (try #1) done!
[07.02.2023 11:59:29] Starting Valheim... (try #1) done!
[07.02.2023 11:59:39] Starting whoogle-search... (try #1) done!
[07.02.2023 11:59:48] Starting WireGuard-Easy... (try #1) done!
[07.02.2023 12:00:03] Starting WordPress-Komina... (try #1) done!
[07.02.2023 12:00:16] Starting WordPress-MB... (try #1) done!
[07.02.2023 12:00:29] A error occurred somewhere. Not deleting old backup sets of appdata
[07.02.2023 12:00:29] Backup / Restore Completed

 

These syslogs are the issue. Changed while backing up. Where are those from?

1 hour ago, KluthR said:

These syslogs are the issue. Changed while backing up. Where are those from?

I'm not sure, and I don't even know where to find the files. I did a search but can't find them.

 

UPDATE: Okay, found it. It's in /mnt/cache/appdata. It looks like it's the Unraid syslog file.

 

UPDATE 2: It looks like under Settings the syslog server was set to the appdata folder. I changed it to the log folder. Hopefully that will fix the issue.

 

Edited February 7, 20233 yr by thunderclap

20 hours ago, trurl said:

The question is whether or not appdata is also anywhere else.

 

On the User Shares page, click Compute... for the appdata share. It will show you how much of each disk is used by the share.

 

appdata Cache 14.4GB 

Edited February 7, 20233 yr by urbanracer34
be more precise.

On 1/24/2023 at 2:33 PM, PlanetDyna said:

I have docker that should be backed up 1x a week and 1x a month. This is what I meant.

Can someone please show me how I can setup multiple different backup jobs?

 

This is currently not possible via plugin

5 hours ago, PlanetDyna said:

Can someone please show me how I can setup multiple different backup jobs?

 

There are many different backup options. Here’s one-

https://forums.unraid.net/topic/97958-rsync-incremental-backup/