[Plugin] Appdata.Backup

KluthR

By KluthR
in Plugin Support

Recommended Posts

Recommended

Posted by KluthR,

Sorry, the old backups are not compatible with the new plugin and therefore not available for restore. If you need something unpack it by yourself. After some time you can discard they.
Recommended by KluthR
  • Upvote

2 reactions

Go to this post
Darkestnoir Noob

Darkestnoir

Posted
Posted (edited)
4 hours ago, KluthR said:

Yes, thats the case. I have no clue how to fix that in a smart way. Maybe I just move the preRun BEFORE destination existence. Seems smart enough to me.

This would also be the way i would fix it, i am happy to see it in the next release ☺️

 

4 hours ago, KluthR said:

Looks like a missing +x (executable) flag to me. Make sure the scripts are really executable by set rights like "chmod a+x *script.sh*"

Ah, i totally forgot this, ty for the hint.

 

4 hours ago, KluthR said:

See Compression Option (Yes, Yes multicore) and its related help block.

Oh, i overlooked this ty.

 

4 hours ago, KluthR said:

Nope. Only VM meta xml. No more logic to VMs (yet)

Okay, i found the VM Backup plugin, its a little bit old, but maybe it works just fine for it.
Edit: Hm seems not to work correctly unfortunately.

 

4 hours ago, KluthR said:

Have a look into the debug log file at the last few lines (/tmp/appdata.backup/ab.debug.log)

I can see it their neither:

grafik.thumb.png.7bc5518dce707183fe0e9230b52ef0dc.png

4 hours ago, KluthR said:

Huh, not used for a while now, I check this.

That would be great, because FF is my main browser ^^

Edited by Darkestnoir
Link to comment
  • Replies 1.1k
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

KluthR
KluthR

Appdata.Backup Support Thread This is the support thread for appdata.backup (formerly known as ca.backup2).   This plugin primary takes care of your appdata backup! It allows

KluthR
KluthR

The new update is coming It been a while since the last stable update. There were some betas (never got feedback though) but I had other work to do the last weeks. I tested the major changes agai

KluthR
KluthR

2023.08.28 should fix the docker auto update issue.

Posted Images

KluthR Collaborator

KluthR

Posted
  • Author
Posted
1 hour ago, jcofer555 said:

having the WARN: Multi mapping detected! message in all my containers even though the paths are different. this is the newest version 2024.02.26

Known an I (we) are on it. Currently collecting debug info from affected users as I cant reproduce it on my end.

 

1 hour ago, Darkestnoir said:

I can see it their neither:

Uh Oh. Doesnt look right at all! I guess something is crashing silently. If the red heart is definitively the last line in that log, er are having an issue here. If you have some time, please PM me, I also need some testst at your side for me to understand this.

 

54 minutes ago, Zotarios said:

Is it possible to just run a bash command instead of a script file?

No. Currently the best way is to create a helper .sh file

  • Like 1
Link to comment
betaman Enthusiast

betaman

Posted
Posted
10 hours ago, Darkestnoir said:

Okay, i found the VM Backup plugin, its a little bit old, but maybe it works just fine for it.
Edit: Hm seems not to work correctly unfortunately.

Checkout URBackup Docker. I think xml backup with this plugin combined with VM backup using URBackup is the best path right now.

  • Like 1
Link to comment
Kilrah Rising Star

Kilrah

Posted
Posted
6 hours ago, Darkestnoir said:

A "small" feature request:

  • Optional Zstandard compression.

Because its the "best" compression algorithm at the time, when you compare time needed to compression ration.

If you choose "yes, multicore" for compression you get Zstd already.

  • Like 1
Link to comment
xl3b4n0nx Noob

xl3b4n0nx

Posted
Posted

I'm not sure where the best place to do this is, but I have an idea for a feature request. I think this would be quite beneficial to anyone on 6.12+ and using ZFS for their cache pool where their appdata directory lives.

 

The feature would take advantage of ZFS snapshots to enable backing up of the appdata directory and xml without shutting down the containers. The procedure would be something like this.

 

  1. Check for unraid 6.12+
  2. Check if appdata is on a ZFS filesystem AND in its own dataset
  3. If so, take a snapshot and give it a unique name generated by the script
  4. Substitute in the snapshot path into the appdata location and then run the script as normal, but without shutting down the containers

At the end of the procedure the MVP could be deleting the snapshot so they don't pile up. But a more advanced version would incorporate some basic snapshot management for the automatically created snapshots.

 

If i can get some time I would love to take a crack at this, but that's in short supply for me now. I figured I would throw this out there in case someone else wants to work on it.

Link to comment
KluthR Collaborator

KluthR

Posted
  • Author
Posted
2 hours ago, xl3b4n0nx said:

The feature would take advantage of ZFS snapshots to enable backing up of the appdata directory and xml without shutting down the containers.

Which is not a consistent backup, in my eyes.

 

If Snapshots would be supported I would AT LEAST stop all containers, create snap, start container, doing file backup on just created snap.

Link to comment
HumanTechDesign Rookie

HumanTechDesign

Posted
Posted
2 minutes ago, KluthR said:

named volumes are in progress to be supported. Needs some more time. But it should be possible to exclude those volumes by writing the exact name inside the exclude box (inside container specific settings).

 

Perfect! That's great to hear. Thank you very much (also for the quick response). Looking forward to full support!

Link to comment
jademonkee Contributor

jademonkee

Posted
Posted

My weekly backup ran successfully this morning, however the directory is empty.

Logs are as follows: 

[28.02.2024 05:00:01][ℹ️][Main] 👋 WELCOME TO APPDATA.BACKUP!! :D
[28.02.2024 05:00:01][ℹ️][Main] Backing up from: /mnt/cache/appdata
[28.02.2024 05:00:01][ℹ️][Main] Backing up to: /mnt/user/Backup/ca_backup_app/ab_20240228_050001
[28.02.2024 05:00:01][ℹ️][Main] Selected containers: DiskSpeed, LogitechMediaServer, MongoDB, QDirStat, Redis, Sonarr, binhex-sabnzbdvpn, gPodder, mariadb-nextcloud, nextcloud, phpmyadmin, plex, radarr, swag, unifi-network-application
[28.02.2024 05:00:01][ℹ️][Main] Saving container XML files...
[28.02.2024 05:00:01][ℹ️][Main] Method: Stop all container before continuing.
[28.02.2024 05:00:01][ℹ️][unifi-network-application] Stopping unifi-network-application... done! (took 8 seconds)
[28.02.2024 05:00:09][ℹ️][MongoDB] Stopping MongoDB... done! (took 1 seconds)
[28.02.2024 05:00:10][ℹ️][QDirStat] No stopping needed for QDirStat: Not started!
[28.02.2024 05:00:10][ℹ️][DiskSpeed] No stopping needed for DiskSpeed: Not started!
[28.02.2024 05:00:10][ℹ️][phpmyadmin] No stopping needed for phpmyadmin: Not started!
[28.02.2024 05:00:10][ℹ️][gPodder] Stopping gPodder... done! (took 5 seconds)
[28.02.2024 05:00:15][ℹ️][Sonarr] Stopping Sonarr... done! (took 4 seconds)
[28.02.2024 05:00:19][ℹ️][radarr] Stopping radarr... done! (took 5 seconds)
[28.02.2024 05:00:24][ℹ️][nextcloud] Stopping nextcloud... done! (took 5 seconds)
[28.02.2024 05:00:29][ℹ️][swag] Stopping swag... done! (took 4 seconds)
[28.02.2024 05:00:33][ℹ️][Redis] Stopping Redis... done! (took 0 seconds)
[28.02.2024 05:00:33][ℹ️][plex] Stopping plex... done! (took 4 seconds)
[28.02.2024 05:00:37][ℹ️][LogitechMediaServer] Stopping LogitechMediaServer... done! (took 3 seconds)
[28.02.2024 05:00:40][ℹ️][mariadb-nextcloud] Stopping mariadb-nextcloud... done! (took 4 seconds)
[28.02.2024 05:00:44][ℹ️][binhex-sabnzbdvpn] Stopping binhex-sabnzbdvpn... done! (took 2 seconds)
[28.02.2024 05:00:46][ℹ️][Main] Starting backup for containers
[28.02.2024 05:00:46][ℹ️][unifi-network-application] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][unifi-network-application] Calculated volumes to back up: /mnt/cache/appdata/unifi-network-application
[28.02.2024 05:00:46][ℹ️][unifi-network-application] Backing up unifi-network-application...
[28.02.2024 05:00:46][ℹ️][unifi-network-application] Backup created without issues
[28.02.2024 05:00:46][⚠️][unifi-network-application] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:46][ℹ️][MongoDB] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][⚠️][MongoDB] MongoDB does not have any volume to back up! Skipping. Please consider ignoring this container.
[28.02.2024 05:00:46][ℹ️][QDirStat] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][QDirStat] Calculated volumes to back up: /mnt/cache/appdata/QDirStat
[28.02.2024 05:00:46][ℹ️][QDirStat] Backing up QDirStat...
[28.02.2024 05:00:46][ℹ️][QDirStat] Backup created without issues
[28.02.2024 05:00:46][⚠️][QDirStat] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:46][ℹ️][DiskSpeed] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][DiskSpeed] Calculated volumes to back up: /mnt/cache/appdata/DiskSpeed
[28.02.2024 05:00:46][ℹ️][DiskSpeed] Backing up DiskSpeed...
[28.02.2024 05:00:46][ℹ️][DiskSpeed] Backup created without issues
[28.02.2024 05:00:46][⚠️][DiskSpeed] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:46][ℹ️][phpmyadmin] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][phpmyadmin] Calculated volumes to back up: /mnt/cache/appdata/phpmyadmin
[28.02.2024 05:00:46][ℹ️][phpmyadmin] Backing up phpmyadmin...
[28.02.2024 05:00:46][ℹ️][phpmyadmin] Backup created without issues
[28.02.2024 05:00:46][⚠️][phpmyadmin] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:46][ℹ️][gPodder] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][gPodder] Calculated volumes to back up: /mnt/cache/appdata/gPodder
[28.02.2024 05:00:46][ℹ️][gPodder] Backing up gPodder...
[28.02.2024 05:00:46][ℹ️][gPodder] Backup created without issues
[28.02.2024 05:00:46][⚠️][gPodder] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:46][ℹ️][Sonarr] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:46][ℹ️][Sonarr] Calculated volumes to back up: /mnt/cache/appdata/sonarr
[28.02.2024 05:00:46][ℹ️][Sonarr] Backing up Sonarr...
[28.02.2024 05:00:49][ℹ️][Sonarr] Backup created without issues
[28.02.2024 05:00:49][⚠️][Sonarr] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:49][ℹ️][radarr] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:49][ℹ️][radarr] Calculated volumes to back up: /mnt/cache/appdata/radarr
[28.02.2024 05:00:49][ℹ️][radarr] Backing up radarr...
[28.02.2024 05:00:58][ℹ️][radarr] Backup created without issues
[28.02.2024 05:00:58][⚠️][radarr] Skipping verification for this container because its not wanted!
[28.02.2024 05:00:58][ℹ️][nextcloud] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:00:58][ℹ️][nextcloud] Calculated volumes to back up: /mnt/cache/appdata/nextcloud
[28.02.2024 05:00:58][ℹ️][nextcloud] Backing up nextcloud...
[28.02.2024 05:01:11][ℹ️][nextcloud] Backup created without issues
[28.02.2024 05:01:11][⚠️][nextcloud] Skipping verification for this container because its not wanted!
[28.02.2024 05:01:11][ℹ️][swag] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:01:11][ℹ️][swag] Calculated volumes to back up: /mnt/cache/appdata/swag
[28.02.2024 05:01:11][ℹ️][swag] Backing up swag...
[28.02.2024 05:01:12][ℹ️][swag] Backup created without issues
[28.02.2024 05:01:12][⚠️][swag] Skipping verification for this container because its not wanted!
[28.02.2024 05:01:12][ℹ️][Redis] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:01:12][ℹ️][Redis] Calculated volumes to back up: /mnt/cache/appdata/redis/data
[28.02.2024 05:01:12][ℹ️][Redis] Backing up Redis...
[28.02.2024 05:01:12][ℹ️][Redis] Backup created without issues
[28.02.2024 05:01:12][⚠️][Redis] Skipping verification for this container because its not wanted!
[28.02.2024 05:01:12][ℹ️][plex] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:01:12][ℹ️][plex] Calculated volumes to back up: /mnt/cache/appdata/plex
[28.02.2024 05:01:12][ℹ️][plex] Backing up plex...
[28.02.2024 05:05:29][ℹ️][plex] Backup created without issues
[28.02.2024 05:05:29][⚠️][plex] Skipping verification for this container because its not wanted!
[28.02.2024 05:05:29][ℹ️][LogitechMediaServer] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:05:29][ℹ️][LogitechMediaServer] Calculated volumes to back up: /mnt/cache/appdata/LogitechMediaServer
[28.02.2024 05:05:29][ℹ️][LogitechMediaServer] Backing up LogitechMediaServer...
[28.02.2024 05:05:45][ℹ️][LogitechMediaServer] Backup created without issues
[28.02.2024 05:05:45][⚠️][LogitechMediaServer] Skipping verification for this container because its not wanted!
[28.02.2024 05:05:45][ℹ️][mariadb-nextcloud] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:05:45][ℹ️][mariadb-nextcloud] Calculated volumes to back up: /mnt/cache/appdata/mariadb
[28.02.2024 05:05:45][ℹ️][mariadb-nextcloud] Backing up mariadb-nextcloud...
[28.02.2024 05:05:50][ℹ️][mariadb-nextcloud] Backup created without issues
[28.02.2024 05:05:50][⚠️][mariadb-nextcloud] Skipping verification for this container because its not wanted!
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] '/mnt/cache/appdata/binhex-sabnzbdvpn/data' is within mapped volume '/mnt/cache/appdata/binhex-sabnzbdvpn'! Ignoring!
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] Should NOT backup external volumes, sanitizing them...
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] Calculated volumes to back up: /mnt/cache/appdata/binhex-sabnzbdvpn
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] Backing up binhex-sabnzbdvpn...
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] Backup created without issues
[28.02.2024 05:05:50][⚠️][binhex-sabnzbdvpn] Skipping verification for this container because its not wanted!
[28.02.2024 05:05:50][ℹ️][Main] Set containers to previous state
[28.02.2024 05:05:50][ℹ️][binhex-sabnzbdvpn] Starting binhex-sabnzbdvpn... (try #1) done!
[28.02.2024 05:05:58][ℹ️][mariadb-nextcloud] Starting mariadb-nextcloud... (try #1) done!
[28.02.2024 05:05:58][ℹ️][mariadb-nextcloud] The container has a delay set, waiting 5 seconds before carrying on
[28.02.2024 05:06:03][ℹ️][LogitechMediaServer] Starting LogitechMediaServer... (try #1) done!
[28.02.2024 05:06:05][ℹ️][plex] Starting plex... (try #1) done!
[28.02.2024 05:06:08][ℹ️][Redis] Starting Redis... (try #1) done!
[28.02.2024 05:06:10][ℹ️][swag] Starting swag... (try #1) done!
[28.02.2024 05:06:10][ℹ️][swag] The container has a delay set, waiting 15 seconds before carrying on
[28.02.2024 05:06:25][ℹ️][nextcloud] Starting nextcloud... (try #1) done!
[28.02.2024 05:06:28][ℹ️][radarr] Starting radarr... (try #1) done!
[28.02.2024 05:06:30][ℹ️][Sonarr] Starting Sonarr... (try #1) done!
[28.02.2024 05:06:32][ℹ️][gPodder] Starting gPodder... (try #1) done!
[28.02.2024 05:06:35][ℹ️][phpmyadmin] Starting phpmyadmin is being ignored, because it was not started before (or should not be started).
[28.02.2024 05:06:35][ℹ️][DiskSpeed] Starting DiskSpeed is being ignored, because it was not started before (or should not be started).
[28.02.2024 05:06:35][ℹ️][QDirStat] Starting QDirStat is being ignored, because it was not started before (or should not be started).
[28.02.2024 05:06:35][ℹ️][MongoDB] Starting MongoDB... (try #1) done!
[28.02.2024 05:06:35][ℹ️][MongoDB] The container has a delay set, waiting 5 seconds before carrying on
[28.02.2024 05:06:40][ℹ️][unifi-network-application] Starting unifi-network-application... (try #1) done!
[28.02.2024 05:06:43][ℹ️][Main] Backing up the flash drive.
[28.02.2024 05:07:16][ℹ️][Main] Flash backup created!
[28.02.2024 05:07:16][ℹ️][Main] Checking retention...
[28.02.2024 05:07:16][ℹ️][Main] Delete old backup: /mnt/user/Backup/ca_backup_app/ab_20240124_050001
[28.02.2024 05:07:18][ℹ️][Main] DONE! Thanks for using this plugin and have a safe day ;)
[28.02.2024 05:07:18][ℹ️][Main] ❤️

 

I also created a private debug log. The debug log id is: 36756508-9131-4a72-9764-cd0ed83a1b75

Link to comment
jademonkee Contributor

jademonkee

Posted
Posted

UPDATE:
I remembered that I updated the plugin this morning (hours after the backup had run), so thought I'd take a look at all the settings and manually run a backup.

All the files are in the new directory, as expected.

I don't know what caused it, but it's working as expected now.

Please discard my previous post.

Link to comment
MyStarserver Noob

MyStarserver

Posted
Posted
On 4/10/2023 at 4:22 PM, KluthR said:

Plex Media Server/Media

I want to know if I really need to back up my Plex Media Server/media. My media file is over 150 GB, and I want to know if it consists only of posters and some movie information that can be recreated when I set up a new media server without backing it up.

Link to comment
betaman Enthusiast

betaman

Posted
Posted (edited)
9 minutes ago, MyStarserver said:

I want to know if I really need to back up my Plex Media Server/media. My media file is over 150 GB, and I want to know if it consists only of posters and some movie information that can be recreated when I set up a new media server without backing it up.

If you’re not anal about your poster art then yes, it can be recreated easily. Alternatively, you could store your art in a remote folder and just back that up. The bigger issue with the Plex data (assume it’s similar to Emby as that’s what I use) than the size is the sheer number of small files. Doesn’t lend it itself well to backups or copies.

Edited by betaman
Link to comment
Sptz87 Apprentice

Sptz87

Posted
Posted

A couple of questions:

 

If I'm doing a new unraid build and using the flash disk zip file to create a new unraid usb boot drive. Will that fire up the array as it was? (don't want that) If so, is there a way to stop it from starting the array as soon as it starts?

 

Secondly: I've never done a restore but I'm in a pickle and may need to do a restore on a fresh new build. How would one go about it? Restore the docker backups and then install the containers?

Link to comment
Sptz87 Apprentice

Sptz87

Posted
Posted (edited)

So I just did a restore, selected all templates and containers (did not select "restore backup config") and instantly got all the appdata in the mnt/user/appdata! Great!

But when I go to Apps, I can't see any dockers in Previous Apps. Any idea how to get them back? As that's really the main thing about these backups. so that the templates are as they were.

 

1152147761_CleanShot2024-03-03at00_16.48@2x.thumb.png.44169b846151999de2f316daf90dac40.png

 

This is a new installation. So where did the templates get restored to?!

Edited by Sptz87
Link to comment
Sptz87 Apprentice

Sptz87

Posted
Posted (edited)
15 hours ago, trurl said:

Previous Apps gets the templates from /boot/config/plugins/dockerMan/templates-user

 

But since this a new installation it doesn't exist. And doing a restore I thought it'd copy them into that folder? Otherwise what's the point of restoring?

Should I create that folder and attempt a restore again?

 

Solved: In case anyone is in the same situation. Just installing any random container from the "appstore" obviously created that folder. Then once you restore it again it will be able to populate. Since it looks like this plugin isn't attempting to create the folder if it's missing, just populate it.

Edited by Sptz87
Link to comment
tenpaiyomi Noob

tenpaiyomi

Posted
Posted

Seems like I wound up updating from the older version to the newer today and had to set up the various settings and all this morning, which was fine. However I have several Docker containers that mount at /mnt/user/appdata/steamcmd, which I don't have any reason to back up.  I figured I could just add that directory to the global exclusions, but when I started a manual backup and it got to the first container which included that directory, it did not include the message about that particular folder matching an exclusion and included it in the calculated volumes to be backed up.  Only when I aborted and then added the exclusion to each container exclusion individually did it then note that it was not going to back them up.

Link to comment
BartyB Noob

BartyB

Posted
Posted
On 4/10/2023 at 10:22 AM, KluthR said:

The plugin sent me here to get help for the "Mapping used in multiple containers!" message

The plugin can detect if you use the same mapping within more containers. That is completely okay but you should know that this can lead to "verification failed: contents differ" messages if you use stop/backup/start method and another container modifies the data during backup of the container that uses that share.

The best way to get rid of that message is to add that share to the exclusion in all but the main container. One could also change the backup type but it does not prevent backing that share up multiple times!

 

I do not think I am fully understanding this. So I am getting the multiple containers warning. 
image.thumb.png.032be1640e346a543e100a8ca7974c3e.png

 

I am trying to understand the remedy for this. So basically this is saying one file is pointed multiple times and will be backed up multiple times? Since I have the /mnt/user/appdata added to the appdata sources.

 

image.png.bc0bda39f5d84e83d6df18cda80d0cea.png

 

I just exclude the file path in each container? 

image.png.f0e4ea909ed767a7d050863ac179a111.png

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing