1 hour ago, blaine07 said:

I'll turn off flash drive back up and run a backup again in bit and see if it doesn't result in server hanging. But yes, the other day when we mentioned potential flash drive back up issue I exported drive in GUI of Unraid out of abundance of caution. I noticed backup was ~550mb and it took a reasonable amount of time/didn't lock up exporting thumb drive in that fashion.
 

Edit for clarity: the server ONLY is crashing when backups run/running. Server goes days any other time without hiccups and until last week server uptime was in the months in general.

Downloaded a flash backup in mere minutes start to finish: 

Ive just released an update which includes a simple settings form debug mode.

 

• Open the AppdataBackup settings page
• Edit the URL by adding "?debugForm" to it. Hit enter
• Save the settings.
  • A new window will appear with the form data generated BEFORE sending it to the server
  • The page behind will post the received settings.

 

Either compare it yourself or send me both for evaluation.

 

I made a test with HUGE settings pages. But that worked for me. Also, if the data, sent to the server, is too big, the page stays blank.

 

Maybe we can get some info with the debugForm mode.

20 minutes ago, KluthR said:

Ive just released an update which includes a simple settings form debug mode.

 

• Open the AppdataBackup settings page
• Edit the URL by adding "?debugForm" to it. Hit enter
• Save the settings.
  • A new window will appear with the form data generated BEFORE sending it to the server
  • The page behind will post the received settings.

 

Either compare it yourself or send me both for evaluation.

 

I made a test with HUGE settings pages. But that worked for me. Also, if the data, sent to the server, is too big, the page stays blank.

 

Maybe we can get some info with the debugForm mode.

ONE: https://justpaste.it/dh2k5
TWO: https://justpaste.it/h97fm

Definitely a difference between the two.

Yea. Okay. We seem to hit a limit here. Let me think about possible solutions

6 minutes ago, KluthR said:

Yea. Okay. We seem to hit a limit here. Let me think about possible solutions

So I was only *part* crazy LOL 🙂

4 hours ago, blaine07 said:

So I was only *part* crazy LOL 🙂

Not that it matters at this point - but ran another backup this evening with thumb drive disabled - it resulted in server going offline and unresponsive and unable to be resuscitated without "pulling the plug" again.

Your previous screenshot shows the issue during backup: the oom-killer was kicking in. The ram was full resulting in killing docker (and system?) processes.

 

Thats another issue you have to look at. Something is eating the ram during docker container starts?

7 hours ago, KluthR said:

Your previous screenshot shows the issue during backup: the oom-killer was kicking in. The ram was full resulting in killing docker (and system?) processes.

 

Thats another issue you have to look at. Something is eating the ram during docker container starts?

I realize maybe that's outside scope of this particular container but how on earth could I begin to figure out what that might be caused by or how to troubleshoot?

This am's scheduled backup was randomly successful with having backup of the flash drive disabled: ffd5fa0a-19f4-4401-ab92-8c9dcd66424e

I would start htop, hit F6, to select by RAM, start backup and watch the ram being filled. The process with the most used ram is on top

Hello, I have been getting this error since I installed and run this app on my server:

 

“tar creation failed! Tar said: tar: /mnt/user/appdata/plex/Library/Application Support/Plex Media Server/Cache/PhotoTranscoder/23/: Cannot savedir: Structure needs cleaning; tar: Exiting with failure status due to previous errors”

 

I have tried deleting that folder at the source completely, verifying that it’s empty when it gets recreated, etc., but I can’t figure out why this error keeps coming up… Any ideas?

Structure needs cleaning. Filesystem check?  No idea.

Probably need a filesystem check/repair on the destination, yeah.

Edited November 22, 20241 yr by Kilrah

Hi there,

This might be documented somewhere and I missed it, if you try to run appdata backup when the docker service is not running you get weird results.

 

Unraid Version 6.12.13
Plugin Version: 2024.11.21

Logs:

[22.11.2024 13:58:03][ℹ️][Main] 👋 [Click and drag to move] WELCOME TO APPDATA.BACKUP!! :D
[22.11.2024 13:58:03][ℹ️][Main] Backing up from: /mnt/user/appdata, /mnt/disks/<diskname>/appdata
[22.11.2024 13:58:03][ℹ️][Main] Backing up to: /mnt/user/appdata_backup/ab_20241122_135803
[22.11.2024 13:58:03][⚠️][Main] There are no docker containers to back up!
[22.11.2024 13:58:03][ℹ️][Main] Backing up the flash drive.
[22.11.2024 13:59:04][ℹ️][Main] Flash backup created!
[22.11.2024 13:59:05][ℹ️][Main] Checking retention...
[22.11.2024 13:59:05][ℹ️ [Click and drag to move] ][Main] DONE! Thanks for using this plugin and have a safe day ;)
[22.11.2024 13:59:05][ℹ️][Main] ❤️ [Click and drag to move]

The plugin can't connect to the docker socket, and just skips backing up any containers, but it still creates the backup, and deletes your old backups. 😬

Thanks for maintaining such a critical plugin!

Edited November 22, 20241 yr by paperblankets
Better log formatting

7 hours ago, pchoi94 said:

Hello, I have been getting this error since I installed and run this app on my server:

 

“tar creation failed! Tar said: tar: /mnt/user/appdata/plex/Library/Application Support/Plex Media Server/Cache/PhotoTranscoder/23/: Cannot savedir: Structure needs cleaning; tar: Exiting with failure status due to previous errors”

 

I have tried deleting that folder at the source completely, verifying that it’s empty when it gets recreated, etc., but I can’t figure out why this error keeps coming up… Any ideas?

Well, I did some digging, and I got directed to the very first post in this thread (LOL) where there is a "hint" to exclude the cache folders for Plex [DERP!]:

 

"The plugin send me here to check for some Plex exclusions.

Yes, thats right. You dont need to save Plex cache (and some other) directories. But its up to you to exclude them or not. Currently you are advised to set the following exclusions for plex:

Each following paths need to be prefixed with your correct appdata path!

Library/Application Support/Plex Media Server/Cache

Library/Application Support/Plex Media Server/Media

Library/Application Support/Plex Media Server/Metadata"

 

Ran the backup again manually and wouldn't you know it, passed.

On 11/21/2024 at 8:35 PM, KluthR said:

Yea. Okay. We seem to hit a limit here. Let me think about possible solutions

Turns out its a default PHP-Limit of the setting max_input_vars. This is defaulted to 1000. and exactly after 1000 lines, the request gets cut off.

6 hours ago, KluthR said:

Turns out its a default PHP-Limit of the setting max_input_vars. This is defaulted to 1000. and exactly after 1000 lines, the request gets cut off.

I work on a solution which splits the data into chunks. I could also patch the PHP settings on-the-fly but that seems a bit hacky to me.

Could take a few more days

 

If you want a workaround for now:

 

• Open a shell and run this command:

• curl -s https://raw.githubusercontent.com/Commifreak/unraid-appdata.backup/refs/heads/master/scripts/hotfix_php_max_input_vars.sh | bash

This changes the php config.

 

Run it again to undo the fix. Or reboot (fix is not permanent!)

Hello,

 

How I must configured the Nextcloud AIO Settings on this Plugin to Backup this?

 

https://github.com/nextcloud/all-in-one

 

"

Event: Appdata Backup
Subject: [AppdataBackup] Error!
Description: Please check the backup log!
Importance: alert

'nextcloud_aio_mastercontainer' does NOT exist! Please check your mappings! Skipping it for now.
"

 

Correct the Docker Container Template have no Appdata Folder under Appdata but a Docker Volume.

 

 

Many Thanks!

 

Many Greetings

 

Revan335

Edited December 3, 20241 yr by Revan335

i get several dockers that say does not have any volume to back up, skipping, even though some of them i'd like to back up (such as binhex plex pass docker.  I'm guessing i'm doing something wrong with these? lol

 

 

 

I dont know if this debug sending it shows that particular issue above as well (since it did have an error with tdarr too but i don't care as much about that issue but here it is.

debug code - d5f24c46-33fa-4e5f-8ea8-ab179d284ece

Edited December 1, 20241 yr by SaberTreasures

Hi,

Can someone give some guidence how to restore VM? I have the backup from the plugin and the img disk file.

 

I tried the following:

1. create a generic linux VM
2. virsh edit the settings
3. paste the config

I get error that the VM already exists with the same uuid. Not sure what to do

 

 

EDIT:

I have resolved the issue by generating a new uuid on some website and replacing it in the config. It might not be the correct solution but it works just fine.

Prerequisites: the original qcow or img file of the VM in the original location restored.

 

1. create a new linux VM, leave everything on default, does not matter. You will need to define an image location but that is all. Dont start the new VM just create it.

2. Go to uuidgenerator.net and create a new uuid, replace it in the backup xml

3. SSH into your unraid (copy paste works funky in the web console) and

virsh edit new_VM_name

4. It will open the the config in vim editor. Replace all the config text with your config text (esc, ggVG, d, esc, i, right click to paste, esc, :wq)

5. Now if you refresh the VM page in unraid you will see your old VM and you can start is as usual, You will also see your temporary linux VM that you can remove. If you are confortable with virsh (provided you are reading this step-by-step you are not) you can create your own VM with the existing config from scratch.

Edited December 2, 20241 yr by daninet

On 11/21/2024 at 1:35 PM, KluthR said:

Yea. Okay. We seem to hit a limit here. Let me think about possible solutions

Any update on this? 

Hey there's I've encountered what someone told me was a known issue with the plugin. I have too many containers and it seems the PHP falls over and it starts to back up weird things (not necessarily everything just more than what was un-excluded).

I've noticed a tell tale sign between my servers is the one that is experiencing the bug has no persistence for anything the user enters below "Custom scripts".

Questions: Are there any workarounds? Can I help with a fix?

8 hours ago, blaine07 said:

Any update on this? 

Yes. Try the workaround script a few posts above

 

24 minutes ago, amateur_wizard said:

Are there any workarounds? Can I help with a fix?

Same. Try the script, save and try again

3 hours ago, KluthR said:

Yes. Try the workaround script a few posts above

 

Same. Try the script, save and try again

Well, that does seem to work as far as saving things past that certain point I couldn't make changes past. For now will probably just set it as a script to start when Unraid starts array; seems to work though. Server scheduled to backup regularly tonight; i'll be able to tell pretty quickly if it excludes the stuff it should this time. 

On 12/1/2024 at 12:53 AM, Revan335 said:

Event: Appdata Backup
Subject: [AppdataBackup] Error!
Description: Please check the backup log!
Importance: alert

'nextcloud_aio_mastercontainer' does NOT exist! Please check your mappings! Skipping it for now.

@KluthR or anybody an Idea for this Issue?

Yes. Named volumes are not supported at this time.