6 minutes ago, KluthR said:

Im wondering as well

 

no, no encryption planned. You could use post-run scripts to build something own

Okay, do you have an examples for that, which tool can i use?

A simple 7zip archive with password would be sufficient i think.

 

Edited November 18, 20241 yr by Darkestnoir

there are some crypt-command examples for encrypt tar.gz archives.

 

I never did it on my end

1 hour ago, KluthR said:

there are some crypt-command examples for encrypt tar.gz archives.

 

I never did it on my end

ChatGPT wrote me a example:

#!/bin/bash

# Check if the required arguments are provided
if [ $# -ne 3 ]; then
    echo "Usage: $0 /path/to/input.tar.zst /path/to/output.enc password"
    exit 1
fi

# Input file, destination file, and password
INPUT_FILE="$1"
OUTPUT_FILE="$2"
PASSWORD="$3"

# Ensure the input file exists
if [ ! -f "$INPUT_FILE" ]; then
    echo "Error: Input file '$INPUT_FILE' does not exist."
    exit 1
fi

# Encrypt the file using OpenSSL
echo "Encrypting '$INPUT_FILE' into '$OUTPUT_FILE'..."
openssl enc -aes-256-cbc -salt -in "$INPUT_FILE" -out "$OUTPUT_FILE" -pass pass:"$PASSWORD"

# Check if encryption succeeded
if [ $? -eq 0 ]; then
    echo "Encryption successful. Encrypted file: '$OUTPUT_FILE'"
    echo "Deleting original file '$INPUT_FILE'..."
    rm -f "$INPUT_FILE"

    if [ $? -eq 0 ]; then
        echo "Original file deleted successfully."
    else
        echo "Error: Failed to delete the original file."
        exit 1
    fi
else
    echo "Error: Encryption failed."
    exit 1
fi

 

But not sure if i have to set the script as "Post-container-backup script" or "Post-backup script" and how i can use the correct input and output path.

 

Unfortunately, i am not very good at this 😅

Edited November 18, 20241 yr by Darkestnoir

Lately towards the end of my scheduled backup running my server has been crashing. Not exactly sure why as rebooting is clearing logs. Anyone been seeing anything else odd lately?

12 hours ago, blaine07 said:

Lately towards the end of my scheduled backup running my server has been crashing. Not exactly sure why as rebooting is clearing logs. Anyone been seeing anything else odd lately?

This started a week or so ago. Only way I have found to recover is to remotely restart entire server. 

 

Does anyone have advice on what logs or how I can grab logs to maybe aid in figuring out what's going wrong? Is there maybe something I could do via command line or something? Yeah, it goes down my list of apps to backup and gets 5-8 from end and bam, goes ghost.

 

EDIT: also when I change containers to NOT backup and hit save at bottom it is NOT saving the option when I go back into the plugin settings. Could that be related to issues? Why would plugin not save the options?

Edited November 19, 20241 yr by blaine07

2 hours ago, blaine07 said:

This started a week or so ago. Only way I have found to recover is to remotely restart entire server. 

 

Does anyone have advice on what logs or how I can grab logs to maybe aid in figuring out what's going wrong? Is there maybe something I could do via command line or something? Yeah, it goes down my list of apps to backup and gets 5-8 from end and bam, goes ghost.

 

Also noticed my config.json doesn't have any containers listed after" PuTTY" and coincidentally when I try to change anything, as in skip the container yes or no, for containers BELOW PuTTY in the list is what making setting changes to doesn't save.



Around time it quit working it changed the user that is creating the back up folders, too?



EDIT again: is there a limit on number of lines that can be contained in this config.json file? I do admittedly have a ton of containers. I dunno, so weird that creator of folder recently changed and config file only goes to "PuTTY" and no containers below the "P" are listed in the config.json.

Edited November 19, 20241 yr by blaine07

4 hours ago, blaine07 said:

Could that be related to issues?

Hm. Maybe. Double check your flash drive. Did you another normal reboot, just for fun?

 

what are the file permissions on /boot/config/plugins/appdata.backup/config.json?

 

sounds like it cant write the file. But it can read it. Open the global log terminal and see if anything gets logged when trying to save.

12 hours ago, KluthR said:

Hm. Maybe. Double check your flash drive. Did you another normal reboot, just for fun?

 

what are the file permissions on /boot/config/plugins/appdata.backup/config.json?

 

sounds like it cant write the file. But it can read it. Open the global log terminal and see if anything gets logged when trying to save.

Everytime I try to run a backup and it locks up I am having to manually reboot server; it's been rebooted many times.

 

Permissions attached.

 

What other ideas might you? Not sure why backup folder suddenly creating as a different user, either? On global log I glanced but didn't see anything telling.

 

 

EDIT: config.json has this many lines; if it matters:

Edited November 19, 20241 yr by blaine07

Hi!

 

Background is that I recently lost my appdata folder, and then realized that I have no back up for it.

(did have the templated backed up so that's something... thanks!)

 

I noticed that I can use this plugin to also backup external volumes, which usually are the actual app data folders.

 

Before I turn it on for everything, I want to ask if there's any downside to enabling it for all, except maybe it will drastically increase the backup time and size.

 

Thanks!

2 minutes ago, StylishQuoter said:

except maybe it will drastically increase the backup time and size.

This can be one of the big ones. Some dockers (plex for example) can have thousands of files and make your backup take hours. Some people don’t want to have their dockers stopped for that long. You may want to do a little initial testing to decide what customizations to use.

5 minutes ago, wgstarks said:

This can be one of the big ones. Some dockers (plex for example) can have thousands of files and make your backup take hours. Some people don’t want to have their dockers stopped for that long. You may want to do a little initial testing to decide what customizations to use.

Got it. Thanks!

 

Currently I'm running a user script to `rc.docker stop` and 7z the whole folder, on a lower frequency.

 

Seems like I can use this plugin to backup all the smaller containers, and then run user script to do the larger ones less frequently.

 

When using the plugin to restore, does it automatically put back the backed-up external volumes (aka appdata folders)? Or is it that user is expected to just copy it back? 

Edited November 19, 20241 yr by StylishQuoter

6 hours ago, blaine07 said:

Everytime I try to run a backup and it locks up I am having to manually reboot server; it's been rebooted many times.

 

Permissions attached.

 

What other ideas might you? Not sure why backup folder suddenly creating as a different user, either? On global log I glanced but didn't see anything telling.

 

 

EDIT: config.json has this many lines; if it matters:

If I delete a container above "PuTTY" in the list it DOES add for example "Quickshare" container to config.json below "PuTTY" and save file successfully. 

 

We've reached some sort of container or code line limit in the config.json; has to be somehow.

6 minutes ago, StylishQuoter said:

Got it. Thanks!

 

Currently I'm running a user script to `rc.docker stop` and 7z the whole folder, on a lower frequency.

 

Seems like I can use this plugin to backup all the smaller containers, and then run user script to do the larger ones less frequently.

 

When using the plugin to restore, does it automatically put back the backed-up external volumes (aka appdata folders)? Or is it that user is expected to just copy it back? 

It has a restore function.

58 minutes ago, blaine07 said:

We've reached some sort of container or code line limit in the config.json

Not in the json. This can be huge without issues.

 

maybe a limit for the web form? How many containers do you have?

34 minutes ago, KluthR said:

Not in the json. This can be huge without issues.

 

maybe a limit for the web form? How many containers do you have?

Is there a easy way to get a number?

 

 

 

 

 

 

this needs some more time on my side. It seems that information getting cut off during form submission.

I made some tests with many dummy containers a few weeks ago but couldnt find any issue. Have to try again.

7 minutes ago, KluthR said:

this needs some more time on my side. It seems that information getting cut off during form submission.

I made some tests with many dummy containers a few weeks ago but couldnt find any issue. Have to try again.

Is it likely whatever it's cutting off is what's keeping backup from completing correctly and crashing the unraid server itself, too?

 

EDIT: I also find it odd it's been fine until recently. Up until earlier this week all containers were backing up correctly and not crashing server.

Edited November 19, 20241 yr by blaine07

6 minutes ago, blaine07 said:

Is it likely whatever it's cutting off is what's keeping backup from completing correctly and crashing the unraid server itself, too?

 

No. These issues does not belong to each other.

 

how long does it take to make the server crash? Could you observe logs during backup until it happens?

2 hours ago, KluthR said:

No. These issues does not belong to each other.

 

how long does it take to make the server crash? Could you observe logs during backup until it happens?

Just a few ago changed backup locations seeing if maybe that would correlate to anything. I DID watch backup as long as I could. THIS TIME it made it to "Backing up the flash drive" HOWEVER earlier it only made it to the "V"s. No idea on exact time but over a hour - hour and twenty or thirty minutes. 

I dont see any other indication that their is anything wrong with thumb drive...I can edit the plugin settings and it successfully saves/writes to the thumb drive... I don't think issue is the thumb drive since I expect that's where you're going to want to head with this?

Not sure it matters, but yesterday I exported copy of thumb drive off server; I thought it was odd it was ~570MB...?

Also, today, I uninstalled backup plugin, rebooted server, re-installed and reconfigured plugin - it didn't make any difference or change anything.

 

Edited November 19, 20241 yr by blaine07

I think I'm running into the same issue as you@blaine07where the settings page doesn't seem to save the full input to the config file, leading to backups hanging the system. I also have a similarly large number of docker containers and notice my config file is cut off before the end of the list (not including any lines for the scripts etc that appear at the end of the file). As a workaround, I have found that I can edit the config file directly and then the plugin runs manually or via cron without hanging (presumably because it doesn't know what to do once it gets to missing stage(s) of the backup config). Before this, I tried using earlier versions of the plugin (that I hadn't had issues with before) but they didn't work either, which leads me to believe this is most likely an issue with how much data the settings page can pass to the config file via the browser as @KluthRsuggests...

Edited November 21, 20241 yr by rob_cal
punctuation

I was finally able to successfully get a backup to complete last night; Debug ID: 224a8953-127f-4f2c-b9d3-2086d3b969f5

I oddly noticed the hangup in mine seemed to be:

 

Zipline was last container to back up but the flash drive took OVER 2 hours to back up? That's never been the case before... Yeah, I definitely dont think all the the config.json is being respected; in my case past the ~1500 lines or whatever - whether it's receiving it all back to save I have no idea of lol

 

Oh, found another issue; so server will have to be restarted; not sure why docker service would've ever stopped?:



Only thing in Unraid log I see maybe helpful:

Edited November 21, 20241 yr by blaine07

3 minutes ago, blaine07 said:

the flash drive took OVER 2 hours to back up?

That abnornal. Please try to create a backup via unraid

Just now, KluthR said:

That abnornal. Please try to create a backup via unraid

I did the other day create one on it's own as some posts above I mention that I thought maybe it was hanging on thumb drive - exporting thumb drive through unraid only took a few minutes; nothing outside the scope of ordinary. Rebooting server at moment; when it comes back up I can time it if necessary.

The backup simply calls unraids method for creating flash backup. That weird.

4 minutes ago, KluthR said:

The backup simply calls unraids method for creating flash backup. That weird.

I'll turn off flash drive back up and run a backup again in bit and see if it doesn't result in server hanging. But yes, the other day when we mentioned potential flash drive back up issue I exported drive in GUI of Unraid out of abundance of caution. I noticed backup was ~550mb and it took a reasonable amount of time/didn't lock up exporting thumb drive in that fashion.
 

Edit for clarity: the server ONLY is crashing when backups run/running. Server goes days any other time without hiccups and until last week server uptime was in the months in general.

Edited November 21, 20241 yr by blaine07