9 minutes ago, LadyHaley said:

Yeah I have tried different file paths and creating them manually beforehand, I dont know what im doing wrong, none of my docker containers seem have trouble using the same directory

Are you running 7.0.0-beta.1 ?

5 hours ago, NeoJoris said:

Are you running 7.0.0-beta.1 ?

I have a 7 beta machine and a stable 6.12 machine experiencing this issue.

 

The per container setting and setting a specific order for the docker doesn't save.

This is the version 6 one also not for some reason it didn't grab the local AI image minor but also worth noting that there is something wrong here...

Hello all! I have a super weird issue. I just ran a backup for the first time and now over half of my docker containers will either not start or aren't accessible. Looks like a lot of permission errors. Any ideas? Diagnostics attached.

 

Plex logs for example: 

2024-07-15 18:01:42.114955 [info] Host is running unRAID
2024-07-15 18:01:42.126423 [info] System information Linux TUS 6.1.79-Unraid #1 SMP PREEMPT_DYNAMIC Fri Mar 29 13:34:03 PDT 2024 x86_64 GNU/Linux
2024-07-15 18:01:42.140122 [info] SHARED_NETWORK not defined (via -e SHARED_NETWORK), defaulting to 'no'
2024-07-15 18:01:42.152443 [info] PUID defined as '99'
2024-07-15 18:01:42.185448 [info] PGID defined as '100'
2024-07-15 18:01:42.227855 [info] UMASK defined as '000'
2024-07-15 18:01:42.239833 [info] Permissions already set for '/config'
2024-07-15 18:01:42.258848 [info] Deleting files in /tmp (non recursive)...
2024-07-15 18:01:42.275028 [info] TRANS_DIR defined as '/Transcode/'
2024-07-15 18:01:42.301535 [info] Starting Supervisor...
2024-07-15 18:01:42,494 INFO Included extra file "/etc/supervisor/conf.d/plexmediaserver.conf" during parsing
2024-07-15 18:01:42,494 INFO Set uid to user 0 succeeded
2024-07-15 18:01:42,497 INFO supervisord started with pid 7
2024-07-15 18:01:43,499 INFO spawned: 'plexmediaserver' with pid 62
2024-07-15 18:01:43,499 INFO reaped unknown pid 8 (exit status 0)
2024-07-15 18:01:43,671 DEBG 'plexmediaserver' stderr output:
PMS: failure detected. Read/write access is required for path: /config/Plex Media Server

2024-07-15 18:01:43,672 DEBG fd 8 closed, stopped monitoring <POutputDispatcher at 22427278507568 for <Subprocess at 22427267806800 with name plexmediaserver in state STARTING> (stdout)>
2024-07-15 18:01:43,672 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 22427284664448 for <Subprocess at 22427267806800 with name plexmediaserver in state STARTING> (stderr)>
2024-07-15 18:01:43,672 WARN exited: plexmediaserver (exit status 1; not expected)
2024-07-15 18:01:43,672 DEBG received SIGCHLD indicating a child quit
2024-07-15 18:01:44,674 INFO spawned: 'plexmediaserver' with pid 67
2024-07-15 18:01:44,687 DEBG 'plexmediaserver' stderr output:
PMS: failure detected. Read/write access is required for path: /config/Plex Media Server

tus-diagnostics-20240715-1748.zip

Edited July 15, 20241 yr by twolfekc

6 hours ago, twolfekc said:

Hello all! I have a super weird issue. I just ran a backup for the first time and now over half of my docker containers will either not start or aren't accessible. Looks like a lot of permission errors. Any ideas? Diagnostics attached.

 

Plex logs for example: 

2024-07-15 18:01:42.114955 [info] Host is running unRAID
2024-07-15 18:01:42.126423 [info] System information Linux TUS 6.1.79-Unraid #1 SMP PREEMPT_DYNAMIC Fri Mar 29 13:34:03 PDT 2024 x86_64 GNU/Linux
2024-07-15 18:01:42.140122 [info] SHARED_NETWORK not defined (via -e SHARED_NETWORK), defaulting to 'no'
2024-07-15 18:01:42.152443 [info] PUID defined as '99'
2024-07-15 18:01:42.185448 [info] PGID defined as '100'
2024-07-15 18:01:42.227855 [info] UMASK defined as '000'
2024-07-15 18:01:42.239833 [info] Permissions already set for '/config'
2024-07-15 18:01:42.258848 [info] Deleting files in /tmp (non recursive)...
2024-07-15 18:01:42.275028 [info] TRANS_DIR defined as '/Transcode/'
2024-07-15 18:01:42.301535 [info] Starting Supervisor...
2024-07-15 18:01:42,494 INFO Included extra file "/etc/supervisor/conf.d/plexmediaserver.conf" during parsing
2024-07-15 18:01:42,494 INFO Set uid to user 0 succeeded
2024-07-15 18:01:42,497 INFO supervisord started with pid 7
2024-07-15 18:01:43,499 INFO spawned: 'plexmediaserver' with pid 62
2024-07-15 18:01:43,499 INFO reaped unknown pid 8 (exit status 0)
2024-07-15 18:01:43,671 DEBG 'plexmediaserver' stderr output:
PMS: failure detected. Read/write access is required for path: /config/Plex Media Server

2024-07-15 18:01:43,672 DEBG fd 8 closed, stopped monitoring <POutputDispatcher at 22427278507568 for <Subprocess at 22427267806800 with name plexmediaserver in state STARTING> (stdout)>
2024-07-15 18:01:43,672 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 22427284664448 for <Subprocess at 22427267806800 with name plexmediaserver in state STARTING> (stderr)>
2024-07-15 18:01:43,672 WARN exited: plexmediaserver (exit status 1; not expected)
2024-07-15 18:01:43,672 DEBG received SIGCHLD indicating a child quit
2024-07-15 18:01:44,674 INFO spawned: 'plexmediaserver' with pid 67
2024-07-15 18:01:44,687 DEBG 'plexmediaserver' stderr output:
PMS: failure detected. Read/write access is required for path: /config/Plex Media Server

tus-diagnostics-20240715-1748.zip 329.43 kB · 0 downloads

 run the docker safe perms from the webu > tools 

 

this set 777 and nobody:users to all files and folders.

On 7/9/2024 at 7:26 AM, KluthR said:

@affected users

Could someone test this yet?

9 hours ago, bmartino1 said:

 run the docker safe perms from the webu > tools 

 

this set 777 and nobody:users to all files and folders.

That fixed it! Thanks so much.

10 hours ago, KluthR said:

Could someone test this yet?

Actually, looks like it fixed it for my plex docker but all others are still getting permissions errors. Is there something else I can run for the rest of my containers with issues?

1 hour ago, twolfekc said:

Actually, looks like it fixed it for my plex docker but all others are still getting permissions errors. Is there something else I can run for the rest of my containers with issues?

you may have chosen other data path that need similar permission set.
Default /mnt/user/appdata
If you chose a different path to the data, these permissions need to set to these folders...

So stop all dockers (there have been times when setting permission that this doesn't set due to it running...)
confirm path in each docker affected

Set Unraid Docker permissions:
chmod 777 -R /path/to/data
chown -R nobody:users /path/to/data

EX.

chmod 777 -R /mnt/user/appdata

chown -R nobody:users /mnt/user/appdata

Edited July 16, 20241 yr by bmartino1

23 hours ago, bmartino1 said:

I have a 7 beta machine and a stable 6.12 machine experiencing this issue.

 

The per container setting and setting a specific order for the docker doesn't save.

This is the version 6 one also not for some reason it didn't grab the local AI image minor but also worth noting that there is something wrong here...

Somehow the start order started saving. will continue to monitor it... 

I was able to fix my problem because the start stop order started keeping its stations.

so stop photoprism and mariadb dockers with pre run script to stop both dockers.

Next set order to have maraidb 2nd and photoprism 1st.

that way when it backups both dockers are stopped and when mariadb backups is done its started first. So I don't get this situations where photoprism is on without its database...

 

 

on the side to note as this plugin does this already.

If following the defaults. /mnt/user/appdata is the defualt locaiton for dockers


I also have a script I run monthly

#!/bin/bash

# Define the source and destination directories
SOURCE="/mnt/user/appdata/"
DESTINATION="/mnt/user/Docker-Rsync-Backup/"

# Path to the exclude file
#Make tree form lxc updates:
cd /mnt/user/appdata/lxddata/
rm tree.txt
touch tree.txt
find . -type f > /mnt/user/appdata/lxddata/tree.txt

EXCLUDE_FILE="/mnt/user/appdata/lxddata/tree.txt"



# Create the destination directory if it doesn't exist
#mkdir -p "$DESTINATION"

# Run the rsync command with the exclude-from option
# Using -vv for more verbose output
time rsync -avrlptgo -vv --exclude-from="$EXCLUDE_FILE" "$SOURCE" "$DESTINATION"

This is a rsync copy example to copy the location (in my case dockers) and to exclude a Directory
(In my case i chose to have my lxc plugin data in the same folder but don't want rsync copy to touch any files and folders.)
So I use the find command to get a path tree to exclude with rsync.
you can specify more then 1 source...

This can be run via the user script plugin as an alternative... There are many post on the forum for automating this, hence the birth of this plugin...

Okay kinda a weird problem I do have but I am stuck.

I used this plugin for the last years but have since ~6 Months the same bug, and could narrow it down.

The Backup is scheduled every Tuesday at 3:00 AM, and every Tuesday morning my server crashes and I have to kill the power to the server to reboot. I am running a weekly backup of my appdata and I am hard resetting the power connection to the server every week (that des hurt emotionally). The backups are always complete and fine.

I tested a manual backup which I monitored which went flawless, as always, the output showed me ("Done.") Something I noted, was that my RAM (32GB) was at 75-90 % when it is usually around 30 %, so I added a SWAP file via the SwapFile Plugin with around 20GB and went on my way, thinking that the problem was fixed.

Nope, the following weeks the Server was still unresponsive (NO Gui via HDMI, NO WebGUI, NO Response of my Docker Containers)

Today I tested it again manual backup, that finished well, all Containers started back up and I could use them for like 15min? and after that the RAM was againg idling at 75-90 % and suddenly the WebGUI was unresponsive and I couldn't reach any of the Docker Container.

If I do the reboot via a power plugout and start the server, everything is running fine for the rest of the week until next Tuesday morning...

So anyone does have an idea why that keeps happening?
I will attach logfiles maybe someone can help me.

Edit: My reboot process looks like the following:
Server is unresponsive -> Power plug reboot -> Then because the Docker Service will always fail to start after this kind of reboot (idk why) I do a manual reboot via the WebGUI and voila everything runs again - this is a workaround but not a nice one

tower-diagnostics-20240719-0119.zip

Edited July 18, 20241 yr by Maximilian-Tek

I guess thats something for an own thread. I dont see any relation to the plugin as it only stops/starts containers and packs data together.

Hello,

I use Appdata.backup to schedule my backups, especially the one of the USB flash drive.
All the backups go well except when I have to copy the backup from the flash drive to the destination.
It worked a while ago and I can't explain why it doesn't work anymore.
The archive is corrupted at the destination, which is a cloud share mounted using rClone.

 

Appdata.backup manages to copy a large 10Gb Plex archive to the destination.

Debug log ID : 5474e375-f5ee-43fd-95e5-56008173f599

 

 

[21.07.2024 02:00:01][ℹ️][Main] 👋 WELCOME TO APPDATA.BACKUP!! :D
[21.07.2024 02:00:01][ℹ️][Main] Backing up from: /mnt/user/appdata, /mnt/cache/appdata
[21.07.2024 02:00:01][ℹ️][Main] Backing up to: /mnt/disks/Backups_Plex/BackupPlex/ab_20240721_020001
[21.07.2024 02:00:02][ℹ️][Main] Selected containers: JDownloader2, Plex-Media-Server, binhex-hexchat, chromium, tautulli, transmission
[21.07.2024 02:00:02][ℹ️][Main] Saving container XML files...
[21.07.2024 02:00:02][ℹ️][Main] Method: Stop/Backup/Start
[21.07.2024 02:00:02][ℹ️][transmission] No stopping needed for transmission: Not started!
[21.07.2024 02:00:02][ℹ️][transmission] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:00:02][ℹ️][transmission] Calculated volumes to back up: /mnt/user/appdata/transmission
[21.07.2024 02:00:02][ℹ️][transmission] Backing up transmission...
[21.07.2024 02:00:02][ℹ️][transmission] Backup created without issues
[21.07.2024 02:00:02][ℹ️][transmission] Verifying backup...
[21.07.2024 02:00:02][ℹ️][transmission] Starting transmission is being ignored, because it was not started before (or should not be started).
[21.07.2024 02:00:02][ℹ️][tautulli] Stopping tautulli... done! (took 2 seconds)
[21.07.2024 02:00:04][ℹ️][tautulli] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:00:04][ℹ️][tautulli] Calculated volumes to back up: /mnt/user/appdata/tautulli
[21.07.2024 02:00:04][ℹ️][tautulli] Backing up tautulli...
[21.07.2024 02:00:10][ℹ️][tautulli] Backup created without issues
[21.07.2024 02:00:10][ℹ️][tautulli] Verifying backup...
[21.07.2024 02:00:12][ℹ️][tautulli] Starting tautulli... (try #1) done!
[21.07.2024 02:00:17][ℹ️][Plex-Media-Server] Stopping Plex-Media-Server... done! (took 9 seconds)
[21.07.2024 02:00:26][ℹ️][Plex-Media-Server] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:00:26][ℹ️][Plex-Media-Server] Calculated volumes to back up: /mnt/user/appdata/Plex-Media-Server
[21.07.2024 02:00:26][ℹ️][Plex-Media-Server] Backing up Plex-Media-Server...
[21.07.2024 02:07:56][ℹ️][Plex-Media-Server] Backup created without issues
[21.07.2024 02:07:56][ℹ️][Plex-Media-Server] Verifying backup...
[21.07.2024 02:10:57][ℹ️][Plex-Media-Server] Starting Plex-Media-Server... (try #1) done!
[21.07.2024 02:11:01][ℹ️][binhex-hexchat] No stopping needed for binhex-hexchat: Not started!
[21.07.2024 02:11:01][ℹ️][binhex-hexchat] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:11:01][ℹ️][binhex-hexchat] Calculated volumes to back up: /mnt/user/appdata/binhex-hexchat
[21.07.2024 02:11:01][ℹ️][binhex-hexchat] Backing up binhex-hexchat...
[21.07.2024 02:11:13][ℹ️][binhex-hexchat] Backup created without issues
[21.07.2024 02:11:13][ℹ️][binhex-hexchat] Verifying backup...
[21.07.2024 02:11:29][ℹ️][binhex-hexchat] Starting binhex-hexchat is being ignored, because it was not started before (or should not be started).
[21.07.2024 02:11:29][ℹ️][chromium] No stopping needed for chromium: Not started!
[21.07.2024 02:11:29][ℹ️][chromium] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:11:29][ℹ️][chromium] Calculated volumes to back up: /mnt/user/appdata/chromium
[21.07.2024 02:11:29][ℹ️][chromium] Backing up chromium...
[21.07.2024 02:11:31][ℹ️][chromium] Backup created without issues
[21.07.2024 02:11:31][ℹ️][chromium] Verifying backup...
[21.07.2024 02:11:33][ℹ️][chromium] Starting chromium is being ignored, because it was not started before (or should not be started).
[21.07.2024 02:11:33][ℹ️][JDownloader2] Stopping JDownloader2... done! (took 2 seconds)
[21.07.2024 02:11:35][ℹ️][JDownloader2] Should NOT backup external volumes, sanitizing them...
[21.07.2024 02:11:35][ℹ️][JDownloader2] Calculated volumes to back up: /mnt/user/appdata/JDownloader2
[21.07.2024 02:11:35][ℹ️][JDownloader2] Backing up JDownloader2...
[21.07.2024 02:11:41][ℹ️][JDownloader2] Backup created without issues
[21.07.2024 02:11:41][ℹ️][JDownloader2] Verifying backup...
[21.07.2024 02:11:45][ℹ️][JDownloader2] Starting JDownloader2... (try #1) done!
[21.07.2024 02:11:49][ℹ️][Main] Backing up the flash drive.
[21.07.2024 02:13:11][❌][Main] Copying flash backup to destination failed!
[21.07.2024 02:13:14][ℹ️][Main] VM meta backup enabled! Backing up...
[21.07.2024 02:13:14][❌][Main] Error while backing up VM XMLs. Please see debug log!
[21.07.2024 02:13:16][ℹ️][Main] Checking retention...
[21.07.2024 02:13:16][ℹ️][Main] Delete old backup: /mnt/disks/Backups_Plex/BackupPlex/ab_20240602_020001
[21.07.2024 02:13:23][ℹ️][Main] DONE! Thanks for using this plugin and have a safe day ;)
[21.07.2024 02:13:23][ℹ️][Main] ❤️

 

appdatabackuperror.zip

Edited July 22, 20241 yr by JUST-Plex
debug log attached

Share debug log.

 

the copy of flash backup is a simple „cp“ command, so Im unable to tell whats wrong. 

Is there a way in bash to know if the script is running? I have another script that needs to check if a container is stopped because there's a backup in process or else.

18 hours ago, KluthR said:

Share debug log.

 

the copy of flash backup is a simple „cp“ command, so Im unable to tell whats wrong. 

 

Thanks for your answer

Where does the original archive come from? 
Does appdatabackup generate the “xxx-flash-backup-xxx.tar” file and then copy it, or does it take it from somewhere?

 

I attached the debug log in my previous post

That's a nice plugin.

It would be nice if it was possible to specify the task schedule and backup destination paths separately in the advanced options of a specific container.

 

There are some containers that I don't want to backup too often. There are containers that have external volumes that exist in the array, but I don't want the data and backups may be on the same drive.

As others have said, thanks for your hard work on this plugin.

 

I've recently upgraded Unraid to 6.12.10 and updated your plugin.

The Status/Log indicates that the backups are all successful, but my [binhex-plex] container seems to get wiped out every time the backup runs.

 

[23.07.2024 03:47:26][ℹ️][binhex-plex] Starting binhex-plex... (try #3) Container did not started! - Code: No such container

 

I don't know if it's my docker config or backup.

 

Any help would be greatly appreciated.

 

Thanks again.

A new update includes enhancements for better debugging. Stay tuned

Great. I'll stay tuned.

 

Thanks

Hi, I have a use case that maybe will be nice as a feature. What If i want a docker to be saved in a separate folder ? my use case is i can't really filter an specific docker to backup to the cloud (plex)

3 hours ago, gacpac said:

What If i want a docker to be saved in a separate folder ?

Why? What are the advantages?

9 hours ago, KluthR said:

Why? What are the advantages?

I'm guessing they want the backup for some containers sent to a different folder so that the backup can be archived elsewhere.

 

I can also see a use case based on importance of the specific container. Critical backups sent to redundant local fast storage, "nice to have" backups sent to cheap low priority bulk non-redundant destinations.

 

Both desires can be handled manually with scripting, but it would be easier if the backup destination could be made more granular.

 

Backups for your backups.

Hey folks- noob question here. I'm getting "file changed as we read it" during tar creation of my biggest container (plex), this causes the backups to fail.

 

756a63af-5946-4530-ace2-10ce80320122 is my secure log.

 

Do you know how to overcome this error? 

Hiya 

 

My PlexTraktSync docker is detected by Autobackup plugin as Plex and i misguiding info in settings due to it:

PlexTraktSync: ghcr.io/taxel/plextraktsync:latest

 

 

Is there a way to make it not see it as Plex?