Lossy Off-Site Image Backup

[ridley33]

I have 2 Unraid servers running at two different locations, one as the main server and the other as the off-site backup.

There are roughly 7TB of images, 4TB of which are in raw. However for the off-site backup, raw is not necessary and compressing would save a ton of space.

 

Is there a way to tell the regular rsync backups to also reencode raws to jpegs and deal with the file name, size and creation date being different in subsequent backups?

Or is there a tool that can do this?

[bmartino1]

wireguard vpn setup both to be a server and client.
https://docs.unraid.net/unraid-os/manual/security/vpn/
https://unraid.net/blog/wireguard-on-unraid


unraid vpn: 
this way they can ping and talk to each other...

nfs conect to a share / mount the backup unraid as a folder on the main to copy/rsync files...
https://docs.oracle.com/cd/E19253-01/817-5093/fsmount-69423/index.html


userscript plugin
rsync copy between the two over wiregurad...

Example rsync script

#!/bin/bash

# Define the source and destination directories
SOURCE="/mnt/user/appdata/"
DESTINATION="/mnt/user/Program-Installers-PCRepair/Other_OS/Docker-Rsync-Backup/"

# Path to the exclude file
#Make tree form lxc updates:
cd /mnt/user/appdata/lxddata/
rm tree.txt
touch tree.txt
find . -type f > /mnt/user/appdata/lxddata/tree.txt

EXCLUDE_FILE="/mnt/user/appdata/lxddata/tree.txt"



# Create the destination directory if it doesn't exist
#mkdir -p "$DESTINATION"

# Run the rsync command with the exclude-from option
# Using -vv for more verbose output
time rsync -avrlptgo -vv --exclude-from="$EXCLUDE_FILE" "$SOURCE" "$DESTINATION"

Other option manual intervention..
enable ssh on the backup unraid.
install the filezilla docker. and use sftp to connect to and send the files...