Jump to content

walle

Members
  • Content Count

    18
  • Joined

  • Last visited

Community Reputation

0 Neutral

About walle

  • Rank
    Member

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

  1. I have a Docker image that needs the hostname paramter. For example: docker run --name backup-container --hostname backup-instance How do I set this parameter in a container template?
  2. Sorry about the late reply. I didn't have time to get back to you. You can read about the cache folder here: https://forum.duplicacy.com/t/cache-usage-details/1079 It uploads during backup, it only uploads chunks of the files. https://forum.duplicacy.com/t/chunk-size-details/1082 What I do is I backup locally on the server, then using the copy command to offsite storage. It's much more efficient than run same backup for each offsite backup storage and upload it each time. I think don't need to do that. Sense my last post, Duplicacy have announced beta testing of there new Web UI client (https://forum.duplicacy.com/t/duplicacy-web-edition-0-2-10-beta-is-now-available/1606). There are Docker images right now that looks promising (eg. https://hub.docker.com/r/saspus/duplicacy-web). I think the Web UI approach makes more sens for Unraid rather than using the CLI version. But it needs to become more stable before I dear to use it for my real backups. There are Docker images with Web UI that are progressing nicely. From what I can tell looking at some of the Docker images, all that needs to be done to work with Unraid is to create a Docker template (takes minutes to do) and test it. One potential downside with Web UI is it will probably require a license to use. But looking at what the current GUI client costs ($20 first year and $5 for year 2 and forward, https://duplicacy.com/buy.html) and assume it will have the same price, it will probably be worth it.
  3. Source: https://github.com/gilbertchen/duplicacy#license Just download the binary and you are good to go. My post about my installation doesn't include how to work with Duplicacy, but there are guides like this one that gives an idea how to work with it.
  4. Please note that this is not a guide, this is just a short(-ish) explanation of how I currently using Duplicacy. I assume you are familiar with how Duplicacy works and somewhat comfortable to work with a terminal. I'm aware of this could be done much simpler, with eg. doing a Docker container and therefore make it more accessible to others to use. But in my case, I needed a quick and dirty setup just to start to do backups again. I maybe will do a Docker container out of this some day. In my case, I have created /boot/custom/bin/ folder where I save additional binaries like Duplicacy wget -O /boot/custom/bin/duplicacy https://github.com/gilbertchen/duplicacy/releases/download/v2.1.0/duplicacy_linux_x64_2.1.0 What I add to my /boot/config/go file ## Copy Duplicacy binary cp -f /boot/custom/bin/duplicacy /usr/local/bin/duplicacy chmod 0755 /usr/local/bin/duplicacy ## Duplicacy backup cp -rf /boot/custom/duplicacy /usr/local chmod 0755 /usr/local/duplicacy/ /boot/custom/duplicacy is the folder I use to save backup preferences for each main folder I backup. I copy this folder to RAM in order to minimize wear on the flash drive. Duplicacy is using this preferences folder to temporary write cache files. Folders I backup (plus private shares): /boot /mnt/user/appdata /mnt/user/system/libvirt To add a folder to backup, I cd to that folder (eg. `cd /boot`) and run duplicacy init command: duplicacy init -pref-dir /boot/custom/duplicacy/boot my-snapshot-id /mnt/user/backup/duplicacy To brake the command down a bit: /boot/custom/duplicacy/boot - Path to preference folder. I have a separate folder for each main backup folder. /mnt/user/backup/duplicacy - My local backup share. Can be replaced with a remote storage (read Duplicacy documentation). If you want to add remote storage, add filters and do adjustments in preferences folder, do so before editing the .duplicacy file (eg. /boot/.duplicacy) and point it to the ram location. Example: From: /boot/custom/duplicacy/boot To: /usr/local/duplicacy/boot Do the same for rest of the backup folder, after that either run commands in the go-file or restart the server. Test to backup by running the backup command (eg. cd /boot; duplicacy backup -threads 1) and copy command for remote storage. I use User scripts plugin to run the backup and copy commands nightly. If I need to add additional remote storage or do other changes that I by mistake was saved to RAM instead of the flash memory, I run this command to sync back the changes to flash: rsync -avh --exclude=logs/ --exclude=cache/ --exclude=.git/ /usr/local/duplicacy/ /boot/custom/duplicacy/ How do this differently Instead of adding main folders to backup with the init command, it should be possible to just run it once at / and use filters to include and exclude folders/files to backup. The reason I don't tested or want this setup is because I need to have the flexibility to have separate snapshot IDs for each folder in order to control what remote backup locations show have backup of what. For example I may want to send the /boot backup to Amazon s3 and to a friends server, but I don't want to send my family videos to s3 because it will be too expensive. Any questions @xhaloz?
  5. You mean how I do my unraid backups with Duplicacy? Sure, soon as I get home I can write how I did it. Not a guide per se, but at least the big picture of the solution I settled for.
  6. My disk also got stuck at "unRAID's signature on the MBR is valid", but all I needed to do was to stop pre-clear and resume the operation again. See my post above, if you got stuck on "Starting", try to restart the server then try again.
  7. I found the problem with the plugin (sort of)! For some reason a old tmux pre-clear session got stuck: $ ps uax | grep tmux root 1695 0.0 0.0 28968 7364 ? Ss Aug31 1:07 /usr/bin/tmux new-session -d -x 140 -y 200 -s preclear_disk_WD-WCC7K6SFD5TJ root 10801 0.0 0.0 9812 2136 pts/1 S+ 02:28 0:00 grep tmux After I killed the process (`kill 1695`), it seams that it works as expected (it has passed "Started..." and currently running pre-read) An other way to solve it would be to restart the server. Thank you for your help!
  8. Ahh, didn't read that. Thank you! But how can I install previews version of the plugin it self (not the scripts)? Older updates worked for my other drives I pre-cleared. Yeah, I know. But I don't really like screen, I prefer tmux wish is much better in my opinion. Now I haven't debug this much, but currently I getting this error: $ ./preclear_disk.sh -t /dev/sdj ./preclear_disk.sh: line 1307: strings: command not found sfdisk: invalid option -- 'R' Try 'sfdisk --help' for more information. Sorry: Device /dev/sdj is busy.: 1 I the script I downloaded was this (version 1.15): https://forums.unraid.net/applications/core/interface/file/attachment.php?id=11467 And I got this link from bottom on first post: Line 1307 is this (plus above comment): #---------------------------------------------------------------------------------- # First, do some basic tests to ensure the disk is not part of the arrray # and not mounted, and not in use in any way. #---------------------------------------------------------------------------------- devices=`/root/mdcmd status | strings | grep rdevName | sed 's/\([^=]*\)=\([^=]\)/\/dev\/\2/'` For some reason there is no strings command in my installation of unraid, so I guess I need to install additonal packages somewhere else?
  9. Does anyone know what the issue can be? Shall I test and install an older version of the plugin and see if that helps? If so, how do I do that? Here is my diagnostics data. It seams that doesn't on my system. Did I miss something? $ ls -l /boot/config/plugins/preclear.disk/ total 1960 -rwxrwxrwx 1 root root 263640 Sep 4 07:48 libevent-2.1.8-x86_64-1.txz -rwxrwxrwx 1 root root 1289920 Sep 4 07:48 ncurses-6.1_20180324-x86_64-1.txz -rwxrwxrwx 1 root root 63 Sep 4 07:48 preclear.disk-2018.08.27.md5 -rwxrwxrwx 1 root root 163992 Sep 4 07:48 preclear.disk-2018.08.27.txz -rwxrwxrwx 1 root root 244556 Sep 4 07:48 tmux-2.6-x86_64-1.txz -rwxrwxrwx 1 root root 15624 Sep 4 07:48 utempter-1.1.6-x86_64-2.txz
  10. I have an issue with preclear my WD Red 3TB hdd. When I ran this plugin with my other HDDs that worked excellent, but for some reason this drive is stuck on "Starting...". I have tried to restart it and leave it for a few hours, but it's still stuck on "Starting...". I have attached my preclear log. WALLESERVER-preclear.disk-20180904-1934.zip
  11. Ahh, didn't see that. Maybe I needed to do a bit more research before I uninstall a plugin next time. This plugin will be a nice combo with Duplicacy to save copies on my remote servers. Thank you for your help!
  12. Thank you for the reply! Makes sens, then I just will look for if the folder exists and I would be able to do my remote backups. First of all, I like many of your plugins and many of them are fantastic (I probably wouldn't go with Unraid without them). But what I don't like with your backup plugin is the docker containers must be stopped for the backup. This wouldn't work in my case because I have sftp containers to allow remote servers to save backups on my server. What is the reason for this? If it's about concurrent access, Duplicacy has lock-free concurrent access. I can backup a running MySql server without duping to SQL-file. From the restore tests I have done, this has worked flawlessly.
  13. Sorry, forgot this thread. I agree with you that a long random password that's manually entered to start the array, is probably the most secure option we currently have. But I want this to be automatic and in this case a file on a remote server have the benefit of I can revoke access and also have the possibility of log the IP that's trying to authenticate from. But I agree with you that a somewhat competent digital forensics investigator that's gets the hands on a running array, it isn't much of a challenge to offload the data from the server. I'm just trying to protect my data from the average (stupid) burglar.
  14. Ohh, that's was easy. Thank you! When does /boot/config/go triggers? What comes before /boot/config/go? Another thing, is it possible to check if the array is running? If I want to backup the flash drive and store the backup in a share (to save as a local backup), I assume the array needs to be running? Then what happens if I try to save the backup to /mnt/users/my-backup-share/local/flash? I would preferably abort the local backup if I can't/shouldn't save it to the share.
  15. I have recently installed Unraid for the first time on my main server to replace Ubuntu. On that server I used Duplicacy to backup my data and I plan to do so on this server in order do have the same setup for all my Linux servers. The issue I have is I'm not sure how I can install Duplicacy "the right way" with Unraid. The way I do it on my other Linux machines is to run this command. sudo wget -O /usr/local/bin/duplicacy https://github.com/gilbertchen/duplicacy/releases/download/v2.1.0/duplicacy_linux_x64_2.1.0; sudo chmod 0755 /usr/local/bin/duplicacy But I have a feeling that this command will only save the binary to RAM and I will need to do this again after next reboot. Is it a way to add a binary to the flash drive and make sure that it's in /usr/local/bin/ on boot? Before someone asks, I have searched in Docker hub and seams that most of them either have an old version Duplicacy or missing key features like define more than one backup path and remote location.