acosmichippo Posted August 15, 2020 Share Posted August 15, 2020 (edited) hey all, does anyone have experience backing up to B2 on a gigabit connection? Seems like it maxes out around 50Mb/s (bit, not byte, to be clear). also tested with cloudberry and backblaze’s speedtest, which seem similar. i’ve seen recommendations to increase the number of threads in the backup software - is that possible with duplicati? Edited August 15, 2020 by acosmichippo Quote Link to comment
DivideBy0 Posted August 16, 2020 Share Posted August 16, 2020 I get "duplicati Access to the path "/mnt/user" is denied." when I am trying to restore What am I missing on permissions? Quote Link to comment
JonathanM Posted August 16, 2020 Share Posted August 16, 2020 12 hours ago, johnwhicker said: I get "duplicati Access to the path "/mnt/user" is denied." when I am trying to restore How is duplicati getting access to /mnt/user? Normally that wouldn't be mapped. Quote Link to comment
DivideBy0 Posted August 16, 2020 Share Posted August 16, 2020 13 minutes ago, jonathanm said: How is duplicati getting access to /mnt/user? Normally that wouldn't be mapped. Thanks partner. No it wasn't mapped. I had to play with the path for source in settings and that fix it. I switched to /mnt/ and it works now. I never understand the file permission stuff. Does the "privileged" switch gives access to everything? How does it work? Quote Link to comment
a12vman Posted September 1, 2020 Share Posted September 1, 2020 (edited) I decided to give Duplicati a try as my backup solution. I have been using UnRaid for the last 10 years but I stepped up my game in the last year by setting up several dockers along with a few VM's on my Quad Xeon with 64GB Ram. I installed the Docker and scheduled a 220GB backup from Unraid to a remote SMB Share(Synology Box) for 3am. When I woke up this morning it looks as if the backup was complete(~220GB of duplicati files in my Synology Share). I attampted to access the Duplicati WebUI but it won't come up - stuck on loading. I stopped and re-started the Docker - same result. I stopped the array and re-booted the server - same result I can't access the WebUI. No errors in the Docker Log and no errors in Syslog. Where do I go next? Edited September 1, 2020 by a12vman Quote Link to comment
bigbangus Posted September 10, 2020 Share Posted September 10, 2020 I get a warning from within duplicati GUI when I configure a backup to run-script-after. After clicking on the warning the log reports success and no details on what went wrong. The script itself works, but I suppose it never reaches "exit 0"? Any help is appreciated. MESSAGE="$DUPLICATI__OPERATIONNAME $DUPLICATI__PARSED_RESULT" TITLE="$DUPLICATI__backup_name" APP_TOKEN="hidden" USER_TOKEN="hidden" curl 'https://api.pushover.net/1/messages.json' -X POST -d "token=$APP_TOKEN&user=$USER_TOKEN&message=\"$MESSAGE\"&title=\"$TITLE\"" exit 0 Quote Link to comment
bigbangus Posted September 14, 2020 Share Posted September 14, 2020 (edited) OK nevermind got it working without any warnings or errors using the pushover api example code for unix. In case anyone wants to get notifications when backups occur here is my script set to "run-script-after" in advanced options of the backup. Just add your token and user. TITLE="Duplicati ($DUPLICATI__backup_name)" MESSAGE="$DUPLICATI__OPERATIONNAME $DUPLICATI__PARSED_RESULT" curl -s \ --form-string "token=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx" \ --form-string "user=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx" \ --form-string "message=$MESSAGE" \ --form-string "title=$TITLE" \ https://api.pushover.net/1/messages.json exit 0 Edited September 14, 2020 by bigbangus spelling Quote Link to comment
bobo89 Posted September 29, 2020 Share Posted September 29, 2020 A public service announcement regarding duplicati. Duplicati is still in beta ( which this container runs) I recently lost my cache drive which means the I lost all my docker containers and duplicati config. No sweat, I had a backup of the config. After restoring the config, I tried to restore a backup of the ~20GB file containing my docker backups. Since the database of files was lost with the duplicati docker, duplicati has to rebuild the database. Whatever code performs this task is broken. A 40GB restore from a 600GB backup, is tracking on taking about 20 days.I bring down all the files from the cloud, and looks like the restore will take about 9 days, even when running from local disk. This seems to be a well known problem with this software. Google duplicati recreating database for similar stories. If you are relying on duplicati for your primary backup, I recommend you google the above msg, and test your back. (delete your docker container / duplicati config, and try a restore as if you had a catastrophic failuer) Sent from my SM-N960W using Tapatalk Quote Link to comment
xxxliqu1dxxx Posted October 1, 2020 Share Posted October 1, 2020 On 9/29/2020 at 7:17 PM, bobo89 said: A public service announcement regarding duplicati. Duplicati is still in beta ( which this container runs) I recently lost my cache drive which means the I lost all my docker containers and duplicati config. No sweat, I had a backup of the config. After restoring the config, I tried to restore a backup of the ~20GB file containing my docker backups. Since the database of files was lost with the duplicati docker, duplicati has to rebuild the database. Whatever code performs this task is broken. A 40GB restore from a 600GB backup, is tracking on taking about 20 days. I bring down all the files from the cloud, and looks like the restore will take about 9 days, even when running from local disk. This seems to be a well known problem with this software. Google duplicati recreating database for similar stories. If you are relying on duplicati for your primary backup, I recommend you google the above msg, and test your back. (delete your docker container / duplicati config, and try a restore as if you had a catastrophic failuer) Sent from my SM-N960W using Tapatalk Thanks for the PSA. I had several error messages myself when there were DB issues, and ended up deleting everything and starting fresh, but never had to simulate a catastrophic failure. I only backup small datasets in comparison to your use case, but still this is worrysome, as the stable version of Duplicati is not even recommended anymore... so there are not lots of alternative in this Duplicati world. Do you know of alternatives of tools that are: 1. free 2. can deduplicate 3. can store to cloud as encrypted, splitted files 4. not beta, and that can actually restore without taking weeks 5. not command line only, i.e. needs a free GUI (Duplicacy is close alternative, but with CLI version being only version that's free, this is not intuitive to use and especially restore via command line) Quote Link to comment
bobo89 Posted October 1, 2020 Share Posted October 1, 2020 Thanks for the PSA. I had several error messages myself when there were DB issues, and ended up deleting everything and starting fresh, but never had to simulate a catastrophic failure. I only backup small datasets in comparison to your use case, but still this is worrysome, as the stable version of Duplicati is not even recommended anymore... so there are not lots of alternative in this Duplicati world. Do you know of alternatives of tools that are: 1. free 2. can deduplicate 3. can store to cloud as encrypted, splitted files 4. not beta, and that can actually restore without taking weeks 5. not command line only, i.e. needs a free GUI (Duplicacy is close alternative, but with CLI version being only version that's free, this is not intuitive to use and especially restore via command line) Some recommendations I have seen were to use Borg, and to use just use rclone to copy over the files(or the rclone uoload/mount/unmount script) used on furms . I haven't explored thay yet fully, but will report back how it works.Duplicati is out for me. Sent from my SM-N960W using Tapatalk Quote Link to comment
Abigel Posted October 19, 2020 Share Posted October 19, 2020 Hi, I want to mount an external hard disk but when I turn it off and put it away, duplicati docker goes off How do I set it up so I can swap external hard drives and still have the path available because I want to use one name for 7 hard drives for all 7 days of the week. While I'm at it, can I tell duplicati that a backup should start when a particular disk is attached? Quote Link to comment
administrator Posted October 21, 2020 Share Posted October 21, 2020 On 10/1/2020 at 10:32 AM, xxxliqu1dxxx said: Thanks for the PSA. I had several error messages myself when there were DB issues, and ended up deleting everything and starting fresh, but never had to simulate a catastrophic failure. I only backup small datasets in comparison to your use case, but still this is worrysome, as the stable version of Duplicati is not even recommended anymore... so there are not lots of alternative in this Duplicati world. Do you know of alternatives of tools that are: 1. free 2. can deduplicate 3. can store to cloud as encrypted, splitted files 4. not beta, and that can actually restore without taking weeks 5. not command line only, i.e. needs a free GUI (Duplicacy is close alternative, but with CLI version being only version that's free, this is not intuitive to use and especially restore via command line) Nothing else exists that matches all those requirements. Borg does have a GUI, Vorta, but you still need another program to get your backups to the cloud, like rclone. You can check out this thread for more details if you decide to go the borg + rclone way, but you will have to modify scripts to use. Quote Link to comment
gacpac Posted October 31, 2020 Share Posted October 31, 2020 Question. What's the best way to backup appdata using duplicati? Currently backing the appdata folder directly with all the dockers running. Surprises me that it compressed from 20gb to 10gb. Other option to use the appdatabackup plugin that saves into tar.gz and then have duplicati upload that, but my backup size will be huge then, cause I keep last 4 copies in the folder. With duplicati I only one the last 2 going to a Mega.nz account Quote Link to comment
jj_uk Posted November 28, 2020 Share Posted November 28, 2020 I'm struggling to decide where to set Duplicati TMP folder on the server. I use appdata backup app that backs up the appdata folder. Duplicati stores the databases in it's appdata folder so that needs to be backed-up. The tmp folder for duplicati doesn't need backing up, so inside its appdata folder is the wrong place for it, and its making my appdata backup tar files huge! Would it be ok to set it to the server cache drive e.g. /mnt/cache/ ? I thought about using the server's RAM "/tmp/" but didn't want it to run out of RAM during a backup. Quote Link to comment
DivideBy0 Posted December 26, 2020 Share Posted December 26, 2020 Why is duplicati creating and storing these files in the directory I am trying to backup? I left it running for like 2 weeks while I was vacationing in Mexico and when I got back the drive was full. WTF? Quote Link to comment
bobo89 Posted December 26, 2020 Share Posted December 26, 2020 Why is duplicati creating and storing these files in the directory I am trying to backup? I left it running for like 2 weeks while I was vacationing in Mexico and when I got back the drive was full. WTF? Those are the encrypted chunks that constitute your backup. Are you sure you setup the right destination for your backup? Sent from my SM-N960W using Tapatalk Quote Link to comment
DivideBy0 Posted December 27, 2020 Share Posted December 27, 2020 (edited) 20 hours ago, bobo89 said: Those are the encrypted chunks that constitute your backup. Are you sure you setup the right destination for your backup? Sent from my SM-N960W using Tapatalk Yes I am sure, the destination was right, to cloud. Perhaps it creates a local copy before it uploads it and the upload speed couldn't keep up with the local copy? I was backing up about 5TB and the drive is 8TB. It was full in 2 weeks while I was out traveling Edited December 27, 2020 by johnwhicker Quote Link to comment
doma_2345 Posted January 3, 2021 Share Posted January 3, 2021 I am getting the following error over and over. I have tried restoring the container by re-downloading it but it does not seem to fix the issue. I am not sure how long this has been going on for but it stops the container properly launching. Any ideas? A serious error occurred in Duplicati: System.UnauthorizedAccessException: Access to the path "/tmp/HttpServer" is denied. at System.IO.Directory.CreateDirectoriesInternal (System.String path) [0x0005e] in <254335e8c4aa42e3923a8ba0d5ce8650>:0 at System.IO.Directory.CreateDirectory (System.String path) [0x0008f] in <254335e8c4aa42e3923a8ba0d5ce8650>:0 at HttpServer.HttpServer.Init () [0x0010a] in <bed89f1655ee48029f6d6812f54c58ad>:0 at HttpServer.HttpServer.Start (System.Net.IPAddress address, System.Int32 port) [0x00026] in <bed89f1655ee48029f6d6812f54c58ad>:0 at Duplicati.Server.WebServer.Server..ctor (System.Collections.Generic.IDictionary`2[TKey,TValue] options) [0x00215] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 at Duplicati.Server.Program.StartWebServer (System.Collections.Generic.Dictionary`2[TKey,TValue] commandlineOptions) [0x00000] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 at Duplicati.Server.Program.RealMain (System.String[] _args) [0x00227] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 A serious error occurred in Duplicati: System.UnauthorizedAccessException: Access to the path "/tmp/HttpServer" is denied. Quote Link to comment
doma_2345 Posted January 3, 2021 Share Posted January 3, 2021 12 minutes ago, doma_2345 said: I am getting the following error over and over. I have tried restoring the container by re-downloading it but it does not seem to fix the issue. I am not sure how long this has been going on for but it stops the container properly launching. Any ideas? A serious error occurred in Duplicati: System.UnauthorizedAccessException: Access to the path "/tmp/HttpServer" is denied. at System.IO.Directory.CreateDirectoriesInternal (System.String path) [0x0005e] in <254335e8c4aa42e3923a8ba0d5ce8650>:0 at System.IO.Directory.CreateDirectory (System.String path) [0x0008f] in <254335e8c4aa42e3923a8ba0d5ce8650>:0 at HttpServer.HttpServer.Init () [0x0010a] in <bed89f1655ee48029f6d6812f54c58ad>:0 at HttpServer.HttpServer.Start (System.Net.IPAddress address, System.Int32 port) [0x00026] in <bed89f1655ee48029f6d6812f54c58ad>:0 at Duplicati.Server.WebServer.Server..ctor (System.Collections.Generic.IDictionary`2[TKey,TValue] options) [0x00215] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 at Duplicati.Server.Program.StartWebServer (System.Collections.Generic.Dictionary`2[TKey,TValue] commandlineOptions) [0x00000] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 at Duplicati.Server.Program.RealMain (System.String[] _args) [0x00227] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 A serious error occurred in Duplicati: System.UnauthorizedAccessException: Access to the path "/tmp/HttpServer" is denied. I have managed to fix this with the following that i found on the duplicati forum from 2018 1 Quote Link to comment
showstopper Posted January 12, 2021 Share Posted January 12, 2021 (edited) Has something changed in the last update? My local backups run to a Network NAS (it is very old granted) which can no longer be accessed in duplicati. unRAID can see the NAS and it is mounted and can be accessed: It is configured and the docker has not been edited since i created it (a few years ago): However the destination is not accessible any more in duplicati: Any ideas guys? EDIT - Figured it out. It seems the mounted share is now in /remotes and not /disks. I changed the docker setting and it's now working again. Edited January 12, 2021 by showstopper Quote Link to comment
rampage Posted January 14, 2021 Share Posted January 14, 2021 This doesn't seem to work for me, I getting HTTP ERROR 400 while open the webui? Do I have to change anything with the default template? Quote Link to comment
doma_2345 Posted January 15, 2021 Share Posted January 15, 2021 after resolving the missing httpserver folder error, the latest update broke it again and i had to update my template to remove that fix, that gained me access to the GUI however I am now getting the following error. I backed up one of my backup tasks and deleted it, i then tried restoring that back up and the file import failed, i then added the back up task manually but that also did not resolve the issue. Any ideas? Quote Link to comment
Munce31 Posted January 19, 2021 Share Posted January 19, 2021 On 9/30/2020 at 9:17 AM, bobo89 said: A public service announcement regarding duplicati. Duplicati is still in beta ( which this container runs) I recently lost my cache drive which means the I lost all my docker containers and duplicati config. No sweat, I had a backup of the config. After restoring the config, I tried to restore a backup of the ~20GB file containing my docker backups. Since the database of files was lost with the duplicati docker, duplicati has to rebuild the database. Whatever code performs this task is broken. A 40GB restore from a 600GB backup, is tracking on taking about 20 days. I bring down all the files from the cloud, and looks like the restore will take about 9 days, even when running from local disk. This seems to be a well known problem with this software. Google duplicati recreating database for similar stories. If you are relying on duplicati for your primary backup, I recommend you google the above msg, and test your back. (delete your docker container / duplicati config, and try a restore as if you had a catastrophic failuer) Sent from my SM-N960W using Tapatalk Is this still a current issue? I've been looking for backup solution for my server and was thinking that Duplicati was it, however after reading posts on this forum, I am having my doubts... Quote Link to comment
bobo89 Posted January 20, 2021 Share Posted January 20, 2021 On 1/19/2021 at 6:07 AM, Munce31 said: Is this still a current issue? I've been looking for backup solution for my server and was thinking that Duplicati was it, however after reading posts on this forum, I am having my doubts... Haven't tried it, but I'm of the opinion you should really test your backup anyways. Try duplicati, and pretend you had a catastrophic failure. How quickly can you restore using it ? Quote Link to comment
jmmille Posted January 24, 2021 Share Posted January 24, 2021 (edited) On 1/14/2021 at 5:26 PM, rampage said: This doesn't seem to work for me, I getting HTTP ERROR 400 while open the webui? Do I have to change anything with the default template? I'm getting the same HTTP 400 error. Anyone know what's going on? Edit: Doesn't work in chrome. Found solution from user fnwc: When in the web UI, for Chrome, right click "inspect" go to the "Application" and click the "Clear Site Data" button then reload. Edited January 24, 2021 by jmmille 1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.