How can I automatically backup files from unraid (flash, cache drive, shares) to my Amazon Drive - similar to crashplan?

 

 

good timing :-)

 

Or, you can use rclone but this only does sync i.e. no versioning, but it does have nifty mount options

 

 

Really good timing, I *just* searched for this. Really thinking I'll backup my unraid box to Amazon Drive. $60/year, hard to beat that.

Will be curious to hear how you guys find Duplicati + ACD; I tried a couple of months back and could not break the 1TB barrier without Duplicati crashing.

I'm not sure I'll even get that far. It's too slow! I would like to think I could get ~50Mbps upload based on some speed tests I've run to Amazon. However it's only about 20Mbps or so right now. Maybe it's encrypting files as uploads completed instead of keeping a buffer going of files ready to upload?

 

Rclone is supposed to work well, might need to look into that. Would like a nice tool do it for me though.

I am trying to setup the duplicati docker, and it is asking for backup and source directories, how do I set this up with Amazon Drive?

Remove the backup mapping and set the source to be whatever you want to backup to Amazon

Do I add a source for each folder I want to backup?

Add whatever you want.  Up to you, add more mappings if it suits /photos /documents whatever

I have created the docker now, and setup a backup in Duplicati to push the contents of my cache drive to a folder in Amazon Drive called UnraidCache.  I successfully tested the connection during the setup.

 

When I try to run the backup procedure, it fails saying disk is full, but I have unlimited space on Amazon drive.

 

In the log, I see this message repeating:

Apr 26, 2017 9:21 PM: ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid(); took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid();
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ? took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ?
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid(); took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid();
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ? took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ?
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid(); took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid();
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ? took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ?
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid(); took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: INSERT INTO "Block" ("Hash", "VolumeID", "Size") VALUES (?, ?, ?); SELECT last_insert_rowid();
Apr 26, 2017 9:21 PM: ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ? took 00:00:00.000
Apr 26, 2017 9:21 PM: Starting - ExecuteScalarInt64: SELECT "ID" FROM "Block" WHERE "Hash" = ? AND "Size" = ?

I setup a smaller backup with just a single file, more errors in the log, it is not uploading anything:

 

• Apr 26, 2017 9:49 PM: Message
  Fatal error
  Duplicati.Library.Interface.UserInformationException: Found 1 files that are missing from the remote storage, please run repair at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList (Duplicati.Library.Main.BackendManager backend, Duplicati.Library.Main.Options options, Duplicati.Library.Main.Database.LocalDatabase database, Duplicati.Library.Main.IBackendWriter log, System.String protectedfile) [0x0023a] in <9a0761fc41944a4eac9c10dbd966092c>:0 at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify (Duplicati.Library.Main.BackendManager backend, System.String protectedfile) [0x0006c] in <9a0761fc41944a4eac9c10dbd966092c>:0
• Apr 26, 2017 9:49 PM: Message
  Found 1 files that are missing from the remote storage, please run repair
   
• Apr 26, 2017 9:49 PM: Message
  Missing file: duplicati-i8b133824430740d9913a0900f992dc14.dindex.zip
   
• Apr 26, 2017 9:49 PM: Message
  Fatal error
  Duplicati.Library.Interface.UserInformationException: Found 3 files that are missing from the remote storage, please run repair at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList (Duplicati.Library.Main.BackendManager backend, Duplicati.Library.Main.Options options, Duplicati.Library.Main.Database.LocalDatabase database, Duplicati.Library.Main.IBackendWriter log, System.String protectedfile) [0x0023a] in <9a0761fc41944a4eac9c10dbd966092c>:0 at Duplicati.Library.Main.Operation.BackupHandler.PostBackupVerification () [0x00058] in <9a0761fc41944a4eac9c10dbd966092c>:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x00893] in <9a0761fc41944a4eac9c10dbd966092c>:0

Without you posting how you've got it setup we can't help.

Sent from my LG-H815 using Tapatalk