February 21, 20233 yr I was planning on using s3sync to make daily backups to my AWS bucket. But now I'm wondering how it going to handle doing a daily sync of 3-5TB of data daily. Obviously I only want the changed files backed up. Currently I'm using Cloudberry Backup, and it works great, but I don't want to pay for their unlimited tier, and I just was hoping to go with something simple. I can't really tell the difference between s3sync and the s3backup apps. s3sync seems to work, but it does seem to have to scan every file every time it runs. I guess I'm fine with that, it won't take all night or anything, I just want to make sure it's not going to attempt to upload every file every time or anything. Only wanted new or changed files uploaded. I guess without a specialized tool, the AWS CLI is not built to evaluate for changed files, so all it can do is scan every file. But I assume it's going to evaluate timestamp and size, and only upload changed or new files. I guess I'm just curious what the difference is between the two tools, and what you all are using to backup all your files to your S3 bucket on a daily basis?
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.