I want to backup about 15Tb of my 24Tb array. My upload speed is way to slow for cloud backup (would take months).

I bought two 8Tb externals and want to copy the files and take them offsite.

Ideally, I would do this automatically, having the files copied in such a way that I could later plug in another hard drive and do an incremental backup.

I have toyed with the idea of writing a python script to do this.

I was reading that xfsdump can do something like this as well.

 

Any recommendations for a good reliable way to accomplish this?

Thanks.

9 minutes ago, volcs0 said:

 

Any recommendations for a good reliable way to accomplish this?

My suggestion: Use the Unassigned Devices plugin and the sample script included adjusted to your needs.  It is easy to modify the script.

 

You could backup by share or by disk to your external drives.  I have modified the script to automatically backup four of my shares to a 14TB external USB drive each time I plug it in.  Initially, it copies everything.  On subsequent connections, it copies only new or modified files to the external drive.

19 hours ago, Hoopster said:

My suggestion: Use the Unassigned Devices plugin and the sample script included adjusted to your needs.  It is easy to modify the script.

 

You could backup by share or by disk to your external drives.  I have modified the script to automatically backup four of my shares to a 14TB external USB drive each time I plug it in.  Initially, it copies everything.  On subsequent connections, it copies only new or modified files to the external drive.

Thank you. I will read up on this.

 

I have a little different nerdy idea....   You could do hardware passthrough to  that drive and copy from the shares on a windows VM to the USB Drive and it should be possible.  Being that it is "local" storage it should transfer fairly quickly and then you don't have to play the games of finding which disk on the array has what files

IDK maybe it won't work but I kinda like to think outside the box lol