Currently running v6.3.5 

 

I moved from drivepool Windows 10 to Unraid last week and the /r/Unraid sub helped me but I thought I should ask this here first. 

 

I have a 100TB server with 77TB used. So in prep to move to Unraid I removed 20TB of drives, rigged up a small Unraid Server then filled it up over the last week through SMB with my most crucial files I'd need access too. I copied them, not moved.

 

Well now I've removed all the drives from my main rig, moved Unraid to it, and am slowly moving data from each drive to the array using the Unassigned drive program. No cache or Parity right now because cache gets full quick and Parity slows down the transfers. 

 

The problem is I have 77TB of data with 20TB already in the array but I have no idea what disk has what information. So what I'm doing is adding a disk one at a time, running Rsync, and copying data from the unassigned drive to the Mnt/user Array and telling it not to copy if the file already exists. This is taking much longer than I thought. Once I've moved all the data, I format the disk and add it to the array and start on the next disk. 

 

Id love to do disk to disk so I could do 3-4 disk at a time without lag but I've already moved 20TB of random data so if I transfer unassigned disk1 to disk3 in the array, I could be moving data that's already on disk1 of the array. If I move it to the mnt/user rsync sees that disk1 has the data already and won't move it. 

 

Any my way around this or am I stuck moving 50TB of data 50-100mb/s?

 

My only idea is maybe using double killer, comparing my loose drive to the array and if the data is already in the array erase it then I can do disk to disk but doublekiller is taking a while finding dupes in 20TB of data. 

 

Fixed it, you can close this baby up...

 

 

 

ha just kidding I hate that! 

 

In case someone has this exact random case I installed an application called Beyond Compare on one of my Windows PCs. I now add an assigned drive, share it over SMB, compare it to my array and erase anything that matches. I now have a disk that only has unique items so I can do my disk to disk transfer with no worries.