tucansam Posted June 23, 2017 Share Posted June 23, 2017 Guys, I have a ten-disk server and I am transitioning over to a second server. I have 31TB of data to move. Can I power down the old server, pull a disk out, put it in the new server, mount it with Unassigned Devices, and move the data directly from the command line? Seems like this would be the fastest way to move so much data at once. Thanks. Link to comment
zonderling Posted June 23, 2017 Share Posted June 23, 2017 Why over complicate things? I would just copy / paste over LAN and let it sit. Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 I have tried this using several different methods, and the fastest I can get is 20MB/s. So 30+TB at 20MB/s will take..... well..... it would be faster to pull disks and copy them individually at SATA II speeds. Link to comment
MrCrispy Posted June 23, 2017 Share Posted June 23, 2017 You should disable parity on the target server in any case. Then enable it back when all the data is there. If possible, you could also look at installing 10Gb cards in the 2 servers, they are not expensive (~$20) and this is the perfect use case. 20MBps seems really slow to me in any case, is that the read speed you get as well? Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 If I disable parity, will I need to do a parity check once the data is moved? 10g cards is a good idea, I had no idea they were that cheap. Read speeds are generally better, Windows copy over gig-e is 20MB/s, right now I am 'cp -R'ing from the command line and cannot measure speed. Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 Using nload I am getting 250-300Mb/s on eth0 on the target server Link to comment
JorgeB Posted June 23, 2017 Share Posted June 23, 2017 Rsync with turbo write on (or no parity) should give you line speed with gigabit. Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 rsync (with parity) is giving me 20-25MB/s If I disable parity, should I run a parity check when the file copy is done? Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 To disable parity, just unassign the parity disk? Link to comment
JorgeB Posted June 23, 2017 Share Posted June 23, 2017 Yes, also make sure you're not using the -z flag (compression) on the rsync command, or it will be muck slower for lan use. Link to comment
tucansam Posted June 23, 2017 Author Share Posted June 23, 2017 Yeah, thanks. I was using it, figured out real quick it was slowing things down. I'm averaging: Device eth0 [192.168.0.5] (2/10): ================================================================================ Incoming: Outgoing: Curr: 216.14 MBit/s Curr: 1.26 MBit/s Avg: 445.31 MBit/s Avg: 2.50 MBit/s Min: 952.00 Bit/s Min: 26.27 kBit/s Max: 904.55 MBit/s Max: 13.86 MBit/s Ttl: 3756.96 GByte Ttl: 1843.84 GByte according to nload Good enough for now. I'm moving a few hundred gigs for now, and when its time for the huge batch move, I'll unassign the parity disk and see how much faster things go. Thanks again. Link to comment
Recommended Posts
Archived
This topic is now archived and is closed to further replies.