Homebrewzero Posted June 20 Share Posted June 20 New to Unraid, I talked to a friend who told me to forget the parity and cache until I transfer my data over. I mounted my Unraid share on my Synology NAS as an SMB share. I am copying over a lot of files, about 17 TB, but the move speed is still around 50-80MB/s. I have the Unraid server and Synology connected to the same switch. My friend advised me not to do a dual NIC configuration as I do not have an LACP switch, but I currently have both my Unraid and Synology configured for active-backup running at 1G. Any suggestion on how to improve transfer speeds? All drives are enterprise or NAS HDD. Cheers Quote Link to comment
Frank1940 Posted June 20 Share Posted June 20 IF the files are small (Say <10MB), this is is not an unacceptable speed. The file creation overhead is files being written directly to an Unraid User Share is substantiation. (When I back up my KODI media database, the speed drops into the 10-20MB/s range. When it is transferring the actual media files, the speed is 90+MB/s.) Quote Link to comment
Homebrewzero Posted June 20 Author Share Posted June 20 It's mostly my video Files ranging from few hundred MB to 50GB Quote Link to comment
Frank1940 Posted June 20 Share Posted June 20 Describe in detail how you are doing the transfer. Specifically, the software being used, if any link (like a PC) in the middle, etc. Depending on your other hardware, this still might in an expected speed. Remember that there is software and hardware on both ends of this equation. I would suspect that you are not using rsync (as I understand it), it is not installed on Synology NAS's by default. rsync is very efficient as it runs natively on both ends of the connection. (I also have some reason to believe that it actually pushes the files from the originating server to the receiving server.) Also include a diagnostics file as it might provide some clues. Quote Link to comment
Homebrewzero Posted June 21 Author Share Posted June 21 I mounted the unraid share on my Synology nas. I went into my Synology nas file browser( File station) tools> mount remote CIFS drive. Then I highlighted my media directory copy , then pasted it into the newly mounted cifs drive. Let me see if I can find where the diagnostics files are located. Quote Link to comment
Homebrewzero Posted June 21 Author Share Posted June 21 So I am trying rsync. I was able to mount my synology folder into unraid, and I ran some rsync commands, and it seems to be running even slower 4.26G 99% 39.80MB/s 0:00:00 410.55M 9% 43.19MB/s 0:01:27 Quote Link to comment
Frank1940 Posted June 21 Share Posted June 21 About locating the diagnostics file. You will see there is a line under Diagnostics. That is a link to a section of the Unraid Manual which will explain about generating the file. Point your cursor at that link and left click on it. You upload the entire file in a new post in this thread. (I copied about 15TB from one Unraid server to another Unraid server about nine months ago. Moved it in about twenty chunks rather than all at once and it took about a week to complete.) This is the basic command format that I used for all of the chunks: rsync -avhPX /mnt/remotes/192.168.1.245_Media/All\ Movies/ /mnt/user/BackupMedia/All\ Movies/ (This actual command that I use every week or two to add all of the new files onto the backup server. Since I have a parity installed and no cache drive for this share, I have set the 'Tunable (md_write_method):' parameter to "reconstruct write". I get sped approximately equal to the drive write speed. My data drives at the point are almost full 3TB drives which are rather slow on the inner tracks.) Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.