December 11, 201015 yr Greetings, I've just installed a new 2tb drive to my server. It will replace 3x500gb drives. The new 2tb is disk5 (rebuilt from the original 500gb). The other 2 500Gb HDD's are disk6 and disk7. So I need to get all the movies off disk6&7 on to disk5. Looking at the wiki, I was considering using MC (instead of across the network). Then I saw the wiki part about using Unix commands here - http://lime-technology.com/wiki/index.php?title=Transferring_Files_Within_the_unRAID_Server#Move_Files_Overnight. Is there a BEST way of doing this? Do I need to leave the telnet window open when using the UNIX commands, or is it carried out directly on the server? (I can do it from the unRAID attached keybd/monitor). I'd like to try a simple copy (I prefer Copy to MOVE) so I can get the gist of how things work. Is this the correct command to copy a single movie (Get Shorty) from disk6 to disk5 - thereby creating a folder in the root of disk5 called "Disk6Movies/Get Shorty? cp -r /mnt/disk6/movies/Get Shorty /mnt/disk5/Disk6Movies/Get Shorty Then... To copy all the movies on disk6 to disk5 and create a root folder called "Disk6Movies", I'll use cp -r /mnt/disk6 /mnt/disk5/Disk6Movies I am assuming this will NOT overwrite the movies already on disk5. (Disk5/Movies). Finally, I guess I need to verify the copied data is complete. I've never done this before, but I'm assuming a checksum is used. I found this post here by JoeL http://lime-technology.com/forum/index.php?topic=4699.msg43039#msg43039. I was going to try the 2nd one, as although I use shares - I do not write to them - preferring to write directly to the disk. Can you make one checksum for an entire folder - Say Disk6/Movies? Or, is this not the way to do it?? In JoeL's example, a checksum is generated for each file in the folder. What is the best way to check they are the same between disks? Do you have to manually do it, or is there a "compare" function? Thx for any insights.
December 11, 201015 yr You could use Teracopy. It copies over the network, but is very user friendly and will make checksum calculations.
December 11, 201015 yr Is there a BEST way of doing this? IMO, not really. It's all personal preference. Whichever you're most comfortable using. Do I need to leave the telnet window open when using the UNIX commands, or is it carried out directly on the server? (I can do it from the unRAID attached keybd/monitor). Yes, you need to leave the telnet session open. On long operations, I tend to use ssh and screen (easily install as an add-on if you are using UnMENU). Screen will keep the session open in the background in the event the network connection drops. Of course, you can avoid any and all network issues using the server directly. I'd like to try a simple copy (I prefer Copy to MOVE) so I can get the gist of how things work. Is this the correct command to copy a single movie (Get Shorty) from disk6 to disk5 - thereby creating a folder in the root of disk5 called "Disk6Movies/Get Shorty? cp -r /mnt/disk6/movies/Get Shorty /mnt/disk5/Disk6Movies/Get Shorty Yes. Then... To copy all the movies on disk6 to disk5 and create a root folder called "Disk6Movies", I'll use cp -r /mnt/disk6 /mnt/disk5/Disk6Movies I am assuming this will NOT overwrite the movies already on disk5. (Disk5/Movies). That's correct. All your movies will end up in the directory Disk6Movies/ and not touch anything below it. Finally, I guess I need to verify the copied data is complete. I've never done this before, but I'm assuming a checksum is used. I found this post here by JoeL http://lime-technology.com/forum/index.php?topic=4699.msg43039#msg43039. I was going to try the 2nd one, as although I use shares - I do not write to them - preferring to write directly to the disk. Can you make one checksum for an entire folder - Say Disk6/Movies? Or, is this not the way to do it?? In JoeL's example, a checksum is generated for each file in the folder. What is the best way to check they are the same between disks? Do you have to manually do it, or is there a "compare" function? You'll need to change Joe's examples slightly if you're working with files in different absolute paths: To create the checksum list of files from disk6: cd /mnt/disk6 find * -type f -exec md5sum {} \; | tee /boot/md5_file_checksums.txt and to compare the files you copied to disk5: cd /mnt/disk5/Disk6Movies md5sum -c /boot/md5_file_checksums.txt Hope this helps.
December 11, 201015 yr Author Thx for the help. I'm always a little apprehensive about making changes to the system - especially when it's not something I do everyday. I'll give this a go. On a wee side note: Can someone recommend good Checksum software for XP - something that can generate a checksum for individual files and a folder full of files (preferably free )
December 12, 201015 yr For Windows you can try these: http://www.md5summer.org/ http://etree.org/md5com.html
December 12, 201015 yr Author For Windows you can try these: http://www.md5summer.org/ http://etree.org/md5com.html Thx muchly.
December 14, 201015 yr Is this really the only way to move files around with unRAID? I'm thinking about replacing a bunch of smaller drives with a single large drive. It seems like unRAID should have a built in utility to migrate data to a new drive and then perform a verification (checksum) step.
December 14, 201015 yr Is this really the only way to move files around with unRAID? I'm thinking about replacing a bunch of smaller drives with a single large drive. It seems like unRAID should have a built in utility to migrate data to a new drive and then perform a verification (checksum) step. It is already built into the server, it just does not have a nice GUI control. Besides that, there is no need for unRAID to really work at that level. The md5 sums are to check that files transferred from your local machine to unRAID correctly, once there they should be fine. Even then unRAID does not care about a "file" the parity it keeps is at the bit level and to unRAID everything is 1's and 0's. If you want to check that stuff is transferring properly use something like TeraCopy or do md5 sums. If you want to transfer from disk to disk in unRAID then use Midnight Commander (type mc at the console prompt or in a telnet session).
December 14, 201015 yr Is this really the only way to move files around with unRAID? [there are many ways to copy files around. (unix utilities include "mc", "mv", "tar", "cpio", "rsync") I'm thinking about replacing a bunch of smaller drives with a single large drive. It seems like unRAID should have a built in utility to migrate data to a new drive and then perform a verification (checksum) step. It has no graphical interface to any of these. Most are unix utilities that have existed for 30+ years. "mc" is the best for a novice user. (Easiest, even if not the fastest is file-explorer on your PC as it needs no special skills) Terracopy on your PC can perform verification checksums. It is closest to what you are looking for. unRAID has the "sum" command and the md5sum command. Both can be used to verify files. "rsync" can be used to copy and verify, but it is command line only.
December 14, 201015 yr fyi I just did this and posted in this thread about it. http://lime-technology.com/forum/index.php?topic=9022.msg86415;topicseen#msg86415
December 14, 201015 yr If you want to transfer from disk to disk in unRAID then use Midnight Commander (type mc at the console prompt or in a telnet session). Ok I'll give MC a try. Thanks. I just think it would be easy to implement a page in the web interface that initiates the CLI commands to move data from one drive to another or to consolidate a dir to one drive and stuff like that. It has no graphical interface to any of these. Most are unix utilities that have existed for 30+ years. "mc" is the best for a novice user. "rsync" can be used to copy and verify, but it is command line only. Using CLI is really powerful, but it's cumbersome for most quick things. I really thing unRAID has to get past requiring users to use CLI for fairly basic things like upgrading hard drives. I'll try out rsync. I don't want to use a file-explorer or Terracopy because I want to keep the transfer entirely local to the unRAID box. fyi I just did this and posted in this thread about it. Ah thanks for posting that! This is the functionality I'd love to see implemented in the WebGUI.
December 15, 201015 yr I don't want to use a file-explorer or Terracopy because I want to keep the transfer entirely local to the unRAID box. Install unMENU. Use unMENU to download and install unRAID-Web. It will install a small web-server and a set of php pages on port 89. Access //tower:89 to get to it. In unRAID web is AjaxExplorer. You can use the version invoked in the unMENU extension under unRAID-Web, or the one that is an extension of its own. (The one under unMENU sizes itself to the window better, I think) AjaxExplorer is is Web-based, GUI, and transfers of files using it will be entirely on the server. The id/password to begin using it is admin/admin Joe L.
Archived
This topic is now archived and is closed to further replies.