JonathanM Posted March 18, 2020 Share Posted March 18, 2020 1 hour ago, gnollo said: Great, thank you! do I run that in a telnet session? Preferably in a session guaranteed to stay up, so it can complete. Either use the screen program from a remote terminal, or use the local console on the unraid box. Successful completion will give zero results, that command will give a listing of files that don't match. I suggest playing with it using a couple of small folders, so you can get comfortable with how it works. rsync -narcv <source path> <destination path> Quote Link to comment
gnollo Posted March 19, 2020 Share Posted March 19, 2020 Thanks I will test tonight Quote Link to comment
gnollo Posted March 30, 2020 Share Posted March 30, 2020 Ok I tested te rsync command, it lists all the folders and files and it then wrote "sent 776 bytes received 136 bytes 608.00 bytes/sec total size is 342,029 speedup is 375.03 (DRY RUN)" I am guessing that it means that it found all the files on both sides? Quote Link to comment
gnollo Posted March 30, 2020 Share Posted March 30, 2020 Compared another folder "sent 982,270 bytes received 89,107 bytes 4,399.91 bytes/sec total size is 804,721,870 speedup is 751.11 (DRY RUN)" This time is showed a much longer list of files during the run. Does it mean it found differences between the two folders? And did it actually write any files from the old drive to the rebuilt one? Quote Link to comment
JonathanM Posted March 30, 2020 Share Posted March 30, 2020 7 hours ago, gnollo said: This time is showed a much longer list of files during the run. Sounds like you may have the source and / or destination paths wrong. Try it on a pair of folders that you know for a fact are identical. Quote Link to comment
gnollo Posted March 30, 2020 Share Posted March 30, 2020 3 hours ago, jonathanm said: Sounds like you may have the source and / or destination paths wrong. Try it on a pair of folders that you know for a fact are identical. I tried one of the bluray rips, but it doesn't seem to handle spaces in the folder name, so I choose the whole Bluray older, and it's cranking away, "sending incremental file list". No error messages so far. Has been going a while, used the terminal option in the server UI. CPU usage seems to indicate it's still going at it (1 CPU always close to 100%) Quote Link to comment
JonathanM Posted March 30, 2020 Share Posted March 30, 2020 38 minutes ago, gnollo said: No error messages so far. Has been going a while, used the terminal option in the server UI. CPU usage seems to indicate it's still going at it That command doesn't give "errors", it tells you a list of files which don't match and would be transferred if you didn't have the n in the narcv Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 (edited) Checked on the computer this morning, the terminal session is now clear, like I just opened it. CPU is at 2% so I guess it finished. How do I find out the results? This is what it displays "Linux 4.19.41-Unraid. Last login: Mon Mar 30 17:20:15 +0100 2020 on /dev/pts/2. root@Tower:~# " Edited March 31, 2020 by gnollo update Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 (edited) If the movie folder I want to test is structures as "Movie Name (2010)" how do I translate that in the command line? Doesn't like spaces, I tried underscores but then it doesn't like ( either. Edited March 31, 2020 by gnollo Quote Link to comment
JonathanM Posted March 31, 2020 Share Posted March 31, 2020 1 hour ago, gnollo said: If the movie folder I want to test is structures as "Movie Name (2010)" how do I translate that in the command line? Easiest way is to use tab completion. Start typing the beginning of the path and hit the tab key. 4 hours ago, gnollo said: Checked on the computer this morning, the terminal session is now clear, like I just opened it. Sounds like the terminal session got closed at some point. It should show the command you typed and eventually (hours later) return to the prompt, not just show a new session. You need to use a console that won't automatically close or get terminated, either on the local console at the physical machine, or use the screen program to set up a virtual console that won't terminate. For the benefit of others reading along, if anybody is, the reason I'm not redirecting the output to a file to be examined later is that there should be no files listed, so nothing to read in the output file. If it starts spitting out a file list, those files don't match. This was theoretically going to be an easy way to do file copy verification, not a full fledged sync routine. Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 1 hour ago, jonathanm said: Easiest way is to use tab completion. Start typing the beginning of the path and hit the tab key. Tab does nothing for me on the telnet session in CMD or via the UI interface Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 1 hour ago, jonathanm said: Sounds like the terminal session got closed at some point. It should show the command you typed and eventually (hours later) return to the prompt, not just show a new session. Is the prompt a flashing square? No message to say that the task was completed? Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 Ok so I tested by finding a sequence of folders with no spaces. Two files in the folder, each around 716,000 KB. results on telnet message below. Does it mean that they are not identical? root@Tower:~# rsync -narcv /mnt/disks/WDC_WD20EZRZ-00Z5HB0_WD-WCC4M3FD32PK/unraid/divx/Blindness /mnt/disk2/unraid/div x/Blindness sending incremental file list Blindness/ Blindness/p-blind-cd1.avi Blindness/p-blind-cd2.avi sent 156 bytes received 26 bytes 14.56 bytes/sec total size is 1,468,149,760 speedup is 8,066,756.92 (DRY RUN) Quote Link to comment
JonathanM Posted March 31, 2020 Share Posted March 31, 2020 3 minutes ago, gnollo said: Does it mean that they are not identical? Most likely. Play both sets of files and see which ones are correct, copy the correct ones overwriting the corrupt files and rerun the command to see the results when the files are identical. Quote Link to comment
JonathanM Posted March 31, 2020 Share Posted March 31, 2020 35 minutes ago, gnollo said: Tab does nothing for me on the telnet session in CMD or via the UI interface when typing the path, /mnt/disk2/un <tab> doesn't fill in /mnt/disk2/unraid ? Try using putty. Quote Link to comment
trurl Posted March 31, 2020 Share Posted March 31, 2020 13 minutes ago, jonathanm said: when typing the path, /mnt/disk2/un <tab> doesn't fill in /mnt/disk2/unraid ? Try using putty. Whatever they are using must not be sending the tab. The information for autocomplete is on the server side after all. Quote Link to comment
JorgeB Posted March 31, 2020 Share Posted March 31, 2020 43 minutes ago, gnollo said: rsync -narcv /mnt/disks/WDC_WD20EZRZ-00Z5HB0_WD-WCC4M3FD32PK/unraid/divx/Blindness /mnt/disk2/unraid/div x/Blindness You need to add another slash to both paths or it will fail, like so: rsync -narcv /mnt/disks/WDC_WD20EZRZ-00Z5HB0_WD-WCC4M3FD32PK/unraid/divx/Blindness/ /mnt/disk2/unraid/divx/Blindness/ 1 Quote Link to comment
gnollo Posted March 31, 2020 Share Posted March 31, 2020 (edited) It explains. I just used checksum compare and it tells me everything is ok, the files are identical (as I recreated them using parity). Tried it again with the end / and no incremental file list is showing Edited March 31, 2020 by gnollo update Quote Link to comment
JonathanM Posted March 31, 2020 Share Posted March 31, 2020 1 hour ago, johnnie.black said: You need to add another slash to both paths or it will fail, like so: Missed that. Good catch! Quote Link to comment
gnollo Posted April 1, 2020 Share Posted April 1, 2020 Thank you all, I checked the entire bluray folder, took over 10 hours but completed fine finding no files that were different. I will check the other folders as well so I can wipe the data off the old drive and retire it once confirmed. Quote Link to comment
gnollo Posted April 2, 2020 Share Posted April 2, 2020 I am still unable to run rsync on a folder with spaces in it. Anyone has any idea other than using the TAB key on how to run it on a folder that is not named as a single word (TAB autocomplete does not work for me for some reason)? I run the Checksum Compare app from a windows machine, scanning the same folder with spaces ("bluray full rips" on both drives (old and rebuilt) and it says it has found three files that are different. The are three large mkvs, tested them all three and they play all the way to the end. Could the files that parity recreated be corrupted and still work? Quote Link to comment
gnollo Posted April 2, 2020 Share Posted April 2, 2020 Here is an example of the two MD5 numbers being different for the same mkv full rip of the bluray (Dark City). I used MakeMKV to build the file on the old drive, and parity rebuilt it on the new drive. Quote Link to comment
JorgeB Posted April 2, 2020 Share Posted April 2, 2020 2 hours ago, gnollo said: I am still unable to run rsync on a folder with spaces in it Use " or escape the spaces with \, e.g.: "/mnt/path to folder" or /mnt/path\ to\ folder/ Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.