Rsync weirdness

[heffneil]

This is a bit off-topic but I thought you guys might be able to help:

 

I am running an rsync from one unraid server to another.  I have ran this command numerous times and each time it copies the same files over and over.  For some reason it isn't registering the file as being the same.  Any ideas why that might be?  I have ran them one after the other and seen the files on the destination server.  It is not all the file just a subset of those files.  The command for reference is:

 

rsync -e ssh -avz /mnt/user/Movies/ root@storage2:/mnt/user/Movies

 

Thanks!

 

Neil

 

[cyrnel]

Try without the -e ssh. It's been known to cause issues. Not necessarily as a solution, but for troubleshooting.

 

Are these going over a WAN? If not I'd get rid of both -e and z. Really, for movies, z isn't going to buy you much anyway at the expense of lots of crunching.

[heffneil]

Ok thanks and yes this is over the wan.

 

Neil

 

[heffneil]

Let me also explain I was setting this up a scheduled task with cron so the -e was to use SSH with shared keys on the server so it would automagically happen?

 

Neil

 

[cyrnel]

That probably isn't it. Check the receiver log and/or add verbosity to make sure things are actually being written as you expect.

 

For movies over a WAN link I'd also start using --partial.

[heffneil]

Im pretty stupid can you tell me how to do some of those things with the log etc?

 

Thanks!

 

Neil

 

[cyrnel]

Adding more "v"s to the command line increases verbosity at your end. Probably won't be very useful as the sender.

 

Look on the other system, in syslog or whatever log file is specified in your rsyncd.conf file. See any errors?

 

I've seen behavior like you describe when the remote end didn't have adequate permissions to do everything correctly. Might be an ownership thing. Again, your rsyncd.conf is important. You might try -c to force checksum compares instead of mod dates & sizes. Takes longer & more horsepower but may behave differently. Use -n so you just get a report of what would have happened instead of burning bandwidth.

 

Good luck.

[dgaschk]

Are you copying to a user share with multiple included disks? You may be running into this problem: http://lime-technology.com/forum/index.php?topic=11847.0

[cyrnel]

Ooh, good call. That could do it.

[heffneil]

I think that is it! I looked at the file I used the -n option to not copy and the files are identical the only problem is their modified date!  I guess my problem is that I am copying to two unraid servers.  Now the question is how do I fix it

 

Neil

 

[heffneil]

One file I just checked actually was different size.  My buddy who helped me concoct this command was told that I didn't want to sync them up in that delete files which aren't there so maybe since the older file exists it won't overwrite it on the source server?  I just don't know rsync well enough?