so my rsync command line is

rsync -avzue ssh --checksum --exclude-from='/boot/config/plugins/user.scripts/scripts/exclude1.txt' --protect-args -avue ssh --stats --numeric-ids --progress '/mnt/user/Family Files/' [email protected]:'/mnt/user/Backup_Tardis_Folders/Family Files/'

and its always hanging used to be rsync would say increminting list. and then things would zip zip zip.. now it just hangs . all the time.. i dunno what its doing

here is some of it its stuck..

!Home Videos/2019/boat engine issues still  September/20190908_185100.mp4 is uptodate
!Home Videos/2019/boat engine issues still  September/20190910_145821.mp4 is uptodate
!Home Videos/2019/boat engine issues still  September/20190910_150014.mp4 is uptodate
!Home Videos/2019/boat engine issues still  September/20190910_150249.mp4 is uptodate
!Home Videos/2019/boat engine issues still  September/20190914_115630.mp4 is uptodate
!Home Videos/2019/boat engine issues still  September/20191004_120828.mp4 is uptodate
[sender] expand file_list pointer array to 1024 bytes, did move
[sender] expand file_list pointer array to 1024 bytes, did move
[sender] expand file_list pointer array to 4096 bytes, did move
[sender] expand file_list pointer array to 1024 bytes, did not move
[sender] expand file_list pointer array to 4096 bytes, did not move

is there a way to get rysnc to work like it worked a couple years ago where it just went fast ... like its just crazy

Probably want to remove --checksum, that means each side will need to read the entirety of each file on both sides every time it runs.

Edited July 22Jul 22 by Kilrah

@Kilrah ok that seems to speed it up more faster.. now as it was over an hour and still not done yet..

when do you want to have the checksum and when dont you want it?

I would run checksum once or twice a year to verify that the data hasn't been corrupted for some reason, but also in a way that it only shows discrepancies instead of updating so I can verify which side is correct.

Would also check how long it should take to read that amount of data and check it takes about the expected time when it runs to hopefully catch a failing drive that's slower than it should.

ok so ill use the checksum every 6 months then.

so you mean see how long it takes to use the checksum? so say if it takes 2 hours or more now... record that and do it again in 6 months and see if it takes longer or the same.. and how would it tell if there is a failing drive just by being slower?

and is there a option -whatever dash if rsync looses connection forwhatever reason not to exit out but to just resume.. or you gotta just wait for user script to run again as i do it nightly backup but if it craps out it wont finish till the next day. is there an option that tells it if it craps out wait and restart and resume

and is there a option -whatever dash if rsync looses connection forwhatever reason not to exit out but to just resume.. or you gotta just wait for user script to run again as i do it nightly backup but if it craps out it wont finish till the next day. is there an option that tells it if it craps out wait and restart and resume

12 hours ago, comet424 said:

so you mean see how long it takes to use the checksum? so say if it takes 2 hours or more now... record that and do it again in 6 months and see if it takes longer or the same..

I meant more "see how much data there is, compare to typical drive read speed" but that works too. That was in response to you seeing it used to be fast and now it's slow, if that was both with the same options then either you now have much more data or something's going wrong if it now takes longer for the same amount of data.

12 hours ago, comet424 said:

and is there a option -whatever dash if rsync looses connection forwhatever reason not to exit out but to just resume.. or you gotta just wait for user script to run again as i do it nightly backup but if it craps out it wont finish till the next day. is there an option that tells it if it craps out wait and restart and resume

Don't know of one but you could probably make a script that checks whether rsync succeeded or errored and retries if it errored.

@Kilrah ah ok ya i didnt record the times.. i know in the past when i rsync' it would go fast it would only do the files it didnt have and skip everything else.. now it seems there is "up to date" it says now before it never did all that stuff.. and just runs slower from saya couple years ago where there was not "up to date" display

i just know when i didnt do the >> to export a log file in past it would zip through now it seems its going slow.. and i havent changed my rysnc user scripts just update unraid version but i noticed now there is "up to date" and the sender] expand file_list pointer array to 1024 bytes, did move trhat wasnt there in the past... i guess its just newer version of rsync and possible slower now from past versions?

as for the script wouldnt know how to write it.. but this is home use not mission critical.. so i guess just regular rsync i have setup in user scrip good enough

i did check my other user scripts for backing up some i had

rsync -avzue ssh --partial --append-verify --checksum --exclude

rsync -avzue ssh --partial --append-verify --exclude

rsync -avzue ssh --exclude

rsync --protect-args -avu --stats --numeric-ids --progress

now i dont truly understand all 4.. i was learning rysnc and using examples when i set this stuff up like 10 years ago and less so whatever was on google searchs for backup.. as i liked it better then the syncthing i didnt need to relie on a program to do it

Edited July 24Jul 24 by comet424