comet424

i did check my other user scripts for backing up some i had rsync -avzue ssh --partial --append-verify --checksum --exclude rsync -avzue ssh --partial --append-verify --exclude rsync -avzue ssh --exclude rsync --protect-args -avu --stats --numeric-ids --progress now i dont truly understand all 4.. i was learning rysnc and using examples when i set this stuff up like 10 years ago and less so whatever was on google searchs for backup.. as i liked it better then the syncthing i didnt need to relie on a program to do it

@Kilrah ah ok ya i didnt record the times.. i know in the past when i rsync' it would go fast it would only do the files it didnt have and skip everything else.. now it seems there is "up to date" it says now before it never did all that stuff.. and just runs slower from saya couple years ago where there was not "up to date" display i just know when i didnt do the >> to export a log file in past it would zip through now it seems its going slow.. and i havent changed my rysnc user scripts just update unraid version but i noticed now there is "up to date" and the sender] expand file_list pointer array to 1024 bytes, did move trhat wasnt there in the past... i guess its just newer version of rsync and possible slower now from past versions? as for the script wouldnt know how to write it.. but this is home use not mission critical.. so i guess just regular rsync i have setup in user scrip good enough

and is there a option -whatever dash if rsync looses connection forwhatever reason not to exit out but to just resume.. or you gotta just wait for user script to run again as i do it nightly backup but if it craps out it wont finish till the next day. is there an option that tells it if it craps out wait and restart and resume

and is there a option -whatever dash if rsync looses connection forwhatever reason not to exit out but to just resume.. or you gotta just wait for user script to run again as i do it nightly backup but if it craps out it wont finish till the next day. is there an option that tells it if it craps out wait and restart and resume

ok so ill use the checksum every 6 months then. so you mean see how long it takes to use the checksum? so say if it takes 2 hours or more now... record that and do it again in 6 months and see if it takes longer or the same.. and how would it tell if there is a failing drive just by being slower?

@Kilrah ok that seems to speed it up more faster.. now as it was over an hour and still not done yet.. when do you want to have the checksum and when dont you want it?

so my rsync command line is rsync -avzue ssh --checksum --exclude-from='/boot/config/plugins/user.scripts/scripts/exclude1.txt' --protect-args -avue ssh --stats --numeric-ids --progress '/mnt/user/Family Files/' [email protected]:'/mnt/user/Backup_Tardis_Folders/Family Files/'and its always hanging used to be rsync would say increminting list. and then things would zip zip zip.. now it just hangs . all the time.. i dunno what its doing here is some of it its stuck.. !Home Videos/2019/boat engine issues still September/20190908_185100.mp4 is uptodate !Home Videos/2019/boat engine issues still September/20190910_145821.mp4 is uptodate !Home Videos/2019/boat engine issues still September/20190910_150014.mp4 is uptodate !Home Videos/2019/boat engine issues still September/20190910_150249.mp4 is uptodate !Home Videos/2019/boat engine issues still September/20190914_115630.mp4 is uptodate !Home Videos/2019/boat engine issues still September/20191004_120828.mp4 is uptodate [sender] expand file_list pointer array to 1024 bytes, did move [sender] expand file_list pointer array to 1024 bytes, did move [sender] expand file_list pointer array to 4096 bytes, did move [sender] expand file_list pointer array to 1024 bytes, did not move [sender] expand file_list pointer array to 4096 bytes, did not move is there a way to get rysnc to work like it worked a couple years ago where it just went fast ... like its just crazy

so i was copying a bunch of files from my windows machine nvme drive to the array folder and found it just slow only getting 20meg -50meg a sec so then i just deciided to copy from windows to a share on the cache drive that is just cache.. and i get 20-50 spikes at 130mb/s but if i copy from nvme windows to appdata folder which is a nvme also i getting 500+mb/s same files is there a test i can do if its the sata ssd wd 1tb drive the issue if its cuz its on a HBA card and its my pcie slots slowed down are there tests to see why its slow there?

@JorgeB ohy ok ya i had unpluged it as its hot swap did it show other errors why rsync and just windows copying desktop files to desktop files on the 2 server are crapping out so bad and just failing

so i been trying for a week to rysnc or use windows to copy from tardis server to backup server copying 5tb well it keeps crapping out now i getting messed up errors Jun 20 18:45:29 Tardis kernel: Buffer I/O error on dev sdj1, logical block 30708689, async page read Jun 20 18:45:29 Tardis ntfs-3g[17264]: ntfs_attr_pread_i: ntfs_pread failed: Input/output error Jun 20 18:45:29 Tardis ntfs-3g[17264]: Failed to read vcn 0x0 from inode 297: Input/output error Jun 20 18:45:29 Tardis kernel: Buffer I/O error on dev sdj1, logical block 30708689, async page read Jun 20 18:50:06 Tardis ntfs-3g[17264]: ntfs_attr_pread_i: ntfs_pread failed: Input/output error Jun 20 18:50:06 Tardis ntfs-3g[17264]: Failed to read index block: Input/output error what is going on? almost seems i need to go back to 6.9 i posted rsync issues and diagnostics but no one checked them to see whats going on not sure what i need to fix to be able to copy properly tardis-diagnostics-20260620-1903.zip backupserver-diagnostics-20260620-1903.zip

cuz even with windows copying the files are spinning through there is no disk activity on 2nd unraid server or main unraid... unless cuz the files are small files its just going through them fast. and not registering a speed.. as ive tried copying the same 4tb folder of my desktop files of computer backups and ive been trying last 4 days before i tried asking help on here any my logs are full of Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1 Jun 19 03:59:09 Tardis nginx: 2026/06/19 03:59:09 [error] 1409846#1409846: MEMSTORE:00: force-reaping msg with refcount 1which i constantly see alot of times and googling never helps it doesnt say what caused it and its copying tardis desktop files to backupserver desktop files tardis-diagnostics-20260619-0530.zip backupserver-diagnostics-20260619-0530.zip

im doing unraid to unraid rysncing so 7.3.1v to 7.3.1v i even finding if i do windows copy unraid share to 2nd unraid share it stalls out too the 4.5TB copy small copies seem fine but when you try to copy everything then it just craps itself it seems if i stop copying and restart the 4.5tb 1.6+ mil files i find it doesnt copy says it is the files keep running through the file names but nothing happening going to let it keep copyingg see if it catches up what it copied but since 7.3.1 things just seem a bit buggy here and there

i was usually have scripts update but i was doing a manual copy for a new share and i noticed i see now [sender] expand file_list pointer array to 4096 bytes, did move [sender] expand file_list pointer array to 1024 bytes, did move [sender] expand file_list pointer array to 4096 bytes, did move [sender] expand file_list pointer array to 16384 bytes, did move [sender] expand file_list pointer array to 32768 bytes, did move [sender] expand file_list pointer array to 65536 bytes, did not move [sender] expand file_list pointer array to 131072 bytes, did not move [sender] expand file_list pointer array to 262144 bytes, did move [sender] expand file_list pointer array to 524288 bytes, did move [sender] expand file_list pointer array to 1048576 bytes, did move [receiver] expand file_list pointer array to 524288 bytes, did move [generator] expand file_list pointer array to 524288 bytes, did moveor at end of the file says uptodate.. i find rsync locks up more now doesnt say incremently list i also got it hanging after 30 min run protocol incompatibility this is my code i use in a script i altered it for just command line test rsync -avzue ssh --exclude-from='/boot/config/plugins/user.scripts/scripts/exclude1.txt' --protect-args -avue ssh --stats --numeric-ids --progress '/mnt/user/Documents/' root@$serverip:'/mnt/user/Backup Files/Mikes Files/Documents/'so did things change? get more glitchty etc and or are some the rsync commands no longer used anymore?? and what is this sender, receiver, generator really meaning and this error constantly comes up after a while rsync error: protocol incompatibility (code 2) at receiver.c(358) [receiver=3.4.3] rsync: [sender] write error: Broken pipe (32) and if i keep running my command after so long it craps out with protocol data stream code 12 rsync error: error in rsync protocol data stream (code 12) at io.c(232) [generator=3.4.3] rsync: [sender] write error: Broken pipe (32) rsync error: error in rsync protocol data stream (code 12) at io.c(849) [sender=3.4.3] its like rysnc can no longer transfer 4 tb over 1 million files anymore its like it has a fit.. is there a way to fix it like it used to work fine since this is constantly broken and then the hard drives spin down and rysnc still running supposeldy saying uptodate or the other stuff and the drives arent even running and i running like less then 2 meg a sec copying has rsync busted in unraid 7.3.1 rsync error: protocol incompatibility (code 2) at receiver.c(358) [receiver=3.4.3] rsync: [sender] write error: Broken pipe (32)

@tshorts my repository is linuxserver/transmission you can try my setup minus the extra completed folder locations i made them 5 6 years ago or longer when i was learning transmission and the downlload location stuff

@tshorts i dont have a umask in the container maybe cuz i installed transmission like 5 6 years ago i only have UID GID so the 99 100 so i edited the transmission settings json and changed the umask in there so back then no umask in the container