I have a very odd issue where my downloads via either wget or rsync from internet sources AND to my array are only having speeds of approximately 14MB/s, where in other cases I am able to write to the array at either full speed or the near full speed of my ISP download.
When speed is only approximately 14MB/s:
- I'm writing to array via rsync or wget (internet sources) to path for example /mnt/user/isos
When speed is full, either ISP download 85MB/s, or full spinny HDD speeds at average 125MB/s:
- I'm writing directly to HDD spinny disks via rsync or wget (internet sources) to paths for example /mnt/disk1/isos /mnt/disk2/isos and so on
- I'm writing directly to NVMe cache via rsync or wget (internet sources) to path for example /mnt/cache/downloads
- I'm writing to array via rsync (LOCAL source) from example /mnt/user/isos/ubuntu.iso to /mnt/user/isos/linux/ubuntu.iso
In short, it seems I can only get approximately 14MB/s speeds when the following two conditions exist: source data is from internet AND the destination is within the array
Additional note: The cases above where I was able to still get full speeds (non array destinations) form internet sources, I used same download file source so I don't think peering is in play here, seems its specifically the array and internet sources via rsync and wget
rsync command I'm using with flags is as follows:
rsync -aHAXxv --numeric-ids --info=progress2 --chmod=D0777,F0666 --bwlimit=85M
Diagnostics is attached, and was created while I was attempting the rsync from internet source which only runs at maximum of 14MB/s
Any help on this is greatly appreciated as I need to transfer 50+TB of data via rsync from my offsite server to my local unraid server, and the 70MB/s or so difference is going to make a world of a difference for me
tower-diagnostics-20230913-2209.zip