Hello,
I've been wondering for some time what to do, to speed up transfers in my network.

 

I have a 10Gb connection to my unraid server and when I copy large files from Windows 11 to the server (I have an SSD cache there) I can easily achieve speeds of around 4 to 5 Gb\s and this is super sufficient for me.

But when I need to copy a few TB of photos, the transfers oscillate around 50-100 Mb\s.

 

This is terribly slow...

 And such transfers take a day or more.

(of course, I also have NVME drives in my computer)

 

When copying to an external USB 3.2 drive, it copies around 1GB\s without a problem, thanks to which the process takes maybe an hour.

 

Is there anything I can do or set so that these speeds come close to at least 1Gb\s?

I also guess that this may be due to the lacks in  SMB protocol, or due to some network latency?

Then  maybe there is some tool I could use to copy this small files to my shares?

 

 

If I don't ask I won't know

Using an exclusive share (or disk share) should give a good boost.

Hi,

Thanks for the warp speed reply as usual!
 

I tried to do that (Disk share) but the gain was very small 30%? Of course 70-120Mb/s is an improvement but it does not have the effect of 2-3x (or even better 10x) 

Small files will never be as fast as large files, no way around that, the smaller they are, the slower it will be.

Too bad,

 I was hoping that there is some method that would allow you to connect the disk as if it were a "local" disk (I don't mean the type of mapping) so that the speed would be limited only by the maximum network speed.
 The strangest thing is that it goes through a flash disk, so its speeds are huge and it has a super fast access time. All these disks mounted locally without the network can copy these files in the blink of an eye.
 The question arises why make a NAS from only flash disks? Since you won't feel the difference from a NAS made of regular HDD disks with SSD cache (assuming that someone uses files smaller than 100MB)

 

Maybe I can use a different type of network than 10Gb Lan?

Edited January 27, 20251 yr by Dragonovx

Smaller files always will be slower because it takes the same time to update directories and so on for all sizes.

 

For a single 100G file this time is only needed once, but for 10000 100k files it takes 10000 times. This sums up really badly.

 

The LAN needs to be pessimistic, it has to wait until the file is handled completely before it can move on to the next one.

This is partly untrue for local disks because OS' make use of a "write cache" in RAM. This saves unnecessary writes to the disks with the risk of a file system corruption if a power outage happens. So it is a risky and delicate thing. LANs are very conservative because there is no way to recover or to know how the other box is currently doing.

 

So, there is nothing you can do.

 

 

Edited January 28, 20251 yr by MAM59