Transfer over 10 Gbps network far from maximum speed


vizi0n

Recommended Posts

Hello people of the internets,

 

I'm trying to fix a "slow" file transfer issue between my PC and my Unraid server. I have installed 10 GBps NICs in my computer and server (HP NC552SFP in Unraid, Intel X520-DA2 in PC), but I can  barely reach 300 MB/s when writing to the Unraid server and between 200 and 400 when reading from the server. Isn't the server supposed to write to RAM then cache to make it fast ? The PC has a WD Black NVME SSD, and the server is a R520 with dual Xeon 2430L, 32 GB ECC 1333mhz, HP 500GB SATA SSD connected to the PERC H710p Mini (converted to IT mode / LSI 2308-2 controller).

 

I did run Iperf3 tests between the PC and the server, and I'm getting ±9.2/9.4 Gbps of throughput so the network doesn't seem to be the issue. This was tested using the following command : iperf3 -c <machine> -P 5 -t 10 -b 10G

 

From Unraid to Windows

[SUM]   0.00-10.00  sec  10.7 GBytes  9.22 Gbits/sec    0             sender
[SUM]   0.00-10.00  sec  10.7 GBytes  9.21 Gbits/sec                  receiver

 

From Windows to Unraid

[SUM]   0.00-10.00  sec  11.0 GBytes  9.42 Gbits/sec                  sender
[SUM]   0.00-10.04  sec  11.0 GBytes  9.38 Gbits/sec                  receiver

 

I am taker for any advice/suggestion !

Link to comment
  • 3 weeks later...
On 12/27/2021 at 9:29 AM, JorgeB said:

Try using a disk share instead to test, user shares will always have some overhead, some systems it's a small difference, but it can also be huge.

Thanks for the suggestion.

 

I just did, and it more than doubled the speed.

 

This is to a user share

image.png.6a0387e64d99c097188f55a94a9f4cae.png

 

This is to a disk share:

image.png.357a91797d5ff97a4654a1703c365908.png

 

Why is it so different? What can I do to improve user share writes/read?

 

I've tried enabling Direct I/O but it didn't help, still around 300 MB/s for the same operation to a user share

Edited by vizi0n
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.