[SOLVED] Unraid slow intel nic throughput


Recommended Posts

Hi, 

 

Today I was doing a test using iperf and noticed how the upload speed from the server doesn't reach 1gb as opposed to the download. Is this happening to anyone else?

 

I set my server as the iperf server for this test. Also tried the speedtest docker and same results. 


Accepted connection from 172.16.1.66, port 59770
[  5] local 172.16.1.137 port 5201 connected to 172.16.1.66 port 59771
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-1.00   sec   106 MBytes   891 Mbits/sec
[  5]   1.00-2.00   sec   111 MBytes   930 Mbits/sec
[  5]   2.00-3.00   sec   111 MBytes   934 Mbits/sec
[  5]   3.00-4.00   sec   112 MBytes   938 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   938 Mbits/sec
[  5]   5.00-6.00   sec   112 MBytes   941 Mbits/sec
[  5]   6.00-7.00   sec   111 MBytes   935 Mbits/sec
[  5]   7.00-8.00   sec   112 MBytes   940 Mbits/sec
[  5]   8.00-9.00   sec   112 MBytes   942 Mbits/sec
[  5]   9.00-10.00  sec   111 MBytes   935 Mbits/sec
[  5]  10.00-10.04  sec  4.61 MBytes   938 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec                  sender
[  5]   0.00-10.04  sec  1.09 GBytes   932 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 172.16.1.66, port 59775
[  5] local 172.16.1.137 port 5201 connected to 172.16.1.66 port 59776
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  5]   0.00-1.00   sec  81.1 MBytes   680 Mbits/sec    0    248 KBytes
[  5]   1.00-2.00   sec  69.5 MBytes   583 Mbits/sec    0    248 KBytes
[  5]   2.00-3.00   sec  83.0 MBytes   696 Mbits/sec    0    248 KBytes
[  5]   3.00-4.00   sec  82.4 MBytes   691 Mbits/sec    0    248 KBytes
[  5]   4.00-5.00   sec  82.2 MBytes   689 Mbits/sec    0    248 KBytes
[  5]   5.00-6.00   sec  80.7 MBytes   677 Mbits/sec    0    245 KBytes
[  5]   6.00-7.00   sec  82.0 MBytes   688 Mbits/sec    0    248 KBytes
[  5]   7.00-8.00   sec  82.0 MBytes   688 Mbits/sec    0    245 KBytes
[  5]   8.00-9.00   sec  78.5 MBytes   658 Mbits/sec    0    245 KBytes
[  5]   9.00-10.00  sec  79.8 MBytes   669 Mbits/sec    0    248 KBytes
[  5]  10.00-10.04  sec  2.57 MBytes   566 Mbits/sec    0    248 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  5]   0.00-10.04  sec   804 MBytes   672 Mbits/sec    0             sender
[  5]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec                  receiver

 

 

Update----

Check for the tips and tweaks and disable Nic Offloading 
 

tower-diagnostics-20200619-2052.zip

Edited by gacpac
Link to comment

I did check with a different cable. Cat 6 certified monoprice 5ft. 

Also using a TPlink 5 port switch and everything goes to the Pfsense.

 

It's only the server having the issue, all the other devices are good. I'll try using a bootable ubuntu to take the server aside and get back to the forum if it helps. 

 

Link to comment
1 minute ago, johnnie.black said:

And if you bypass the Pfesens? Test server to desktop directly.

Well, from the networking standing. I'm not traversing any vlans from the unraid to my computer. Everything is on Vlan 1 default. Which, means it's already doing that. 

 

I'm in the same arp table

image.png.785eec139d089a7fb417a90a7afd8782.png

 

Link to comment
13 minutes ago, johnnie.black said:

That's not why I asked, it's just a way to rule out other things, but you do what you want.

Relax, look I just did it to probe your idea. I can send from my computer 172.16.1.138, directly connected using 1Gb. The replies from the server 172.16.1.137 come at 600Mb


C:\iPerf>iperf3.exe -c 172.16.1.137
Connecting to host 172.16.1.137, port 5201
[  4] local 172.16.1.138 port 64589 connected to 172.16.1.137 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   111 MBytes   928 Mbits/sec
[  4]   1.00-2.00   sec   110 MBytes   920 Mbits/sec
[  4]   2.00-3.00   sec   110 MBytes   927 Mbits/sec
[  4]   3.00-4.00   sec   111 MBytes   930 Mbits/sec
[  4]   4.00-5.00   sec   111 MBytes   927 Mbits/sec
[  4]   5.00-6.00   sec   110 MBytes   926 Mbits/sec
[  4]   6.00-7.00   sec   110 MBytes   924 Mbits/sec
[  4]   7.00-8.00   sec   110 MBytes   926 Mbits/sec
[  4]   8.00-9.00   sec   111 MBytes   931 Mbits/sec
[  4]   9.00-10.00  sec   111 MBytes   931 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.08 GBytes   927 Mbits/sec                  sender
[  4]   0.00-10.00  sec  1.08 GBytes   927 Mbits/sec                  receiver

iperf Done.

C:\iPerf>iperf3.exe -c 172.16.1.137 -R
Connecting to host 172.16.1.137, port 5201
Reverse mode, remote host 172.16.1.137 is sending
[  4] local 172.16.1.138 port 64594 connected to 172.16.1.137 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  73.0 MBytes   612 Mbits/sec
[  4]   1.00-2.00   sec  73.8 MBytes   619 Mbits/sec
[  4]   2.00-3.00   sec  72.0 MBytes   604 Mbits/sec
[  4]   3.00-4.00   sec  73.4 MBytes   616 Mbits/sec
[  4]   4.00-5.00   sec  74.5 MBytes   624 Mbits/sec
[  4]   5.00-6.00   sec  76.7 MBytes   644 Mbits/sec
[  4]   6.00-7.00   sec  77.0 MBytes   646 Mbits/sec
[  4]   7.00-8.00   sec  76.2 MBytes   639 Mbits/sec
[  4]   8.00-9.00   sec  76.6 MBytes   642 Mbits/sec
[  4]   9.00-10.00  sec  80.1 MBytes   673 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   755 MBytes   633 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   753 MBytes   632 Mbits/sec                  receiver

 

Link to comment
2 minutes ago, bonienl said:

Try different TCP window sizes (-w option), e.g. iperf3 -c 172.16.1.137 -w 5m -R

The bigger the window the less acknowledgements are required.

It might be your Windows machine not answering fast enough.

 

 

Thanks for the input. 

 

Just did that, but the result. I also did the test between the pfsense (I'm running an CPU G4400T with 4gb of ddr4 if you might ask) and the same result. 

 

I'm starting to think that it has to do with the lan drivers or maybe the mobo itself. 

I'm using an Asrock H110M-ITX/ac with a built in Giga PHY Intel® I219V

 

 

Link to comment
7 minutes ago, bonienl said:

To see if it is bandwidth constraint or not, run the iperf command with parallel streams (-P parameter), e.g. iperf3 -c 172.16.1.137 -P 2 -R

 

Man you are teaching me stuff here. Awesome! 

I ran the test and this is what I got, it looks similar speed that I've been getting. Also compared to the pfsense running iperf to my desktop and goods speeds there. 


C:\iPerf>iperf3.exe -c 172.16.1.137 -P 2 -R
Connecting to host 172.16.1.137, port 5201
Reverse mode, remote host 172.16.1.137 is sending
[  4] local 172.16.1.138 port 49945 connected to 172.16.1.137 port 5201
[  6] local 172.16.1.138 port 49946 connected to 172.16.1.137 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  37.4 MBytes   314 Mbits/sec
[  6]   0.00-1.00   sec  46.1 MBytes   386 Mbits/sec
[SUM]   0.00-1.00   sec  83.5 MBytes   700 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  33.1 MBytes   277 Mbits/sec
[  6]   1.00-2.00   sec  43.6 MBytes   366 Mbits/sec
[SUM]   1.00-2.00   sec  76.7 MBytes   643 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  34.5 MBytes   290 Mbits/sec
[  6]   2.00-3.00   sec  47.7 MBytes   400 Mbits/sec
[SUM]   2.00-3.00   sec  82.3 MBytes   690 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  35.2 MBytes   295 Mbits/sec
[  6]   3.00-4.00   sec  46.5 MBytes   390 Mbits/sec
[SUM]   3.00-4.00   sec  81.7 MBytes   685 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  38.6 MBytes   324 Mbits/sec
[  6]   4.00-5.00   sec  43.7 MBytes   367 Mbits/sec
[SUM]   4.00-5.00   sec  82.4 MBytes   691 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  34.2 MBytes   287 Mbits/sec
[  6]   5.00-6.00   sec  48.5 MBytes   407 Mbits/sec
[SUM]   5.00-6.00   sec  82.7 MBytes   694 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  31.8 MBytes   266 Mbits/sec
[  6]   6.00-7.00   sec  50.4 MBytes   423 Mbits/sec
[SUM]   6.00-7.00   sec  82.2 MBytes   689 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  35.6 MBytes   298 Mbits/sec
[  6]   7.00-8.00   sec  43.8 MBytes   368 Mbits/sec
[SUM]   7.00-8.00   sec  79.4 MBytes   666 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  36.7 MBytes   308 Mbits/sec
[  6]   8.00-9.00   sec  46.3 MBytes   388 Mbits/sec
[SUM]   8.00-9.00   sec  83.0 MBytes   696 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  35.6 MBytes   299 Mbits/sec
[  6]   9.00-10.00  sec  41.6 MBytes   350 Mbits/sec
[SUM]   9.00-10.00  sec  77.3 MBytes   649 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   354 MBytes   297 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   353 MBytes   296 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   460 MBytes   386 Mbits/sec    0             sender
[  6]   0.00-10.00  sec   459 MBytes   385 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   815 MBytes   684 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   811 MBytes   681 Mbits/sec                  receiver

iperf Done.

Link to comment

that's great a nic that I don't have right now. 

Before I get to purchasing a new nic card in this mini-itx board. Where else should I be looking?

I mean, I'm also going to boot a windows drive or ubuntu maybe to do a speedtest from there. I don't want to go down a rabbit hole. 

 

Link to comment

Omg!

 

thanks!!! Tips and tweaks solved the problem. I disabled the Nic Offloading, looks like it was the culprit

 

 

 

48 minutes ago, bonienl said:

You can try the "Tips and Tweaks" plugin, which allows to make some low level changes for the ethernet interface, nothing guaranteed though!

 

 

image.png

Edited by gacpac
Link to comment
  • JorgeB changed the title to [SOLVED] Unraid slow intel nic throughput

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.