Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Intel X540-AT2 10-Gigabit issue

Featured Replies

Hi All,

 

I have purchased an Intel X540-AT2 dual port 10Gbe card to replace the motherboard 2.5Gbe network card.

 

Installed and working but i have some odd things happening:

 

Copy a 10GB file from Windows to Unraid i get the full 10Gb speed, but copy any file from the array, or cache to Windows PC am capped at 230mb/s any ideas ?

 

Windows 11:

  • Intel i7 12700K
  • 32GB 3600 DDR RAM
  • 1TB SN850 
  • TP-Link 10 Gigabit PCI Express Network Adapter

Unraid:

  • Intel i5-2500
  • 48GB 3200 DDR4 RAM
  • NVME cache pool 1 -  2x 1TB WDC_WDS100T2B0C in btrfs mirror
  • SATA cache pool 2 - 3x 1TB WDC_WDS100T1R0A in zfs array
  • Intel X540-AT2 dual port 10Gbe connecting in the main PCIex16 Gen4 slot.
    • Port 1 - 1gb switch connection - DHCP from router
    • Port 2 - static ip to WIndows 10GB card

 

Thanks,

Andy

  • Community Expert

I would suggest doing an iperf3 test in both directions to see if there is any network issue.

  • Author

Unraid as the client:

 

root@Obsidian:~# iperf3 -c 192.168.10.1
Connecting to host 192.168.10.1, port 5201
[  5] local 192.168.10.100 port 47914 connected to 192.168.10.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   238 MBytes  2.00 Gbits/sec    0    283 KBytes       
[  5]   1.00-2.00   sec   234 MBytes  1.96 Gbits/sec    0    294 KBytes       
[  5]   2.00-3.00   sec   240 MBytes  2.01 Gbits/sec    0    286 KBytes       
[  5]   3.00-4.00   sec   247 MBytes  2.07 Gbits/sec    0    311 KBytes       
[  5]   4.00-5.00   sec   251 MBytes  2.10 Gbits/sec    0    297 KBytes       
[  5]   5.00-6.00   sec   268 MBytes  2.25 Gbits/sec    0    277 KBytes       
[  5]   6.00-7.00   sec   261 MBytes  2.19 Gbits/sec    0    288 KBytes       
[  5]   7.00-8.00   sec   259 MBytes  2.17 Gbits/sec    0    280 KBytes       
[  5]   8.00-9.00   sec   245 MBytes  2.05 Gbits/sec    0    272 KBytes       
[  5]   9.00-10.00  sec   257 MBytes  2.15 Gbits/sec    0    277 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  2.44 GBytes  2.10 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  2.44 GBytes  2.09 Gbits/sec                  receiver

 

Unraid as the server:

 

-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 192.168.10.1, port 60681
[  5] local 192.168.10.100 port 5201 connected to 192.168.10.1 port 60682
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.01 GBytes  8.68 Gbits/sec                  
[  5]   1.00-2.00   sec  1.01 GBytes  8.67 Gbits/sec                  
[  5]   2.00-3.00   sec  1.01 GBytes  8.66 Gbits/sec                  
[  5]   3.00-4.00   sec  1.00 GBytes  8.61 Gbits/sec                  
[  5]   4.00-5.00   sec  1.00 GBytes  8.61 Gbits/sec                  
[  5]   5.00-6.00   sec  1.02 GBytes  8.76 Gbits/sec                  
[  5]   6.00-7.00   sec  1.01 GBytes  8.69 Gbits/sec                  
[  5]   7.00-8.00   sec  1.01 GBytes  8.69 Gbits/sec                  
[  5]   8.00-9.00   sec  1.01 GBytes  8.65 Gbits/sec                  
[  5]   9.00-10.00  sec  1.00 GBytes  8.63 Gbits/sec                  
[  5]  10.00-10.00  sec  4.78 MBytes  8.51 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  10.1 GBytes  8.67 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201 (test #2)
-----------------------------------------------------------

 

  • Author

Cable is 3m CAT6A also tested 3M CAT6 and CAT5E cable same result.

  • Community Expert

That definitely looks like a network issue as you would expect an iperf3 test to give the same results in both directions.   What can cause the different speeds depending on direction I have no idea I am afraid.

  • Author

OK, so turned on Jumbo Packet to 9014 and set the unraid MUT to 9000 and get the following:

 

Unraid Client

 

root@Obsidian:~# iperf3 -c 192.168.10.1
Connecting to host 192.168.10.1, port 5201
[  5] local 192.168.10.100 port 55066 connected to 192.168.10.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   879 MBytes  7.37 Gbits/sec    0    489 KBytes       
[  5]   1.00-2.00   sec   875 MBytes  7.34 Gbits/sec    0    437 KBytes       
[  5]   2.00-3.00   sec   878 MBytes  7.36 Gbits/sec    0    437 KBytes       
[  5]   3.00-4.00   sec   886 MBytes  7.43 Gbits/sec    0    454 KBytes       
[  5]   4.00-5.00   sec   879 MBytes  7.37 Gbits/sec    0    454 KBytes       
[  5]   5.00-6.00   sec   882 MBytes  7.40 Gbits/sec    0    489 KBytes       
[  5]   6.00-7.00   sec   883 MBytes  7.41 Gbits/sec    0    437 KBytes       
[  5]   7.00-8.00   sec   860 MBytes  7.22 Gbits/sec    0    454 KBytes       
[  5]   8.00-9.00   sec   877 MBytes  7.36 Gbits/sec    0    507 KBytes       
[  5]   9.00-10.00  sec   882 MBytes  7.39 Gbits/sec    0    437 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  8.57 GBytes  7.37 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  8.57 GBytes  7.36 Gbits/sec                  receiver

 

Unraid Server:

 

-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 192.168.10.1, port 62206
[  5] local 192.168.10.100 port 5201 connected to 192.168.10.1 port 62207
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   945 MBytes  7.93 Gbits/sec                  
[  5]   1.00-2.00   sec   948 MBytes  7.95 Gbits/sec                  
[  5]   2.00-3.00   sec   952 MBytes  7.98 Gbits/sec                  
[  5]   3.00-4.00   sec   954 MBytes  8.00 Gbits/sec                  
[  5]   4.00-5.00   sec   954 MBytes  8.00 Gbits/sec                  
[  5]   5.00-6.00   sec   960 MBytes  8.05 Gbits/sec                  
[  5]   6.00-7.00   sec   956 MBytes  8.02 Gbits/sec                  
[  5]   7.00-8.00   sec   950 MBytes  7.97 Gbits/sec                  
[  5]   8.00-9.00   sec   958 MBytes  8.03 Gbits/sec                  
[  5]   9.00-10.00  sec   951 MBytes  7.98 Gbits/sec                  
[  5]  10.00-10.00  sec  3.38 MBytes  7.92 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  9.31 GBytes  7.99 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201 (test #2)
-----------------------------------------------------------

 

not sure why this worked as i thought jumbo packets are normally not required.

 

Maybe the issue is the TP-Link 10GB card in the windows 11 pc as it is a Marvell AQtion 10Gbit??? or the Intel X540-AT2 NIC has an issue? wrong firmware... (not sure how i would check).

 

  • Community Expert

Try adding parallel streams.  

iperf3 -c 192.168.10.1 -P 10

 

  • Community Expert
8 hours ago, Fluxonium said:

not sure why this worked as i thought jumbo packets are normally not required.

 

They should not be, and often cause problems.

 

Your initial results suggest at that point you might be getting a 10Gb link in one direction and something like 2.5Gb in the other.

  • Author

Hi All, 

 

Thanks for your suggestions, I have ordered another Intel X540-T2 adapter (this time Dell, instead of HP) from eBay. This will allow me to rule out the TP-Link card and test the HP  Intel X540-T2 adapter. 

 

Maybe I have a broken / half working NIC??? I have found a few post online regarding the Marvell AQtion 10Gbit which is in the TP-Link.

  • 6 months later...

Hi Andy. Just wondered if you managed to resolve this issue?

 

I am about to stick a DELL OEM Intel x540-T2 into my unraid server and am looking for any hints and tips - hence I stumbled on this forum post. Any info would be greatly appreciated.

 

FWIW, my card has been tested in a Windows 11 box (using driver package 26.50, driver v4.1.197.0) and has firmware 18.0.0 currently installed. Using the Dell DUP tool, it tells me I can upgrade to fw 20.0.16...but have not done so yet as I can get a 10G connection from the card to my 10G switch. I might update firmware if i run into issues or find something that tells me i need to upgrade it.

 

thanks

  • 1 year later...

A bit late.... and a stale topic.

But I guess your array is spinning disc's? Then that speed would be the max read.

What I would like to know is, do the cards work fine or did you have any problems during the time you are using them now?

By default, network interfaces are bridged with outbound traffic going out the first interface. This is one of the oddities of UnRAID. You don't want them bridged, you want them separate and then normal linux networking will happen with traffic following routing.

The way you are configured right now all traffic is exiting the first NIC and has a 2.5 GB limit somewhere in the path to the windows box.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.