Fluxonium Posted April 17 Share Posted April 17 Hi All, I have purchased an Intel X540-AT2 dual port 10Gbe card to replace the motherboard 2.5Gbe network card. Installed and working but i have some odd things happening: Copy a 10GB file from Windows to Unraid i get the full 10Gb speed, but copy any file from the array, or cache to Windows PC am capped at 230mb/s any ideas ? Windows 11: Intel i7 12700K 32GB 3600 DDR RAM 1TB SN850 TP-Link 10 Gigabit PCI Express Network Adapter Unraid: Intel i5-2500 48GB 3200 DDR4 RAM NVME cache pool 1 - 2x 1TB WDC_WDS100T2B0C in btrfs mirror SATA cache pool 2 - 3x 1TB WDC_WDS100T1R0A in zfs array Intel X540-AT2 dual port 10Gbe connecting in the main PCIex16 Gen4 slot. Port 1 - 1gb switch connection - DHCP from router Port 2 - static ip to WIndows 10GB card Thanks, Andy Quote Link to comment
itimpi Posted April 17 Share Posted April 17 I would suggest doing an iperf3 test in both directions to see if there is any network issue. Quote Link to comment
Fluxonium Posted April 17 Author Share Posted April 17 Unraid as the client: root@Obsidian:~# iperf3 -c 192.168.10.1 Connecting to host 192.168.10.1, port 5201 [ 5] local 192.168.10.100 port 47914 connected to 192.168.10.1 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 238 MBytes 2.00 Gbits/sec 0 283 KBytes [ 5] 1.00-2.00 sec 234 MBytes 1.96 Gbits/sec 0 294 KBytes [ 5] 2.00-3.00 sec 240 MBytes 2.01 Gbits/sec 0 286 KBytes [ 5] 3.00-4.00 sec 247 MBytes 2.07 Gbits/sec 0 311 KBytes [ 5] 4.00-5.00 sec 251 MBytes 2.10 Gbits/sec 0 297 KBytes [ 5] 5.00-6.00 sec 268 MBytes 2.25 Gbits/sec 0 277 KBytes [ 5] 6.00-7.00 sec 261 MBytes 2.19 Gbits/sec 0 288 KBytes [ 5] 7.00-8.00 sec 259 MBytes 2.17 Gbits/sec 0 280 KBytes [ 5] 8.00-9.00 sec 245 MBytes 2.05 Gbits/sec 0 272 KBytes [ 5] 9.00-10.00 sec 257 MBytes 2.15 Gbits/sec 0 277 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 2.44 GBytes 2.10 Gbits/sec 0 sender [ 5] 0.00-10.00 sec 2.44 GBytes 2.09 Gbits/sec receiver Unraid as the server: ----------------------------------------------------------- Server listening on 5201 (test #1) ----------------------------------------------------------- Accepted connection from 192.168.10.1, port 60681 [ 5] local 192.168.10.100 port 5201 connected to 192.168.10.1 port 60682 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 1.01 GBytes 8.68 Gbits/sec [ 5] 1.00-2.00 sec 1.01 GBytes 8.67 Gbits/sec [ 5] 2.00-3.00 sec 1.01 GBytes 8.66 Gbits/sec [ 5] 3.00-4.00 sec 1.00 GBytes 8.61 Gbits/sec [ 5] 4.00-5.00 sec 1.00 GBytes 8.61 Gbits/sec [ 5] 5.00-6.00 sec 1.02 GBytes 8.76 Gbits/sec [ 5] 6.00-7.00 sec 1.01 GBytes 8.69 Gbits/sec [ 5] 7.00-8.00 sec 1.01 GBytes 8.69 Gbits/sec [ 5] 8.00-9.00 sec 1.01 GBytes 8.65 Gbits/sec [ 5] 9.00-10.00 sec 1.00 GBytes 8.63 Gbits/sec [ 5] 10.00-10.00 sec 4.78 MBytes 8.51 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 10.1 GBytes 8.67 Gbits/sec receiver ----------------------------------------------------------- Server listening on 5201 (test #2) ----------------------------------------------------------- Quote Link to comment
Fluxonium Posted April 17 Author Share Posted April 17 Cable is 3m CAT6A also tested 3M CAT6 and CAT5E cable same result. Quote Link to comment
itimpi Posted April 17 Share Posted April 17 That definitely looks like a network issue as you would expect an iperf3 test to give the same results in both directions. What can cause the different speeds depending on direction I have no idea I am afraid. Quote Link to comment
Fluxonium Posted April 17 Author Share Posted April 17 OK, so turned on Jumbo Packet to 9014 and set the unraid MUT to 9000 and get the following: Unraid Client root@Obsidian:~# iperf3 -c 192.168.10.1 Connecting to host 192.168.10.1, port 5201 [ 5] local 192.168.10.100 port 55066 connected to 192.168.10.1 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 879 MBytes 7.37 Gbits/sec 0 489 KBytes [ 5] 1.00-2.00 sec 875 MBytes 7.34 Gbits/sec 0 437 KBytes [ 5] 2.00-3.00 sec 878 MBytes 7.36 Gbits/sec 0 437 KBytes [ 5] 3.00-4.00 sec 886 MBytes 7.43 Gbits/sec 0 454 KBytes [ 5] 4.00-5.00 sec 879 MBytes 7.37 Gbits/sec 0 454 KBytes [ 5] 5.00-6.00 sec 882 MBytes 7.40 Gbits/sec 0 489 KBytes [ 5] 6.00-7.00 sec 883 MBytes 7.41 Gbits/sec 0 437 KBytes [ 5] 7.00-8.00 sec 860 MBytes 7.22 Gbits/sec 0 454 KBytes [ 5] 8.00-9.00 sec 877 MBytes 7.36 Gbits/sec 0 507 KBytes [ 5] 9.00-10.00 sec 882 MBytes 7.39 Gbits/sec 0 437 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 8.57 GBytes 7.37 Gbits/sec 0 sender [ 5] 0.00-10.00 sec 8.57 GBytes 7.36 Gbits/sec receiver Unraid Server: ----------------------------------------------------------- Server listening on 5201 (test #1) ----------------------------------------------------------- Accepted connection from 192.168.10.1, port 62206 [ 5] local 192.168.10.100 port 5201 connected to 192.168.10.1 port 62207 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 945 MBytes 7.93 Gbits/sec [ 5] 1.00-2.00 sec 948 MBytes 7.95 Gbits/sec [ 5] 2.00-3.00 sec 952 MBytes 7.98 Gbits/sec [ 5] 3.00-4.00 sec 954 MBytes 8.00 Gbits/sec [ 5] 4.00-5.00 sec 954 MBytes 8.00 Gbits/sec [ 5] 5.00-6.00 sec 960 MBytes 8.05 Gbits/sec [ 5] 6.00-7.00 sec 956 MBytes 8.02 Gbits/sec [ 5] 7.00-8.00 sec 950 MBytes 7.97 Gbits/sec [ 5] 8.00-9.00 sec 958 MBytes 8.03 Gbits/sec [ 5] 9.00-10.00 sec 951 MBytes 7.98 Gbits/sec [ 5] 10.00-10.00 sec 3.38 MBytes 7.92 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 9.31 GBytes 7.99 Gbits/sec receiver ----------------------------------------------------------- Server listening on 5201 (test #2) ----------------------------------------------------------- not sure why this worked as i thought jumbo packets are normally not required. Maybe the issue is the TP-Link 10GB card in the windows 11 pc as it is a Marvell AQtion 10Gbit??? or the Intel X540-AT2 NIC has an issue? wrong firmware... (not sure how i would check). Quote Link to comment
Veah Posted April 18 Share Posted April 18 Try adding parallel streams. iperf3 -c 192.168.10.1 -P 10 Quote Link to comment
itimpi Posted April 18 Share Posted April 18 8 hours ago, Fluxonium said: not sure why this worked as i thought jumbo packets are normally not required. They should not be, and often cause problems. Your initial results suggest at that point you might be getting a 10Gb link in one direction and something like 2.5Gb in the other. Quote Link to comment
Fluxonium Posted April 18 Author Share Posted April 18 Hi All, Thanks for your suggestions, I have ordered another Intel X540-T2 adapter (this time Dell, instead of HP) from eBay. This will allow me to rule out the TP-Link card and test the HP Intel X540-T2 adapter. Maybe I have a broken / half working NIC??? I have found a few post online regarding the Marvell AQtion 10Gbit which is in the TP-Link. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.