crowdx42

Thank you, I tried it but did not have any effect. I guess because the system is already writing between 2 NVMe SSDs on Unraid and the Windows PC.

How do use memory cache for testing?

For the iPerf result I got above, I was using a Mellanox MCX311A with TP-Link SPF+ transceivers on both ends and connecting using a 25ft fiber cable. I also tried 10GTek transceivers with the same results. On FB, people said I might need to use Parrallel Threads of iperf to max the bandwidth, I am not sure how true that would be due to, if I directly connect the Unraid server to the Windows PC I get over 800MB/s. I have tried both the current TP-Link switch which is SFP+ ports only and I also tried a Mikrotik switch which has RJ45 and SFP+ on it and the results were the same.

Actually I believe it is a settings issue. I have swapped out the hardware for testing and I still get the same results. I think the issue could be related to SMB multi thread. iPerf is giving me 6.7gbps which is way faster than what I am seeing in uploads to Unraid. Unraid is running with defauly network settings other than some Jumbo frame testing I did which made no real difference.

So I know this thread is a little old but I am wondering if I can get some clarification. I have an NVMe SSD in both my Windows machine and also as a cache drive in UNRAID. With a 10g Cat6a connection I am getting around 400mbytes upload to Unraid. The weird part is with a SFP+ adapter using fiber in a different machine I am lucky to get 200mbytes. Both Windows machines are identical in specs, except for the RJ45 NIC is intel 540 and the SFP+ is Mellanox. When I do a direct connect between the Windows machine and Unraid I hit about 800mbytes. I have tried both a TP-Link 8 port 10g managed switch and also a Mikrotek 12 port managed switch, with the same results. Jumbo frames made little difference. Thoughts?

As a further update, I installed an Intel 540 T2 NIC in my livingroom PC yesterday and it is performing much better than the Mellanox in the Office PC. I have a Microtik switch arriving the middle of next week, and so I will be able to see how it performs with the Mellanox NICs. I am hoping to get 600 - 700 mbytes. The intel 540 is doing about 400mbytes, so over double what I am getting with the Mellanox. I also switched out the transceivers on the switch to TP-Link brand, hoping that there could be some sort of compatibility there, but it had no effect.

So I took the switch out of the equation and I hooked up to Unraid from the Windows PC directly and hit 800mbyts per sec, so there is either a setting in the switch or the switch is just not up to it. I may just order a Microtek switch and see how it works and return the TP-Link switch.

Yeah, Windows seems to be the issue, unless I have something wrong with Unraid which installing Linux would help eliminate OS issue, if there is one.

I hits maybe 220mbytes in Windows explorer dropping down to 180 or so over the transfer of an 8gb file. I am considering installing Linux to see what speeds I get with it.

Iperf3 is giving me 6gbps, the switch I have is TP-Link TL-SX3008F which when controlled by Omada (Ubiquiti software controller clone) it does not support Jumbo frames, only in standalone mode. Having said that, if I could get 6gbps in a transfer from Windows to Unraid, I would be more than happy with that. I did disable Windows Firewall and Virus scanner for testing and I get about 220mbytes in Windows, but that is still a long way off 600mbytes that iperf3 is reporting as what is possible between the two cards in standalone transfers.

As an update here, I did a fresh Windows 11 install and I think I have a 10gbe connection BUT it is slow, only about 200mbytes writing from an NVME SSD on Windows to an NVME SSD Cache drive on Unraid. I would think I should be getting much better speeds than that (both drives are capable of 5000mbs r/w . I found the issue with the internet speed was vpn related as the ip was using the vpn connection instead of bypassing it, which is normally what I do with my main desktop. Is there anything else I can check to figure out why the connection is so slow?

Hi all, so I just got two Mellanox MCX311A-XCAT CX311A 10gbe cards, I installed one in my Unraid server and the other in a Windows 11 machine. Unraid seems to be working fine. Both machines are connected via fiber to a TP-Link 10gbe switch, but the Windows 11 machine is not seeing the Unraid machine when it is using the 10gbe card (I disabled it's normal NIC). Windows 11 seems to have installed the drivers for the card correctly and it shows as a 10gbe NIC in the network section but when I run a speedtest it gives me really low numbers (200mbps vs normally 900mbps). Anyone got any idea why Windows 11 is not working correctly? Is there a better driver for Windows 11 that I should be using? Thanks for any help. Patrick

No problem. I actually do have a free 8x slot in most of my PCs, so I think it should work.

Dang, I missed your response and ordered a couple of these , I have contacted the eBay seller to see if I can cancel the order. Can you recommend a card that will work with PCIe 3.0?

From reading elsewhere, will these 10g NICs work for Unraid? I believe I see them as usable? Also, will they only support 10g OR will they drop to 2.5g if connected to a 2.5g switch? I have read that some cards/transceivers run either at 10g or else drop back to 1g? https://www.ebay.com/itm/125582366612?hash=item1d3d4ad794:g:TToAAOSwPZRjWjof&amdata=enc%3AAQAHAAABIEQlj2mC%2FIuOSkYHh1oK30SZwSGP9Re5%2FvDfSnNkdiK0rV3Q164hoGD4gT1%2BShOBzh%2BfO%2FK3uucB36zbf0ZE%2F4bi9NFgaM12n8RgyCrUm0wstvbtGyl7TY%2B%2B77%2FAIoXv%2FdEBvfipOUfV1TtBebZU3roew5%2BAjtiUtAlUPUcW4uSn66h4yeh5YEAZCGAvMhnw99EpKa%2B0n9vDkwPlxsjOPs%2Bf4LY4ayzrlDv1j9Rcg%2B6ZdLjX3eTsWBl%2Fm2w2URiIgjHVFTB9J1kQS8ifZmJOA2M2k507r8nsYCDMcC60dZvh75XVICHMfyVbHKtLUmx9UgGJGvc8%2B1CSmiPWmT7rheI0Joq88e6mVKNV2U3wZUSLW62LOtHzM8sj8RQfL4BM7A%3D%3D|tkp%3ABFBMxJeM3bdh