March 20, 20197 yr 13 minutes ago, blaine07 said: 10G SFP+ DAC Cable – for Mikrotik... https://www.amazon.com/dp/B01M073OJU?ref=ppx_pop_mob_ap_share FWIW I am using one of these exact brands to link two Mikrotik switches together. Its too short for a run to my server. Do you know if the mikrotik brand works with Mellanox card? 17 minutes ago, johnnie.black said: SFP+ optics aren't always compatible with all devices, I can tell you for example that the Avago AFBR-700SDZ-QL transceiver works well with both the ConnectX-2 and X-3, but no idea if they work with the Mikrotik switch. I was afraid of this. swOS sees the transceiver just fine. Reports the correct brand, part number, serial, tx bias, power and rx power.
March 20, 20197 yr I was afraid of this. swOS sees the transceiver just fine. Reports the correct brand, part number, serial, tx bias, power and rx power. Unfortunately no idea. They do sell them in 7m lengths though I see
March 20, 20197 yr 2 minutes ago, blaine07 said: Unfortunately no idea. They do sell them in 7m lengths though I see Thanks for the input. Will reach out to the seller and see what he has to say. I have a feeling it's the Mellanox card.
March 20, 20197 yr Thanks for the input. Will reach out to the seller and see what he has to say. I have a feeling it's the Mellanox card. Sorry I can’t be of more help. I have noticed a oddity maybe related... ordered a SFP+ above I linked to and first go I ordered a 1 meter. Decided that was too long and ordered a 0.5 meter of same. I switched out the longer for short when it came as I am using them to link two of these switches at 10gb. I plugged second one in fiddling around and everything crashes. I can’t have both DACs plugged in on both switches or network goes down. No idea why. I unplug either end of either of two and normalcy resumes to network. If I have both DACs hooked up linking both switches it crashes. [emoji848] Id try ONLY one SFP+ port at a time and see if you get different results. I think I still have an issue though because no matter what on one of the switches the ACT/LINK light refuses to illuminate.
March 20, 20197 yr 1 minute ago, eds said: I have a feeling it's the Mellanox card. Pls also check does Mellanox active or not in Unraid. Pls provide screen dump of Unraid network setting and diagnostic.
March 20, 20197 yr I’ve been debating a ConnectX2/3 card for my Unraid server, hence my subscription here, to get a 10gb link to MikroTik switch and reading all this is making me second guess that potential choice lol.
March 20, 20197 yr 5 minutes ago, blaine07 said: Sorry I can’t be of more help. I have noticed a oddity maybe related... ordered a SFP+ above I linked to and first go I ordered a 1 meter. Decided that was too long and ordered a 0.5 meter of same. I switched out the longer for short when it came as I am using them to link two of these switches at 10gb. I plugged second one in fiddling around and everything crashes. I can’t have both DACs plugged in on both switches or network goes down. No idea why. I unplug either end of either of two and normalcy resumes to network. If I have both DACs hooked up linking both switches it crashes. Id try ONLY one SFP+ port at a time and see if you get different results. I think I still have an issue though because no matter what on one of the switches the ACT/LINK light refuses to illuminate. The help you have given me is great. Gives me ideas on the next way to go. Thanks. BTW, I get no lights on either the card or the switch when plugged in. Also, I thought of doing the one port at a time thing as well which is my current setup. I do not have it in sft port 1 tho, I have it in port 2 (for cable management purposes). Perhaps I will try moving to sfp port 1 and see if that is any difference. 8 minutes ago, Benson said: Pls also check does Mellanox active or not in Unraid. Pls provide screen dump of Unraid network setting and diagnostic. The card is visible on unraid. In fact, I can select it for my windows vm, as it appears available as a network nic. Attached are screen shots of network settings page. What do you need from the diagnostic?
March 22, 20197 yr Pls click "port up" on eth2, if you no need 3 NIC then config the 10G NIC be 1st or 2nd interface. Edited March 22, 20197 yr by Benson
March 22, 20197 yr 31 minutes ago, Benson said: Pls click "port up" on eth2, if you no need 3 NIC then config the 10G NIC be 1st or 2nd interface. Tried to enable the port but get the following message: Interface Ethernet Port 2 is down. Check cable!
March 22, 20197 yr Pls go to the Tools tab, click on the Diagnostics icon, then click on the Download button and post the zip file. I haven't Mellanox card nor Finisar SFP+, but different type NIC / SFP+ / Switch all work well in server side and switch side.
March 22, 20197 yr 9 hours ago, Benson said: Pls go to the Tools tab, click on the Diagnostics icon, then click on the Download button and post the zip file. I haven't Mellanox card nor Finisar SFP+, but different type NIC / SFP+ / Switch all work well in server side and switch side. Done. Thanks for your help. BTW, the screenshot you post looks exactly like mine with the finisar sfp+ transervers installed. unraid-diagnostics-20190322-1059.zip Edited March 22, 20197 yr by eds attachment
March 22, 20197 yr The NIC passthrough or used by VM (vfio-pci) ? 04:00.0 Ethernet controller [0200]: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:6750] (rev b0) Subsystem: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:0015] Kernel driver in use: vfio-pci Kernel modules: mlx4_core In, ethtool.txt, ifconfig.txt, no show of this NIC.
March 24, 20197 yr On 3/22/2019 at 12:06 PM, Benson said: The NIC passthrough or used by VM (vfio-pci) ? 04:00.0 Ethernet controller [0200]: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:6750] (rev b0) Subsystem: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] [15b3:0015] Kernel driver in use: vfio-pci Kernel modules: mlx4_core In, ethtool.txt, ifconfig.txt, no show of this NIC. It is selected in Window 7 vm, but does not see the nic as mellanox, but as a virtual adapter. On 3/22/2019 at 12:17 PM, Benson said: You also can ref. below post Will do. Also getting a new card to test as well.
March 27, 20197 yr Swapping out the Mellaonx card for another one worked! Router has lights. Card has lights and swOS shows the link as active 10G. For those interested - my motherboard sees the device as unknown, but unraid sees the card as Emulex Corporation OneConnect 10Gb NIC. The amazon seller no longer has the one I bought in stock, but this is the make and model. Thanks for your help guys. UPDATE: Looks like the seller I linked to is out of stock, but the card is a HP NC552SFP. I see a lot of them, used, on Ebay. Edited April 25, 20197 yr by eds update. removed dead link.
March 27, 20197 yr I have Emulex NIC too, model should be OCE10102, rather old but work with Unraid (no driver for Win10)
March 29, 20206 yr Author Over a year later and I've posted an update in the top post with my experience.
February 1, 20233 yr You know, I bricked my Mikrotik CRS305-1G-4S+IN while doing a FW update and no matter which recovery option I try, it seems fried. Mikrotik support is null. I read this thread and your problem looks similar to mine in some respects and am trying to deduce if your fix is my fix. Nonetheless, If you have a pointer on how to get this FW up again would be appreciated.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.