I need some network/unraid/hardware guru help. In my Unraid machine, I have this network card - Mellanox CX4121A MCX4121A-ACAT ConnectX-4 25Gigabit Ethernet Card PCI-E 3.0. It works great (but often will not connect at full speed), and it is connected via DAC to my Unifi Gateway Fiber UXG-Fiber (30W) into the 10G SFP+ port.

My main question is how and why Unraid chooses to drop the connection speed to 1 Gigabit vs. the 10Gig that it should be working. Often it will connect at 10,000 and stay there for weeks, but on restart it will randomly connect at 1,000. Based on some prior advice in the discord forum, I disabled the motherboard ethernet port, but something still is not working 100% correct. Any input or advice is appreciated.

For the past 3 restarts, it will not reconnect at 10,000.

You are likely to get better informed feedback if you attach your system’s diagnostics (with everything in the one zip file) to your next post in this thread. It is always a good idea when asking questions to supply your diagnostics so we can see details of your system, how you have things configured, and the current syslog.

Thanks, itimpi.

I have attached the diagnostics below.

unraid-diagnostics-20260201-1032.zip

Have you tried disabling bonding for the 10Gb card?

Well, I opened up quite the can of worms on this one. I was able to disable bonding.

This required disabling Docker.

Disabling VM and rebooting.

Then after rebooting, it was still connecting at only 1gb.

So I decided to upgrade the BIOS to see if something would in the updated BIOS would fix it.

I have a Gigabyte Z790 S WIFI DDR4.

The BIOS is here if anyone is interested (Z790 S WIFI DDR4 (Rev. 1.1/1.2) BIOS)

Well, after I rebooted, I got this error: "Secure Boot Violation" - Invalid signature detected. Check Secure Boot Policy in Setup,

so I did, and found that the option to disable secure boot was there but greyed out.

After trying multiple things, including downgrading bios back to F1 I kind of gave up and called customer support.

They suggested the following: Setting --> Misc --> Intel Platform Trust Technology (PTT) disable = Still no luck with being able to select/ change Secure boot setting. Also they asked if I had a GPU. (I did not as I was using onboard graphics).

They suggested that once I put in GPU it would be able to disable secure boot.

Finally found a working GPU in my parts bin and YAY. I was able to change this setting.

I updated BIOS to F7.

BUT.....

When it starts up the Press Del to enter Bios screen flashes then it instantly shuts down and reboots

The boot order is correct.

It sees the UNRAID boot USB flash drive.

I think something needs to be configured in the EFI settings, and I am stuck.

I tried to Restore Factory Keys.

When the UNRAID boot USB is unplugged the computer boots directly into BIOS

When its plugged in it instantly shuts down.

Again this UNRAID boot drive was working perfectly this morning Nothing has been changed on the physical drive.

I looked into the guides here to see if anything was wrong, and so far, I really can't see what I am doing wrong.

Boot & startup failures | Unraid Docs

When your Unraid server fails to start correctly, it can be challenging to identify the cause without a clear understanding of the boot process. Following this guide lets you quickly diagnose and reso

Create your bootable media | Unraid Docs

Unraid OS is installed on a USB flash drive, which acts as the boot device for your server. You can create this bootable media using our recommended Automated install method with our USB Flash Creator

Any help is appreciated!

Edited February 5Feb 5 by Darkoptix

Went through all these steps: Net result is no difference in how it boots ie with the new drive it instantly shuts down the same as the previously working boot USB drive.

Boot failure

When your server won't start, systematic troubleshooting helps identify and resolve the root cause quickly. Follow these steps in order to avoid missing critical issues or making unnecessary changes. Each step builds on the previous one, so don't skip ahead even if a step seems unrelated to your specific problem.

1. Use a USB 2.0 port for the flash device if possible. It's generally more reliable and less prone to issues than USB 3.0.

2. Check your BIOS/UEFI settings to ensure that the flash device is set as the primary boot device.

3. Inspect the flash device for any physical or logical errors on a Windows or macOS computer.

4. Re-extract the Unraid release bz* files onto the flash device to prevent any potential corruption.

5. Rebuild the flash device by starting with a clean Unraid copy, then restore your config folder.

6. Try booting in Safe Mode to check for any plugin-related problems.

7. Test with a new flash device and perform a clean Unraid installation. This helps determine if there are issues with the server hardware.

8. If necessary, transfer your license to a new flash device.

Search your BIOS for a setting to disallow downgrades. The new Signatures from Microsoft (yeah! dont blame me! it is UEFI) REQUIRE that this must be set (aka: you cannot downgrade BIOS anymore!).

Then install the LATEST BIOS (yeah again, the one that broke everything).

Together they hopefully now boot the UNRAID stick.

(This all has nothing to do with UNRAID or the stick. It is because old Signatures from Microsoft are running out and if not updated properly, the machine will not boot ANYTHING anymore. If you run Windows (11) the updates were automatically be done already (yeah! Microsoft CAN flash your BIOS without notice or asking for!), with Linux like UNRAID the update is manually. And the time for updates is already running out soon. If you wait too long, the board is just a brick and you can throw it away)

And for your "sometimes 1G only" Problem: There is a chance that the DAC cable you are using might be incompatible with the LAN card. Check the manuals or try different cable/modules. (it might also be possible that autonegotiation with your switch does not work properly. Try to set 10G as a fixed rate)

Edited February 6Feb 6 by MAM59

12 hours ago, MAM59 said:

Search your BIOS for a setting to disallow downgrades. The new Signatures from Microsoft (yeah! dont blame me! it is UEFI) REQUIRE that this must be set (aka: you cannot downgrade BIOS anymore!).

Then install the LATEST BIOS (yeah again, the one that broke everything).

Together they hopefully now boot the UNRAID stick.

(This all has nothing to do with UNRAID or the stick. It is because old Signatures from Microsoft are running out and if not updated properly, the machine will not boot ANYTHING anymore. If you run Windows (11) the updates were automatically be done already (yeah! Microsoft CAN flash your BIOS without notice or asking for!), with Linux like UNRAID the update is manually. And the time for updates is already running out soon. If you wait too long, the board is just a brick and you can throw it away)

And for your "sometimes 1G only" Problem: There is a chance that the DAC cable you are using might be incompatible with the LAN card. Check the manuals or try different cable/modules. (it might also be possible that autonegotiation with your switch does not work properly. Try to set 10G as a fixed rate)

If I install Windows 11 and then perform all upgrades, will it fix the bios, allow me to secure boot, and then, if I disable secure boot, allow me to boot UNRAID?

10 minutes ago, Darkoptix said:

If I install Windows 11 and then perform all upgrades, will it fix the bios, allow me to secure boot, and then, if I disable secure boot, allow me to boot UNRAID?

This depends. Not all boards allow windows automatic updates.

But its not needed too if you update the BIOS manually. The newest version should already contain the new certificates.

But DO NOT DISABLE secure boot! it wont work then.

Activate it (and use UNRAID in UEFI mode by renaming "EFI-" on to stick to "EFI" if it is not done yet already) and set the OS type to boot to "other OS" (not "Windows").

This should work and boot fine.

6 minutes ago, MAM59 said:

This depends. Not all boards allow windows automatic updates.

But its not needed too if you update the BIOS manually. The newest version should already contain the new certificates.

But DO NOT DISABLE secure boot! it wont work then.

Activate it (and use UNRAID in UEFI mode by renaming "EFI-" on to stick to "EFI" if it is not done yet already) and set the OS type to boot to "other OS" (not "Windows").

This should work and boot fine.

You have been a great help. I will try this tonight when I get home. I seem to kind of be stuck in limbo where secure boot is disabled, and not wanting to turn back on. I am able to get to the most current BIOS version, F7. I need to find the correct series of commands to enable secure boot as you mentioned. You can see there are many settings regarding the keys and I dont know what to do here. I might end up calling Gigabyte support and see if they can walk me through it.

hmm, seems that you do not have "other os" but need to enroll the bootx64.efi manually.

Sounds like your BIOS does not use standard keys but only accepts boot files that have been enrolled before.

Never seen this before but it may be a good idea to overcome the microsoft s@$t someday.

try it out

I fixed it!!!!!!!! OMG that was brutal! I literally have spent all my spare time the past 4 days troubleshooting. Trying every combination under the sun. then ChatGPT FTW. https://chatgpt.com/share/6988db10-f0bc-800d-a3d3-7858f60083a6

it would be helpful for others to know WHICH one of the list really helped.. !?!?!

(some advices sound utterly stupid, but then, it came from an AI, what could we expect?)

Also, if it was one with "switch UEFI mode off", be aware that soon "Legacy Mode" will disappear from the BIOS and UEFI will be the only choice available. So it might be better to get it to run now already. If you forget about it and update someday you may be locked out by the machine...

Anyway, the detour is closed, now back to your orginal LAN problem...

Edited February 9Feb 9 by MAM59

Yes in case I was not clear about the BIOS fix. Over the past 4 days I have tried nearly every combination of SECURE boot ON vs OFF and I swear I have even done the actual solution at least a few times in my over 150 reboots.

Step #1 was actually the solution. I am not sure if the CMOS battery removal for 30 minutes, shorting the CMOS jumpers etc was necessary as I did those before the actual fix that worked.

Windows 10 Features = Other OS

CSM = Enabled

LAN PXE Boot Option ROM = Enabled

Storage Boot Option Control = Legacy

Other PCI devices = UEFI

I took pictures of almost all my BIOS settings; I will try to update them in case it helps anyone. To this post, the actual settings that worked

Edited February 9Feb 9 by Darkoptix

All the BIOS settings are here incuding the USB settings.

Back to the network speed problem (could not even turn my computer on much less load UNRAID for the past 5 days haha).

I am going to try the following.

1. Yesterday ordered a OEM Mellanox MCX312C-XCCT Dual Port 10GB SFP+ ConnectX-3 Net/Adapter High Profil

2. I tried a different DAC cable (no difference)

3. I ordered a fiber cable because supposedly, copper is not as good at allowing the Mellanox to down regulate the speed.

Note again that the card you have ordered needs a "real" PCIe 8x slot with all lanes attached!

These are usually server cards and most consumer motherboards have no slot for it (the 16x slot for the graphics card will work, but then, only buildin IGPU graphics).

There maybe slots that can physically take the card, but usually they are electrically castrated and only contain 2 or 4 lanes. Consult your manual!!!

If put into a wrong slot the card may either not work at all or slowdown like hell...

(Note that there is also a 4x Version of the card available, this may work better in consumer boards)

DAC cables usually work unless they are too long. Everything >3m is tricky. The longer cables usually are called "active", they contain amplifiers.

Your explicit BIOS settings are nice work, but usually useless for others unless they have the same board with the same bios. The manufactures of the BIOS often use their specific names so that some settings are not directly transportable.

You talk about "CSM enable" but your screenshot shows "disabled" ??? (and many other points also differ between your text and your screenshots)

(which is fairly better because CSM is a transition technology and will disappear soon)

Anyway, if it boots now, its ok. Once the OS is booted and takes over, all stuff will be renewed and fixed...

Edited February 10Feb 10 by MAM59

I tried Mellanox MCX312C-XCCT and the motherboard does not recognize it at all.

You are correct that the current Mellanox is not supported at full speed. I saw a line in the unraid boot up script and it appears to work up to about 8 gigs which is fine since I only have 2 gig interenet.

Does not appear that there are many or any options that are full 10 Gbps on 4_1 slots.

Interesting

11 minutes ago, Darkoptix said:

I tried Mellanox MCX312C-XCCT and the motherboard does not recognize it at all.

I was afraid that you do not have an apropriate slot for it...

12 minutes ago, Darkoptix said:

Does not appear that there are many or any options that are full 10 Gbps on 4_1 slots.

There will be NO options I think. the 8gigs you have seen, are PCIe Speed only. Not LAN speed. But with one lane only the cards can never deliver full 10G. Older cards wont work at all (like the MCX312C you have tested), newer cards contain brighte switches that can step down, but of course the maximum line speed cannot be gained with them.

Your original approach with 2*25G was really bold and naive I think :-)

(unless you through out the graphics card)

Haha yeah, even though I have decades of computer tinkering experience, I am pretty new to Unraid and have only had an Unraid system x under a year.

Happy right now that its working at 10gb even if it is a bottlenecked 10gb. Most of my network is 2.5gb so as long as its faster than any other bottlnecks I am happy.

Especially since it worked in the past for 8 months it did not raise any flags. ie with the Mellanox 3, it was instantly obvious it did not work at all.

Worse case I can just put an intel 2.5gig PCI NIC in there and be happy with that if this Mellanox 4 keeps stepping down in speed.

this has nothing to do with unraid, its just about the limits of your hardware.

BTW: before you through the M4 away, send it to me (just kidding :-) ). I still have only M3 at work, but at full speed...

Haha, yeah, I know what you are saying. I guess I should say/clarify I am really new to network speeds higher than 1gb.

Well dang it, my speed dropped again, so I will have to consider other NIC.

I have my HSA card plugged into the graphics slot and its working so I am not going to mess with that or move it since there will probably be the same limitations.