binaryhellstorm

Trying to get 10GBe networking set up on my server and running into some bizarre issues. Prior setup that worked was both of the motherboard NICS connected via 1gb, in a bonded setup with bridging. Installed a Mellanox dual SFP card, unRAID sees it no issue, it's connected to my switch with a DAC cable. I went in, set it as my primary IP and eth0 and disabled bonding, in network settings, left one of the 1gb cards enabled with no bonding or bridging and a different IP as my "Oh crap" card in case I needed to get back in. Which I'm glad I did. The only way I've been able to get this to work is with VM manager disabled, I can get 10GBs (or near enough) as measured via iPerf running in docker. As soon as enable VM manager it kills the 10GB link. I have to plug in the 1gb link to get anything to work What's even weirder is that at the moment I am connecting to the server via the IP for the 10GB card, yet I'm only getting 1GB speeds, and if I unplug the 1GB link I loose connection on both IPs. I'm pulling my hair out here. It seems like there is some config step I'm missing that's letting the system use the main IP on the other cards even though they're not set up as bonded.