[Unraid 6.8.3] Unraid cannot have two bridged 10gbe connection on the same subnet


Recommended Posts

I'm at a complete loss, can't find anything remotely the same online.

 

I have an Intel x550 T-2 card in my unraid server for direct 10gbe connectivity to two external computers. One of the ports works perfectly fine getting around 9gbe, while the other port stays fixed at 1gbe. This port shows up as having a 10gbe link and everything though. Initially I thought it could have been a bridging issue:

 

My network setup (for convenience) is to bridge eth2 (10g) to eth0(1g to internet) and eth3(10g) to eth1(1g also to internet). (in the screenshot they are inverted because I was testing it out)

image.thumb.png.dbb1a23372024c9afcbca6a129aeef54.png

This results in eth3 achieving 10g but eth2 only getting 1g.

I also tried inverting the bridges but eth2 does not go beyond 1g.

 

I then tried direct connection between server and client and eth2 can do 10g without any issues.

 

Is there some sort of bridging limitation? I also tried bridging just one of the 10g connections to eth0. Eth3 can do 10g but again eth2 in the same situation gets stuck at 1g...

 

(Both show up with the exact same settings in ethtool)

root@Kenchitaru-Serv:~# ethtool eth3
Settings for eth3:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Full 
                                1000baseT/Full 
                                10000baseT/Full 
        Supported pause frame use: Symmetric
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Full 
                                1000baseT/Full 
                                10000baseT/Full 
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: on
        MDI-X: Unknown
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes
root@Kenchitaru-Serv:~# ethtool eth2
Settings for eth2:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Full 
                                1000baseT/Full 
                                10000baseT/Full 
        Supported pause frame use: Symmetric
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Full 
                                1000baseT/Full 
                                10000baseT/Full 
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: on
        MDI-X: Unknown
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes

I've also attached a diagnostics zip just in case

kenchitaru-serv-diagnostics-20200810-1937.zip

Edited by meh301
Link to comment

The information in your diagnostics says

 

eth0 = 1G

eth1 = 1G

eth2 = 10G

eth3 = down (10G)

 

Frankly speaking, I don't understand what you try to achieve exactly.

Is your Unraid server connected to the Internet and you want it to act as bridge for other devices behind it to access Internet?

Your approach needs to be different if the above is the intention.

 

Link to comment
1 hour ago, bonienl said:

The information in your diagnostics says

 

eth0 = 1G

eth1 = 1G

eth2 = 10G

eth3 = down (10G)

 

Frankly speaking, I don't understand what you try to achieve exactly.

Is your Unraid server connected to the Internet and you want it to act as bridge for other devices behind it to access Internet?

Your approach needs to be different if the above is the intention.

 

eth3 was down during diagnostics saving because it was disconnected...

 

I have two 1gbe interfaces linked to the router, giving unraid two separate IPs (br0 and br1) and I have two client PCs with 10gbe connectivity connected to the unraid server directly (no 10gbe switch). Unraid bridges the 10gbe connections to the LAN, with each 10gbe network having their own dedicated 1gbe link to the router. 

 

The issue in doing this was that only one of the client links would get full 10gbe speed to unraid, while the other would be set to 1gbe only, even if everything is reporting it as 10gbe. Bridging both 10gbe links to a single 1gbe link also does not allow both client links to achieve 10gbe. 

 

But I managed to get it to work by setting one of the unraid 1gbe links to the router to be on a different subnet. It only works if the interfaces connecting to the router from unraid are on different subnets entirely. 

 

I'm doing this for two reasons: 

1. I am in a small Japanese apartment and can't really route anymore cables or fit a switch anywhere

2. I have a 2gbe internet connection but only 1gbe interfaces to the router, this in the very least allows me to saturate the wan with two computers. 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.