[6.12.3] VM Getting Multiple MAC Addresses

Has anyone experienced this or I’m I the only one?

Looks like it, you can post the diagnostics to see if there's something visible there.

Good morning @JorgeB, here is the diagnostics. I also changed the network model from E1000 to virtio and my unifi still reports multiple Mac Address. Thank you for your help!

 

eleanor-diagnostics-20230814-0902.zip

On 8/14/2023 at 8:57 AM, JorgeB said:

Looks like it, you can post the diagnostics to see if there's something visible there.

Hey @JorgeB were yo able to review the logs and see anything that stood out?

Not for me, but this is outside my wheel house, possible someone else will see something.

15 minutes ago, JorgeB said:

Not for me, but this is outside my wheel house, possible someone else will see something.

Thank you for your response. I appreciated. 

@limetech are you able to review or guide me to someone that can help me with this please? I appreciate anything on this issue. 

1 hour ago, Tucubanito07 said:

@limetech are you able to review or guide me to someone that can help me with this please? I appreciate anything on this issue. 

Are you able to provide a network diagram.

 

Looks like you have 3 VMs, 3 bridges, on one of the bridges is using DHCP. others are on networks with Statics.

My network looks like this:

 

Modem -> UDM Pro -> USW Enterprise 24Port -> Unifi 8 Port Switch -> Unraid server. 

My unraid server motherboard NIC is connected to a port for webui and docker containers. I then have a separate 2 port NIC on a PCIE port on the motherboard. The other NIC on the mother board is connected straight to my personal computer. 

 

I hope this is what you are wanting. If not let me know. 
 

I have three VM but only one is used all the time. The others are just there for testing purposes. I believe two of the bridges should be using DHCP. 

Edited August 17, 2023 by Tucubanito07

@SimonF have you had the chance to review the logs and the answers to your questions?

14 hours ago, Tucubanito07 said:

@SimonF have you had the chance to review the logs and the answers to your questions?

I have not seen anythink at the point have you tried new 6.12.4 rcs as may help @bonienl any other suggestions

On 8/26/2023 at 5:54 AM, SimonF said:

I have not seen anythink at the point have you tried new 6.12.4 rcs as may help @bonienl any other suggestions

Hello @bonienl and @SimonF,

 

I just updated to 6.12.4 stable version and issue still persist. I downloaded new 6.12.4 diagnostics file. I also grabbed a screenshot of the VM network setting. On my Unifi network, it shows up as 3 different machines. When I sign in into the Windows VM it says the IP Address is 10.10.50.4 and when you ping the VM it doesn't respond. But when you ping 10.10.50.3 which is the one that the Unifi controller says is up, it responds.

 

 

Also, on this screenshot you can see that it says three machines, but only two got IP addresses, however, the connection switch port #7 is correct but no IP address.

 

 

eleanor-diagnostics-20230903-0941.zip

@bonienl do you have any idea of what the issue could be?

# PCI device 0x1d6a:0x07b1 (atlantic)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="70:85:c2:bf:38:08", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"

 

# PCI device 0x1425:0x4409 (cxgb4)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:07:43:17:13:d0", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth2"

 

Try swap eth1 & eth2, so, Aquantia Corp. AQC107 be eth2 ( br2 ), of course, you need connect it to switch port #7 too.

 

Or more simple, change VM NIC using br0 ( then IP will be 10.10.1.43/24 ) and check back same problem happen or not.

 

Why try not use Chelsio NIC, because it have multiple ethernet controller.

 

0f:00.0 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.1 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.2 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.3 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.4 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4409]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.5 SCSI storage controller [0100]: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:4509]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:0000]
0f:00.6 Fibre Channel [0c04]: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:4609]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:0000]
0f:00.7 Ethernet controller [0200]: Chelsio Communications Inc Device [1425:0000]
    Subsystem: Chelsio Communications Inc Device [1425:0000]

26 minutes ago, Vr2Io said:

# PCI device 0x1d6a:0x07b1 (atlantic)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="70:85:c2:bf:38:08", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"

 

# PCI device 0x1425:0x4409 (cxgb4)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:07:43:17:13:d0", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth2"

 

Try swap eth1 & eth2, so, Aquantia Corp. AQC107 be eth2 ( br2 ), of course, you need connect it to switch port #7 too.

 

Or more simple, change VM NIC using br0 ( then IP will be 10.10.1.43/24 ) and check back same problem happen or not.

 

Why try not use Chelsio NIC, because it have multiple ethernet controller.

 

0f:00.0 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.1 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.2 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.3 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4009]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.4 Ethernet controller [0200]: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:4409]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Ethernet Controller [1425:0000]
    Kernel driver in use: cxgb4
    Kernel modules: cxgb4
0f:00.5 SCSI storage controller [0100]: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:4509]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:0000]
0f:00.6 Fibre Channel [0c04]: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:4609]
    Subsystem: Chelsio Communications Inc T420-BT Unified Wire Storage Controller [1425:0000]
0f:00.7 Ethernet controller [0200]: Chelsio Communications Inc Device [1425:0000]
    Subsystem: Chelsio Communications Inc Device [1425:0000]

One of them is the Unraid IP address and Docker containers. I want that VM on a different subnet so I can controlled the traffic on that VM. I don’t want to place it on the same IP as Unraid because then I won’t have control over that VM traffic. I hope that makes sense. 

I can also try to bind together the chelsio ethernet card and pass it through, but there are way too many controllers, and I don't know which ones to bind. It is a 2 nic card and common sense would be 2 ethernet controller per nic but I tried that, and it didn't work. See image below.

 

6 hours ago, Tucubanito07 said:

One of them is the Unraid IP address and Docker containers. I want that VM on a different subnet so I can controlled the traffic on that VM.

Understand that, the test is to identify the problem source. Virtual NIC won't change MAC address self, but I notice you have some call trace relate GPU, this may cause problem too.

8 hours ago, Vr2Io said:

Understand that, the test is to identify the problem source. Virtual NIC won't change MAC address self, but I notice you have some call trace relate GPU, this may cause problem too.

Okay. So I went to the VM template and switched it to BR0 and it got an IP of 10.10.1.158 but I cannot ping it from my desktop which is on the same subnet.

 

So technically the problem is the same just that the server has 10.10.1.43 and the VM has 10.10.1.158 and both are showing on Port # 6. It also has two different MAC Addresses.

 

Citi-VM - MAC Address52:54:00:4e:1d:13

Eleanor Server - MAC Address70:85:c2:bf:38:06

 

 

Thank you so much for your help @Vr2Io.

For ping issue, Windows firewall default were disable , pls check does this is the case.

 

For still found two different MAC, it show 70:85:C2 is Asrock physical NIC ( eth0 ), so you have add it to VM actually. Pls check VM XML.

Due to it is Unraid eth0, so it is normal. ( And I think two MAC problem already gone )

 

If you want further prove this, you need use Aquantia Corp. AQC107 be eth2 ( br2 ) to test again.

 

Edited September 8, 2023 by Vr2Io

8 minutes ago, Vr2Io said:

For ping issue, Windows firewall default were disable , pls check does this is the case.

 

For still found two different MAC, it show 70:85:C2 is Asrock physical NIC ( eth0 ), so you have add it to VM actually. Pls check VM XML.

 

The firewall issue is the windows os. But the issue with multiple MAC on the same Port on the switch still exist. I don’t know what you are wanting me to try. 

Pls found I have edit the post.

1 minute ago, Vr2Io said:

Pls found I have edit the post.

So you want me to place it back to BR2 and see if the multiple MAC address happens and multiple IPs?

3 minutes ago, Tucubanito07 said:

So you want me to place it back to BR2 and see if the multiple MAC address happens and multiple IPs?

Yes, if you insist one MAC and IP ( VM )  in standalone switch port i.e. #7, set eth2 ( br2 ) to use AQC107, VM use br2.

Edited September 8, 2023 by Vr2Io

6 minutes ago, Vr2Io said:

Yes, if you insist one MAC and IP ( VM )  in standalone switch port i.e. #7, set eth2 ( br2 ) to use AQC107, VM use br2.

The VM is set to BR2 and it saying there are three MAC Addresses and two with different IP and the other one does not have an IP Address. See screenshot below. Back to square one.

 

Do you mean set this Interface eht2: to Atlantic on the Interface rules? @Vr2Io