Default gateway overridden, partie deux

vitaprimo

By vitaprimo
in General Support

Recommended Posts

vitaprimo Rookie

vitaprimo

Posted
Posted
Quote

Narrator

On part one, our brave little hero goes around getting his hand on them hefty balls comma dragon, but the evil villain messed up his net config as a distraction while he'd escape with two conveniently packed in a little sack. Oh, the horror! 😩 After the break.

😂

 

Anyway, kidding aside, I'm having a bit of an issue trying to set up networking for Docker; previously I managed to configure the macvtap interface introduced recently, although I was using a much faster NIC to make up for the bonded+bridged 4x single-gig NICs on this host's board and to satisfy the requirement of using the interface directly as instructed.

 

That other NIC basically belongs to my main firewall which lives on vSphere. I reasoned though, Unraid moves most of the data in the network anyway, perhaps sharing it would be more efficient — not that is that much. Truth is, a single gig should be plenty of bandwidth — so it's how it ended up in Unraid. Once in Unraid, I had to enable bridging anyway so I could set up a trunk port for the firewall; but the firewall wouldn't work correctly or as transparently as I expected; if I pinged it, it (the firewall) would reply from Unraid's IP address closest to the source of the echo requests. Because of that interception, IPv6 and multicast weren't working. I had to put it back on vSphere. Container networking was okay though.

 

But back on the bonded bridge, container networking has been impossible to set up; if I set the addresses in Unraid**, my default gateway is overridden misrouting the traffic as a consequence. If I set no addresses in Unraid like I had before, and instead use the docker network commands it won't let me create the networks because my gateway is allegedly already in use elsewhere.

 

I tried docker network rm $(docker network ls -q), to nuke them out before recreating my own, but it didn't work. And the gateways are not specified anywhere, not manually at least, contrary to what docker says when I issue the commands.

 

Any advice?

 

**: in Network Settings so they show up as checkboxes in the Docker settings

 

I have a feeling that the gateways are cached somewhere hence I'm unable to set them. In the meantime, I'll try a restart to see if that clears them. 🤞

 

Link to comment
vitaprimo Rookie

vitaprimo

Posted
  • Author
Posted

Didn't work. :(

  

[Sat11@ 1:05:54][root@zx3:~] #〉docker network create                       \
>   --attachable                              \
>   --driver macvlan                          \
>   --gateway 10.10.0.1                       \
>   --subnet  10.10.0.0/24                    \
>   --ipv6                                    \
>   --gateway XXXX:XXXX:XXXX:XaXX::             \
>   --subnet  XXXX:XXXX:XXXX:XaXX::/120         \
>   --opt parent="br0" z0a00
Error response from daemon: failed to allocate gateway (XXXX:XXXX:XXXX:XaXX::): Address already in use

(Sorry for the Xs, it's a global address)

 

It's the same error for every network, so I removed the IPv6 network and tried again: 

[Sat11@ 1:07:21][root@zx3:~] #〉docker network create  \
>   --attachable                                       \
>   --driver macvlan                                   \
>   --gateway 10.10.0.1                                \
>   --subnet  10.10.0.0/24                             \
>   --opt parent="br0" z0a00
Error response from daemon: network dm-27dcdc7bb8a6 is already using parent interface br0

 

Again, negative — and — if try to see what's  dm-27dcdc7bb8a62; 

[Sat11@ 1:07:42][root@zx3:~] #〉docker network inspect dm-27dcdc7bb8a6
[]
Error: No such network: dm-27dcdc7bb8a6

 

I mean… WT-holy-F!  🤬

 

________________________________________________________________________________________________

+info: (trimmed/related)

 

LINKS 

[Sat11@ 1:18:58][root@zx3:~] #〉ip l
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
…
7: eth0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
8: eth1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:90
9: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:92
10: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:94
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master br0 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
…
14: bond0.10@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br0.10 state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
20: br0.10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
…
23: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default
    link/ether 02:42:b9:0c:7b:5a brd ff:ff:ff:ff:ff:ff

 

ADDRESSES 

[Sat11@ 1:18:21][root@zx3:~] #〉ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
…
7: eth0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
8: eth1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:90
9: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:92
10: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff permaddr e4:11:5b:bc:c2:94
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master br0 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
    inet6 fe80::e611:5bff:febc:c28e/64 scope link
       valid_lft forever preferred_lft forever
…
14: bond0.10@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br0.10 state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
…
17: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
    inet 10.1.0.13/24 metric 1 scope global br0
       valid_lft forever preferred_lft forever
    inet6 XXXX:XXXX:XXXX:X1XX::d/120 metric 1 scope global
       valid_lft forever preferred_lft forever
    inet6 fe80::e611:5bff:febc:c28e/64 scope link
       valid_lft forever preferred_lft forever
…
20: br0.10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether e4:11:5b:bc:c2:8e brd ff:ff:ff:ff:ff:ff
…
23: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
    link/ether 02:42:b9:0c:7b:5a brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

 

GATEWAYS/ROUTES v4 

[Sat11@ 1:22:41][root@zx3:~] #〉ip r
default via 10.11.11.1 dev shim-br0.11
default via 10.11.11.1 dev br0.11 metric 1
10.1.0.0/24 dev br0 proto kernel scope link src 10.1.0.13 metric 1
10.11.11.0/24 dev shim-br0.11 proto kernel scope link src 10.11.11.13
10.11.11.0/24 dev br0.11 proto kernel scope link src 10.11.11.13 metric 1
10.14.0.0/24 dev br0.14 proto kernel scope link src 10.14.0.13 metric 1
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown

 

GATEWAYS/ROUTES v6 

[Sat11@ 1:26:44][root@zx3:~] #〉ip -6 r
::1 dev lo proto kernel metric 256 pref medium
XXXX:XXXX:XXXX:X1XX::/120 dev br0 proto kernel metric 1 pref medium
XXXX:XXXX:XXXX:XbXX::/120 dev br0.11 proto kernel metric 1 pref medium
XXXX:XXXX:XXXX:XeXX::/120 dev br0.14 proto kernel metric 1 pref medium
fe80::/64 dev br0 proto kernel metric 256 pref medium
fe80::/64 dev bond0 proto kernel metric 256 pref medium
fe80::/64 dev br0.11 proto kernel metric 256 pref medium
fe80::/64 dev bond0.11 proto kernel metric 256 pref medium
fe80::/64 dev br0.14 proto kernel metric 256 pref medium
fe80::/64 dev bond0.14 proto kernel metric 256 pref medium
default via XXXX:XXXX:XXXX:XbXX:: dev br0.11 metric 1 pref medium

 

Nowhere to be found. :/

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing