Best setup to utilize Docker with multiple physical ethernet ports

I have had several issues with custom ip address with dockers causing kernal panics and crashing unraid.    I am putting together a new unraid server and was hoping to get direction on how to best set up dockers and fully take advantage of several physical ethernet ports.

Here is one of my threads demeonstrating the problem I was having and what inspired me to redesign my dockers.

Ports I have available:

1. PCIE Fiber card,  with support for 2 x sfp ports, currently has 1 10gb optic
2. supermicro server class motherboard (Supermicro X9DRi-LN4+/X9DR3-LN4+) 4 x 1 gb copper ethernet ports.

Goals I would like to accomplish is:

1. Use the 10gb for high bandwidth items such as file transfers, media streaming, multiple ip surveillance cameras (on separate VLAN)
2. separate the unraid ip address from dockers, (to avoid the kernal panic issues mentioned above)
3. Best way to use the available physical ethernet ports.
4. use a custom docker network to allow communication between dockers.

My thoughts, I am open to suggestions.

1. reserve 1 x 1 gb ethernet port as a management port for unraid 
2. Use the 10 gb port to stream media dockers, transfer files
3. use 1 x 1 gb port for custom docker network separate from unraid. 
4. Split the remaining 1 GB ports between dockers and VM
5. Allow VM and Dockers access to VLAN

Some additional questions:

• I think by having media dockers on the 10gb port and the other dockers on a separate 1gb port will break goal 4
• Regardless of using additional physical ports, will installing and using portainer bypass the limitations of the built in unraid docker management? 
• I do like the unraid docker UI for installing dockers but am not opposed to splitting dockers up between protainer and unraid to better use custom docker IP addresses.
• Open to suggestion on how to split up the available ports. 

Some notes about my network.

• I have a 10Gb switch that provides 10GB connections to my Main desktop computer, a TrueNAS server (same rack).
• I have multiple IP surveillance cameras on 1Gb ports on my 10GB switch that then save to Windows VM running blueIris on the Unraid server.
• I have several VLANs to isolate my network mostly for security. PF Sense firewall manages the firewall rules.
• I have a lightweight docker box (my terminology) where I run portaminer for some apps, secondary VPN, HA piehole (the other in unraid),, dashboard, vaultwarden, other dockers that are critical incase unraid goes down.
• Proxmox servers are not always on, they suck up lots of power and are loud (enterprise servers)
• Truenas for critical files, documents, family photos pictures, anything needing fast read/write, (files backed up on unraid)
• Unraid my heavy lifter has my media files(not backed up on freenas), tons of dockers, VMs, files that are not super critical or can be backed up on truenas, and don't require fast read/write speeds.
• See diagram below for an idea of my network does not include everything but the main stuff.

Edited October 17, 20214 yr by linenoise