2 ports on each server. 1 port on each server going to switch, 1 port direct connect to the other server (static IP, different subnet)
Why a direct connection? Lots of data moving back and forth between them, keeps the traffic off the switch, is a good deal faster.....plus, I had nothing else to do with the ports 🙂
eth1 is the direct connect with the other server, and yes, I noticed eth0 was missing the "RUNNING" piece (I posted a screenshot and talked about it in the first post)
This next question actually didn't have anything to do with the problem, but it put me in a position to see the problem!! (I'm such an idiot)
What happens when I remove the direct connect?
I hadn't even thought to try that since I wasn't having an issue with that port, so I was going to give it a shot, I had nothing to lose.
I went to the server and traced both cables coming out to make sure I was going to pull the right one. I had gone over the cables many, many times over the last couple of days, verifying where they were going and reseating the connections on both ends....but it never sunk in and clicked.
It wasn't going into the switch, it was going directly to the spare port on my opnsense server. A few months ago, I moved it from the switch to the spare port. It had been in the switch for a couple of years, so it was ingrained in my head that it was connected to the switch regardless of what my eyes were telling me.
When I was running untangle I had bridged the interfaces so it was all the same network/subnet. When I moved to opnsense on Saturday, I completely forgot about the creating the bridge....even though I had a screenshot of the old setup showing the bridge.
Not only did I not bridge the interface, but I also disabled it. So there was no way the server was going to be talking to anybody from that port.
Once I recreated the bridge, everything worked as expected. I just had to go through and undo all the changes in unraid I made during troubleshooting.
So long story, short, Thanks for the nudge!!....I was finally able to sleep peacefully 🙂
