VLAN keeps dropping connections.

I'm trying to set up a VLAN to keep my box on my server VLAN, however I'm encountering a very strange issue. I'm having connections drop after about a minute, so for example, I tried to SSH into the box over the VLAN and it froze up and wireshark shows that the connection dropped. I've had no issues with my network setup before using unraid on my server (Dell r720), and I'm kind of lost on what's causing it to do this.

Here's some information from my setup:

NIC config:

Static routes:

Wireshark:

For reference, my unraid box is a r720, which is connected to an unmanaged switch that connects to my opnsense server. I'd like to try to address this issue from the software level because I don't have the money to expense a new switch at this time.

Thanks,

- MrARM