Block access to docker containers UI on local network

I have several docker containers running on a private docker network. I am using SWAG as a reverse proxy. I can access the UI of any of the containers locally on my network. Is there a way to block access from the local network to the UI so that I can force all traffic through the reverse proxy? 

For example, user can access the docker at: http://unraid-server:5050 and https://myapp.mydomain.com but I only want them to be able to use use the https://myapp.mydomain.com 

I have local DNS resolving the domain correctly so this is not an issue.

Thanks for your help.