For anyone having issues to connect to your docker containers via tailscale dns name...
What worked for me (and I know it sounds stupid...) was to enable "userspace networking" in the container, saving and thus restarting the container, and then disabling it again. And suddenly I can access this container via tailscale domain with https and everything.