I did a little more poking around and it seems the issue is by either the Use Tailscale Subnets option, the Use Tailscale DNS option, or the IP Forwarding option. With them enabled, I can only access the GUI via its Tailscale IPv4 address, not any of the local access URLs. With those options disabled, I can access everything like normal.