I am having the same issue using nginx proxy manager, if I go to the local address then it works fine, I have other sites where I user built in TOTP are fine, so is Authelia, I tried clearing browser cache, using different browsers, turning off caching on nginx proxy manager, cleared cache on cloudflare, put cloudflare into dev mode (turns off all caching).
I was able to register and get qrcode first time around but that was done using the local address.