So confused why this specifically works.
Originally I setup the SSH port as 9772 but it would not work regardless of what I tried; switched it to port 8020 and it works perfectly now...
Edit: Turns out my issue was not the port, but the usage of Cloudflare Proxy. Beware that cloudflare will not forward the request even if it is meant to use another port other than 80/443