For all those having problems and everything seems to be well configured. I figured out a dumb solution, I was hitting my head with the table (figuratively speaking) at the moment I got it working.
Disable data saving on your android phone or iphone.
Invite me a coffee
I've been 2 hours trying different ports, different settings, removing tunnels, creating them again, reinstalling wireguard. All was fine... it was the damn phone. I hate this feeling.