Requesting assistance setting up reverse proxy with wireguard VPN to bypass CGNAT for docker containers on custom network.

[KRDucky]

Like the title says, I have my docker containers in a custom docker network ala 'medianet'.
I am stuck behind a CGNAT and have no ability to port forward via my router. 

I have a VPS with unmetered bandwidth and have configured a wireguard VPN server on it to forward all traffic. 

What I need to know how to do is set up a reverse proxy that works with the VPN to forward certain containers over the VPN to my cloudflare domain. 

I have tried Cloudflare argo tunnel but do not want to violate their TOS as one of the containers is Jellyfin and the other is Nextcloud.