Thank you so much Marshalleq, I feel like such an idiot... Been working on this for the better part of a week and it never occurred to me to try that.
UPDATE:
I've got sonarr, radarr, lidarr, and ombi working but tautulli is throwing err_empty_response. I've got usernames and passwords setup for all. I also had to specify each subdomain instead of using the wildcard to get ssl certs for anyone else in this position.
UPDATE 2:
A bit of googling and I found the solution to tautulli, https://github.com/Tautulli/Tautulli-Wiki/wiki/Frequently-Asked-Questions#general-q10
Everything is now working in the reverse proxy thankfully, once again thanks Mashelleq.