Hello, using VNC or RDP will make your VM leverage a virtual GPU which is absolutely not performing as your real GPU. You should leverage tools like "Parsec" (install on both your VM and the computer you want to use it from) to stream your VM display on another computer.. From there, your VM will be able to fully leverage your GPU.
You can look here on how to setup:
(It is in french but subtitles should be just fine i hope).
Hope this helps,