VM can't resume after Hibernation with vGPU

Hello I'm running a VM with Nvidia card using QEMU/KVM

I am using vGPUS on the VM

the Guest OS - Windows 11

What is the issue:
We start the VM
We connect to that VM with RDP
nvidia-smi shows that everything is connected correctly
We call shutdown /h to hibernate the VM
When VM is hibernated, we resume it and the VM just stuck, we can't connect to it or interact.
To resolve this, we execute shutdown from KVM and start again. After that everything is works fine. When we run VM without NVIDIA driver hibernation works as expected.

Whitout Nvidia Drivers instaled, Hibernation works perfectly fine

Logs that might Help Debugg the problem:

Jul 25 00:30:08  nvidia-vgpu-mgr[20579]: error: vmiop_log: (0x0): RPC RINGs are not valid

Some Logs from the Guest:

Reset and/or resume count do not match expected values after hibernate/resume.

Adapter start failed for VendorId (0x10DE) failed with the status (The Basic Display Driver cannot start because there is no frame buffer found from UEFI or from a previously running graphics driver.), reason (StartAdapter_DdiStartDeviceFailed)

any Help would be hugely appreciated and thanks