I'm also having this problem with a win11 vm with a RTX 2080 passthrough. Works fine for some amount of time ( a day or more) and then the VM essentially freezes and maxes out the CPU cores assigned to it to 100% constantly until I force shut it down.