I just came about this thread with the exact same issue.
After reading this thread and a bit of trial an error I found a solution that works for me:
Changing the network model in my VM configuration from virtio-net to vmxnet3.
I didn't experience any stuttering or other issues ever since.