First I upgraded my gpu from a 980gtx to rtx 2070 super and now every time i boot up my win10 vm. I have to wait 10 minutes for the drivers to load. 

Edited October 17, 20196 yr by Sleepyme

That change should have absolutely no effect if the card is stubbed properly.  I changed 2 of my 960s to 2070s a few months ago and the biggest changes that I had to do were to get all of the IDs for that card to pass through- including the USB and sound devices on the card.  Note: the old card only had 2 pcie devices but the new one has a 3rd for the USB 3 device that the card contains.  I didn't even have to change drivers before it would boot(just as fast as always).