Nvidia GPU passthrough not working after 6.9 update

[dylantweedy]

I've been trying to fix this for about a month with no luck. I've been running a windows 10 gaming vm for a couple of years now (mostly) without a problem. It runs with a Nvidia Geforce 1080 and is the only graphics card in the system and I'm also passing through a USB controller. (I vaguely remember having to edit my syslinux config and getting the Graphics ROM BIOS to get it all to work.)

 

 

 

Then I updated to 6.9.1 and things stopped working, I believe at that point I got a notification
"Legacy PCI Stubbing found, please help clear this warning, vfio-pci.ids or xen-pciback.hide found within syslinux.cfg. For best results on Unraid 6.9+, it is recommended to remove those methods of isolating devices for use within a VM and instead utilize the options within Tools - System Devices"

I removed the "vfio-pci.ids=8086:1d2d" and checked it in the System Devices Menu, still no luck.

 

 

As the USB controller seemed to be working fine and because I could still boot into recovery mode, I figured it was something to do with the graphics card, so I checked that too.

 

 

That doesn't seem to help, and after disabling it and rebooting the green dots remain, which makes me wonder if it's actually been disabled.

 

 

It was at this point I made a big mistake, I saw that Unraid 6.9.2 was available. I was hoping that it would just magically fix it, but it didn't, and it wasn't until I had already hit the update button that I noticed the restore button. I tried restoring to 6.9.1 but was unable to restore again to 6.8 so now I'm stuck!

I've gone back to the latest version, removed PCIe ACS override from syslinux and disabled it in VM settings to see if it made a difference (it didn't.) I even made a brand new VM, which was working perfectly until it installed the graphics card drivers, it actually seemed to work for a couple of hours, but after a restart it broke and hasn't worked since. It will attempt to boot, but fail and load into recovery mode.

I'm pretty much out of ideas at this point, so if anyone can help me I'd be extremely grateful!

I have attached the diagnostics file if it's of any use.

storageserver-diagnostics-20210521-1701.zip

[SimonF]

What are the vm machine type and bios.

 

Have you tried without the rom

 

Suggest posting diagnostics..

[dylantweedy]

 

I have tried with SeaBIOS and didn't have much luck there. I'm currently trying to make a new VM with SeaBIOS to see if it's any different.

 

Tried it without the rom, it made things worse and the VM wouldn't even show the boot screen!

 

I did post the diagnostics, didn't I?

 

[SimonF]

Yes you did sorry.

[SimonF]

56 minutes ago, dylantweedy said:

I'm currently trying to make a new VM with SeaBIOS to see if it's any different.

Have you tired Q35 instead of i440 to see if that works?

[dylantweedy]

It works! I seem to be having performance issues, but it's booting and running windows, so this is a big improvement.

[kr1st0ph]

On 5/21/2021 at 10:04 PM, dylantweedy said:

It works! I seem to be having performance issues, but it's booting and running windows, so this is a big improvement.

Can you tell us what steps you followed to get it to work? I am at a loss with my RTX2070 passthrough for my bare metal windows install (which is also my primary pc)

[mikeg_321]

Hi,  Did you manage to get this resolved?  Believe I am having the same issue and also on an EP2C602.  I am searching through the forums and have noticed a couple others with similar problems when they went to 6.9 and are on the same MB.  I thought I tried a Seabios install but maybe not.  Perhaps I'll try that next as it seems like maybe that worked for you?

 

Also posted here and here.  Do those sound like what you had or have as an issue?

[dylantweedy]

It's been a while since this post, but yeah, from what I recall your problem sounds the same as mine
I ended up removing the GPUs from that board and using them in different machine. I've had some success trying to passthrough them on Pop OS with KVM and Virtual Machine Manager and I'm gradually understanding how this whole thing works, but I'm still encountering performance issues on a Windows 10 gaming VM. I've just ordered a RTX 3060 Ti, so I may trying moving a 1080 back to the ASRock EP2C602 motherboard and taking another crack at it. My goal is to have each GPU able to function as an individual gaming VM, then set mining crypto when not in use (to hopefully recoup the cost on these ludicrous GPU prices!). It's taking me a while to overcome each problem I run into, but when I have more useful information I'll be sure to post it here!
I was honestly hoping there would be an update to fix the issue by now.

[mikeg_321]

Ok, thanks for the update.  Appreciated.   I am back on 6.8 now... I've wound up with a very stable WIn 10 environment after days of tweaking and reading.  Happy to compare notes later if you like.  Think I'll just keep things stable and enjoy Xmas and keep trying to figure this out on 6.10 when I have time.  Yeah, I was hoping 6.10 would have resolved this.  I'll post any new news too.  I was doing the same as you in the past.  2 Gaming rigs by day and miners by night.  I stopped mining a while ago but might have to check that out again.