Issues creating VM with GPU passthrough

[Jamie789_]

Getting this error message when creating a windows 10 VM -

 

VM creation error

internal error: qemu unexpectedly closed the monitor: 2020-02-03T12:10:06.064298Z qemu-system-x86_64: -device vfio-pci,host=0000:b3:00.0,id=hostdev0,bus=pci.0,addr=0x6: vfio 0000:b3:00.0: group 33 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

 

Using a rtx 2080 super - which I think is causing the issue as this is in group 33:

 

Does this need a dumped gpu bios file to work properly or is there something else causing the error? 

 

IOMMU group 33:[10de:1e81] b3:00.0 VGA compatible controller: NVIDIA Corporation TU104 [GeForce RTX 2080 SUPER] (rev a1)[10de:10f8] b3:00.1 Audio device: NVIDIA Corporation TU104 HD Audio Controller (rev a1)[10de:1ad8] b3:00.2 USB controller: NVIDIA Corporation TU104 USB 3.1 Host Controller (rev a1)[10de:1ad9] b3:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU104 USB Type-C UCSI Controller (rev a1)

 

Still noobish to unraid - Can anyone point me in the right direction?

Edited February 3, 2020 by Jamie789_

[testdasi]

As always please go to Tools -> Diagnostics -> attach zip file to any post regarding issues.

 

From the look of it, you didn't stub all the devices in group 33.

• You need to watch SpaceInvade One guide on youtube about vfio-pci.ids stubbing (preferably just watch his whole playlist about Unraid VM).
• Alternatively, install the vfio-pci config plugin (just search for "VFIO-PCI Config" in Community Applications) and follow the plugin instruction to stub the devices in group 33 (it's just tick some boxes and click a button)
  Note that with this method, BEFORE you install new PCIe devices and/or move devices around, you have to remember to turn the stubbing off first. This method stub by address and installing new device / moving devices around will change the addresses (i.e. you may end up stubbing the wrong device).

Also note that the RTX 2280 has 4 devices that need to be passed through together. i.e. b3:00.0 -> b3:00.3

[Fabiolander]

Hi,

 

I'm very happy with my NAS Unraid and I would like to go further by creating a gaming VM that I will be able to play from different places.

I follow different spaceinvader vidéo and some advices like the one above but I have the same issue as Jimmy980_ :

My VM works great but every time I want to passthru the NIVIDIA GTX960 2GB I got this VM Creation error :

Execution error

internal error: qemu unexpectedly closed the monitor: 2020-03-22T10:06:53.908737Z qemu-system-x86_64: -device vfio-pci,host=0000:01:00.0,id=hostdev0,bus=pci.0,multifunction=on,addr=0x6,romfile=/mnt/disk6/tmp/MSI.GTX960.2048.150528.rom: vfio 0000:01:00.0: group 1 is not viable Please ensure all devices within the iommu_group are bound to their vfio bus driver.

Nvidia Video card and Nvidia Sound card looks in the same group 1:

 

Group 1 

00:01.08086:0c01PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller (rev 06)

 00:01.28086:0c09PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x4 Controller (rev 06)

 01:00.010de:1401VGA compatible controller: NVIDIA Corporation GM206 [GeForce GTX 960] (rev a1)

 01:00.110de:0fbaAudio device: NVIDIA Corporation GM206 High Definition Audio Controller (rev a1)

 02:00.01000:0072Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

 

My understanding of passthru technics stop here.

Could you please help me ?

nas-diagnostics-20200322-1127.zip

[Fabiolander]

No reply so far but I continue my investigation.

 

As advised by spaceinvader one :

• First I tried to change the slot of the video card on the mother board but the error came back with a different slot number

  • Execution error

    internal error: qemu unexpectedly closed the monitor: 2020-03-25T10:05:32.401100Z qemu-system-x86_64: -device vfio-pci,host=0000:02:00.0,id=hostdev0,bus=pci.0,multifunction=on,addr=0x5: vfio 0000:02:00.0: group 1 is not viable Please ensure all devices within the iommu_group are bound to their vfio bus driver.
     

• I added multifunction='on' and changed the virtual slot of the video sound card  in the KVM xml but error remains

  •     <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x02' slot='0x00' function='0x1'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
        </hostdev>

• I tried VFIO-PCI CFG plugin and after reboot the UNRAID array cannot start again because the Parity disk disappeared.

Do you have an idea where I can dig to sort out this video card passthrough issue ?

 thank you in advance for your time

[testdasi]

@Fabiolander: Please create another topic for your issues.

Hijacking someone else's topic is not going to help both of you due to the resulting confusion.

(for example: I would not have recommended you the same vfio-pci cfg tweak I recommended the OP)

Edited March 25, 2020 by testdasi

[Fabiolander]

Sorry @testdasi and thank you for your answer. I missed this rule in the forum policy, Usually other forum refuses duplicates. I will create my own thread then.

[testdasi]

8 minutes ago, Fabiolander said:

Sorry @testdasi and thank you for your answer. I missed this rule in the forum policy, Usually other forum refuses duplicates. I will create my own thread then.

No prob and it isn't really a rule per se. It's just that pass-through issues tend to be very idiosyncratic so a lot of times, I have found that small diff is not necessarily insignificant.