Windows 11 VM help with GT 710 drivers

stev067 · May 5, 2023

Hey guys,

Having a rough time trying to get a simple GPU passthrough working with a windows 10 (now 11) VM. The OS does recognize the GPU, but lthe resolution is painfully low, and when I look at the adapter properties in device manager, it says "a driver for this device has been disabled," so it's not liking the driver. I've tried a few different things for the driver:

1) Using SpaceInvader One's script to dump the ROM from the card. I haven't been able to get this to work. I get a message that the ROM is too small (under 70kb) and that it will try to reconnect the card. It has me push the power button on my system, and then does nothing when the system comes back from whatever hibernate state it went into.

2) Found what sounds like a matching ROM from techpowerup. This is a Geforce GT 710 1GB. I set the VM to use this as the ROM BIOS.

3) Within the VM, tried manually updating drivers, pointing to the QXL and QXLDOD folders from the VIRTIO drive. I just always get the message that the best drivers are already installed.

4) Within the VM, installed the drivers directly from Nvidia. This results in no change.

The graphics and sound are in their own IOMMU group together.

I'm using the latest VIRTIO driver.

Is there anything I haven't thought of? Appreciate any help.

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm' id='2'>
<name>Windows 11</name>
<uuid>4be232f6-40d7-30e0-a6f8-99a1dcd79660</uuid>
<metadata>
<vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>
</metadata>
<memory unit='KiB'>16777216</memory>
<currentMemory unit='KiB'>16777216</currentMemory>
<memoryBacking>
<nosharepages/>
</memoryBacking>
<vcpu placement='static'>8</vcpu>
<cputune>
<vcpupin vcpu='0' cpuset='12'/>
<vcpupin vcpu='1' cpuset='28'/>
<vcpupin vcpu='2' cpuset='13'/>
<vcpupin vcpu='3' cpuset='29'/>
<vcpupin vcpu='4' cpuset='14'/>
<vcpupin vcpu='5' cpuset='30'/>
<vcpupin vcpu='6' cpuset='15'/>
<vcpupin vcpu='7' cpuset='31'/>
<emulatorpin cpuset='0,6'/>
</cputune>
<resource>
<partition>/machine</partition>
</resource>
<os>
<type arch='x86_64' machine='pc-i440fx-7.1'>hvm</type>
<loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
<nvram>/etc/libvirt/qemu/nvram/4be232f6-40d7-30e0-a6f8-99a1dcd79660_VARS-pure-efi-tpm.fd</nvram>
</os>
<features>
<acpi/>
<apic/>
<hyperv mode='custom'>
<relaxed state='on'/>
<vapic state='on'/>
<spinlocks state='on' retries='8191'/>
<vendor_id state='on' value='none'/>
</hyperv>
</features>
<cpu mode='host-passthrough' check='none' migratable='on'>
<topology sockets='1' dies='1' cores='4' threads='2'/>
<cache mode='passthrough'/>
<feature policy='require' name='topoext'/>
</cpu>
<clock offset='localtime'>
<timer name='hypervclock' present='yes'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>restart</on_crash>
<devices>
<emulator>/usr/local/sbin/qemu</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='raw' cache='writeback'/>
<source file='/mnt/user/domains/Windows 11/vdisk1.img' index='3'/>
<backingStore/>
<target dev='hdc' bus='virtio'/>
<boot order='1'/>
<alias name='virtio-disk2'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</disk>
<disk type='file' device='cdrom'>
<driver name='qemu' type='raw'/>
<source file='/mnt/user/isos/Windows.iso' index='2'/>
<backingStore/>
<target dev='hda' bus='ide'/>
<readonly/>
<boot order='2'/>
<alias name='ide0-0-0'/>
<address type='drive' controller='0' bus='0' target='0' unit='0'/>
</disk>
<disk type='file' device='cdrom'>
<driver name='qemu' type='raw'/>
<source file='/mnt/user/isos/virtio-win-0.1.229-1.iso' index='1'/>
<backingStore/>
<target dev='hdb' bus='ide'/>
<readonly/>
<alias name='ide0-0-1'/>
<address type='drive' controller='0' bus='0' target='0' unit='1'/>
</disk>
<controller type='pci' index='0' model='pci-root'>
<alias name='pci.0'/>
</controller>
<controller type='ide' index='0'>
<alias name='ide'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
</controller>
<controller type='virtio-serial' index='0'>
<alias name='virtio-serial0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
</controller>
<controller type='usb' index='0' model='ich9-ehci1'>
<alias name='usb'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci1'>
<alias name='usb'/>
<master startport='0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci2'>
<alias name='usb'/>
<master startport='2'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci3'>
<alias name='usb'/>
<master startport='4'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
</controller>
<interface type='bridge'>
<mac address='52:54:00:5d:8f:49'/>
<source bridge='br0'/>
<target dev='vnet2'/>
<model type='virtio-net'/>
<alias name='net0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</interface>
<serial type='pty'>
<source path='/dev/pts/1'/>
<target type='isa-serial' port='0'>
<model name='isa-serial'/>
</target>
<alias name='serial0'/>
</serial>
<console type='pty' tty='/dev/pts/1'>
<source path='/dev/pts/1'/>
<target type='serial' port='0'/>
<alias name='serial0'/>
</console>
<channel type='unix'>
<source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-2-Windows 11/org.qemu.guest_agent.0'/>
<target type='virtio' name='org.qemu.guest_agent.0' state='connected'/>
<alias name='channel0'/>
<address type='virtio-serial' controller='0' bus='0' port='1'/>
</channel>
<input type='tablet' bus='usb'>
<alias name='input0'/>
<address type='usb' bus='0' port='3'/>
</input>
<input type='mouse' bus='ps2'>
<alias name='input1'/>
</input>
<input type='keyboard' bus='ps2'>
<alias name='input2'/>
</input>
<tpm model='tpm-tis'>
<backend type='emulator' version='2.0' persistent_state='yes'/>
<alias name='tpm0'/>
</tpm>
<audio id='1' type='none'/>
<hostdev mode='subsystem' type='pci' managed='yes'>
<driver name='vfio'/>
<source>
<address domain='0x0000' bus='0x0a' slot='0x00' function='0x0'/>
</source>
<alias name='hostdev0'/>
<rom file='/mnt/user/isos/vbios/GT710_new.rom'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
</hostdev>
<hostdev mode='subsystem' type='pci' managed='yes'>
<driver name='vfio'/>
<source>
<address domain='0x0000' bus='0x0a' slot='0x00' function='0x1'/>
</source>
<alias name='hostdev1'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</hostdev>
<hostdev mode='subsystem' type='usb' managed='no'>
<source>
<vendor id='0x0b05'/>
<product id='0x18f3'/>
<address bus='3' device='2'/>
</source>
<alias name='hostdev2'/>
<address type='usb' bus='0' port='1'/>
</hostdev>
<hostdev mode='subsystem' type='usb' managed='no'>
<source>
<vendor id='0x1b1c'/>
<product id='0x0c21'/>
<address bus='1' device='2'/>
</source>
<alias name='hostdev3'/>
<address type='usb' bus='0' port='2'/>
</hostdev>
<memballoon model='none'/>
</devices>
<seclabel type='dynamic' model='dac' relabel='yes'>
<label>+0:+100</label>
<imagelabel>+0:+100</imagelabel>
</seclabel>
</domain>

Edited May 5, 2023 by stev067

Hulk77 · May 5, 2023

Hi,
i don't know if this is the Problem but i think that is not corret.

<hostdev mode='subsystem' type='pci' managed='yes'>
<driver name='vfio'/>
<source>
<address domain='0x0000' bus='0x0a' slot='0x00' function='0x0'/>
</source>
<alias name='hostdev0'/>
<rom file='/mnt/user/isos/vbios/GT710_new.rom'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
</hostdev>
<hostdev mode='subsystem' type='pci' managed='yes'>
<driver name='vfio'/>
<source>
<address domain='0x0000' bus='0x0a' slot='0x00' function='0x1'/>
</source>
<alias name='hostdev1'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</hostdev>

In SpaceInvaders Video you have set the Multifunction for the Soundcard:

Edited May 5, 2023 by Hulk77

ghost82 · May 5, 2023

Change to this:

    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0a' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <rom file='/mnt/user/isos/vbios/GT710_new.rom'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0a' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
    </hostdev>

Then install nvidia drivers.

stev067 · May 5, 2023

1 hour ago, Hulk77 said:

Hi,
i don't know if this is the Problem but i think that is not corret.

slot='0x05' function='0x1'/>

Thanks you were right. I should've had the function for the virtual line for the sound card set to slot 0x05 and function 0x1. Unfortunately there must be something else wrong too, because I'm still getting a code 43 error.

stev067 · May 5, 2023

1 hour ago, ghost82 said:

Change to this:

    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0a' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <rom file='/mnt/user/isos/vbios/GT710_new.rom'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0a' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
    </hostdev>

Then install nvidia drivers.

That doesn't seem to do the trick. In fact, the 'alias name' lines don't stick. I add them, update the VM, and when I go back they're gone. I've kept the slot and function of the sound card as you and Hulk put it though, because apparently I missed that. Still getting the code 43 though.

ghost82 · May 5, 2023

Where are diagnostics?

stev067 · May 5, 2023

29 minutes ago, ghost82 said:

Where are diagnostics?

Here ya go, thanks for taking a look.

haven-diagnostics-20230505-1231.zip

ghost82 · May 6, 2023

1. Binded devices have wrong addresses, probably you changed the physical slot of the gpu; do again the "bind to vfio at startup setup"

Loading config from /boot/config/vfio-pci.cfg
BIND=0000:09:00.0|10de:128b 0000:09:00.1|10de:0e0f
---
Processing 0000:09:00.0 10de:128b
Error: Vendor:Device 10de:128b not found at 0000:09:00.0, unable to bind device
---
Processing 0000:09:00.1 10de:0e0f
Error: Device 0000:09:00.1 does not exist, unable to bind device

(2. Enable unsafe interrupts in unraid: (may not be required) --> Settings -> VM -> change "VFIO allow unsafe interrupts" to Yes)

3. Use the attached vbios if you are not able to dump one

200079.rom

4. reboot

Edited May 6, 2023 by ghost82

ghost82 · May 6, 2023

21 hours ago, stev067 said:

3) Within the VM, tried manually updating drivers, pointing to the QXL and QXLDOD folders from the VIRTIO drive. I just always get the message that the best drivers are already installed.

gpu drivers cannot be in the virtio iso...use and install nvidia drivers:
https://www.nvidia.it/Download/driverResults.aspx/203214/en-us

stev067 · May 6, 2023

2 hours ago, ghost82 said:
1. Binded devices have wrong addresses, probably you changed the physical slot of the gpu; do again the "bind to vfio at startup setup"
Loading config from /boot/config/vfio-pci.cfg
BIND=0000:09:00.0|10de:128b 0000:09:00.1|10de:0e0f
---
Processing 0000:09:00.0 10de:128b
Error: Vendor:Device 10de:128b not found at 0000:09:00.0, unable to bind device
---
Processing 0000:09:00.1 10de:0e0f
Error: Device 0000:09:00.1 does not exist, unable to bind device
(2. Enable unsafe interrupts in unraid: (may not be required) --> Settings -> VM -> change "VFIO allow unsafe interrupts" to Yes)

3. Use the attached vbios if you are not able to dump one

200079.rom 164 kB · 1 download

4. reboot

Strange...even after re-binding those and rebooting, I still get those errors, and they don't show as bound in system devices. And I haven't moved the GPU at all.

Edit: Scratch that, I was able to get it to stick. Had to clear it out and reboot and then remake it. Now it's sticking.

Edit 2: It's working now! Thanks for your help!

Edited May 6, 2023 by stev067

Windows 11 VM help with GT 710 drivers

Recommended Posts

stev067

Link to comment

Hulk77

Link to comment

ghost82

Link to comment

stev067

Link to comment

stev067

Link to comment

ghost82

Link to comment

stev067

Link to comment

ghost82

Link to comment

ghost82

Link to comment

stev067

Link to comment

Join the conversation