Unraid 6.2.2 and GTX 780 Code 43 issue

[doroyce05]

:( :'( :'(

 

So i've been trying to get this working for a while now (multiple days and nights). I've looked everywhere and tried possible combos. I have an ITX board with an i7 4771 and an EVGA GTX 780. The card is found in device manager but im getting the Code 43 error. I've tried different bios and reinstall of driver and OS. Any tip welcome. My main goal is to setup Nvidia home stream with Moonlight on this VM. I cant run the nvidia software since it is stuck at the driver install/detection.

 

<domain type='kvm' id='45'>
  <name>Game-VM</name>
  <uuid>f1071944-a469-b718-c8ae-695051294928</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>
  </metadata>
  <memory unit='KiB'>2621440</memory>
  <currentMemory unit='KiB'>2621440</currentMemory>
  <memoryBacking>
    <nosharepages/>
    <locked/>
  </memoryBacking>
  <vcpu placement='static'>4</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='1'/>
    <vcpupin vcpu='2' cpuset='4'/>
    <vcpupin vcpu='3' cpuset='5'/>
  </cputune>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/f1071944-a469-b718-c8ae-695051294928_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vendor id='none'/>
    </hyperv>
    <kvm>
      <hidden state='on'/>
    </kvm>
  </features>
  <cpu mode='host-passthrough'>
    <topology sockets='1' cores='2' threads='2'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/user/vDISK-Drives/Game-VM/vdisk1.img'/>
      <backingStore/>
      <target dev='hdc' bus='virtio'/>
      <boot order='1'/>
      <alias name='virtio-disk2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <alias name='usb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <alias name='usb'/>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <alias name='usb'/>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <alias name='usb'/>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'>
      <alias name='pci.0'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <alias name='virtio-serial0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:dd:e9:7b'/>
      <source bridge='br0'/>
      <target dev='vnet4'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <source path='/dev/pts/4'/>
      <target port='0'/>
      <alias name='serial0'/>
    </serial>
    <console type='pty' tty='/dev/pts/4'>
      <source path='/dev/pts/4'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <channel type='unix'>
      <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Game-VM/org.qemu.guest_agent.0'/>
      <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
      <alias name='channel0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <rom file='/mnt/user/Drivers/gtx780.3.rom'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
    </memballoon>
  </devices>
</domain>

 

Unraid info
M/B: ASRock - Z87E-ITX
CPU: Intel® Core™ i7-4771 CPU @ 3.50GHz
HVM: Enabled
IOMMU: Enabled
Cache: 256 kB, 1024 kB, 8192 kB
Memory: 16 GB (max. installable capacity 16 GB)
Network: eth0: 1000 Mb/s, full duplex, mtu 1500
Kernel: Linux 4.4.26-unRAID x86_64

 

This is also a headless setup. I use RDP all the time unless im doing an initial setup which I use VNC.

 

What am I missing? Many thanks in advance.

[jonp]

First and foremost, I would definitely recommend upgrading to 6.2.4 as soon as possible as there are numerous security fixes in that release.  Second of all, we need to see your system diagnostics.  You can obtain these from the Tools > Diagnostics page.  After downloading the zip, reply back here attaching it for our review.  Lastly, if the motherboard you are using does not have integrated graphics and the GTX 780 is the only GPU on the system, this is a known issue.  You must have a GPU dedicated to the host OS in order for a secondary GPU pass through to function properly.

[doroyce05]

My MB does use the iGPU. i7 4771 has the iGPU vs the "K" version. I've been using the integrated this whole time until I decided to get the GTX installed.

 

I just finished updating to 6.2.4. It actually went smoothly but I have not fully checked everything.

 

Here is the System Diagnostic file for the PCI items and IOMMU_GROUP. I dont know if i need to attached another file but I thought this is what you guys might need.

 

lspci

00:00.0 Host bridge [0600]: Intel Corporation 4th Gen Core Processor DRAM Controller [8086:0c00] (rev 06)
Subsystem: ASRock Incorporation 4th Gen Core Processor DRAM Controller [1849:0c00]
Kernel driver in use: hsw_uncore
00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller [8086:0c01] (rev 06)
Kernel driver in use: pcieport
00:14.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI [8086:8c31] (rev 05)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset Family USB xHCI [1849:8c31]
Kernel driver in use: xhci_hcd
00:16.0 Communication controller [0780]: Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #1 [8086:8c3a] (rev 04)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset Family MEI Controller [1849:8c3a]
00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet Connection I217-V [8086:153b] (rev 05)
Subsystem: ASRock Incorporation Ethernet Connection I217-V [1849:153b]
Kernel driver in use: e1000e
Kernel modules: e1000e
00:1a.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 [8086:8c2d] (rev 05)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset Family USB EHCI [1849:8c2d]
Kernel driver in use: ehci-pci
00:1b.0 Audio device [0403]: Intel Corporation 8 Series/C220 Series Chipset High Definition Audio Controller [8086:8c20] (rev 05)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset High Definition Audio Controller [1849:1150]
Kernel driver in use: vfio-pci
00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 [8086:8c10] (rev d5)
Kernel driver in use: pcieport
00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #4 [8086:8c16] (rev d5)
Kernel driver in use: pcieport
00:1d.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 [8086:8c26] (rev 05)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset Family USB EHCI [1849:8c26]
Kernel driver in use: ehci-pci
00:1f.0 ISA bridge [0601]: Intel Corporation Z87 Express LPC Controller [8086:8c44] (rev 05)
Subsystem: ASRock Incorporation Z87 Express LPC Controller [1849:8c44]
00:1f.2 RAID bus controller [0104]: Intel Corporation SATA Controller [RAID mode] [8086:2822] (rev 05)
Subsystem: ASRock Incorporation SATA Controller [RAID mode] [1849:2822]
Kernel driver in use: ahci
Kernel modules: ahci
00:1f.3 SMBus [0c05]: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller [8086:8c22] (rev 05)
Subsystem: ASRock Incorporation 8 Series/C220 Series Chipset Family SMBus Controller [1849:8c22]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK110 [GeForce GTX 780] [10de:1004] (rev a1)
Subsystem: Device [196e:104b]
Kernel driver in use: vfio-pci
01:00.1 Audio device [0403]: NVIDIA Corporation GK110 HDMI Audio [10de:0e1a] (rev a1)
Subsystem: Device [196e:104b]
Kernel driver in use: vfio-pci
03:00.0 Network controller [0280]: Broadcom Limited BCM4352 802.11ac Wireless Network Adapter [14e4:43b1] (rev 03)
Subsystem: AzureWave BCM4352 802.11ac Wireless Network Adapter [1a3b:2123]

 

 

iommu

/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/2/devices/0000:00:14.0
/sys/kernel/iommu_groups/3/devices/0000:00:16.0
/sys/kernel/iommu_groups/4/devices/0000:00:19.0
/sys/kernel/iommu_groups/5/devices/0000:00:1a.0
/sys/kernel/iommu_groups/6/devices/0000:00:1b.0
/sys/kernel/iommu_groups/7/devices/0000:00:1c.0
/sys/kernel/iommu_groups/8/devices/0000:00:1c.3
/sys/kernel/iommu_groups/9/devices/0000:00:1d.0
/sys/kernel/iommu_groups/10/devices/0000:00:1f.0
/sys/kernel/iommu_groups/10/devices/0000:00:1f.2
/sys/kernel/iommu_groups/10/devices/0000:00:1f.3
/sys/kernel/iommu_groups/11/devices/0000:01:00.0
/sys/kernel/iommu_groups/11/devices/0000:01:00.1
/sys/kernel/iommu_groups/12/devices/0000:03:00.0

 

Let me know if I missed something.

 

Thanks

 

[doroyce05]

I tried trying to get this working over the weekend without any success on getting rid of the Code 43.

 

My main goal is to get Nvidia streaming to work so that I can use moonlight for some lite gaming (Age of empires) with Steam. I dont have a monitor connected to this computer so i'm wondering if that is an issue.

 

[doroyce05]

OK so I reinstalled wind 10 pro again. I did switch it to Q35 2.5. Still no luck though. I do have it pointing to a rom for the card too. 

 

Im rally starting to run out ideas.

[JonathanM]

OK so I reinstalled wind 10 pro again. I did switch it to Q35 2.5. Still no luck though. I do have it pointing to a rom for the card too. 

 

Im rally starting to run out ideas.

Have you disabled the host VNC so the passed through GPU is the only video?

[doroyce05]

Have you disabled the host VNC so the passed through GPU is the only video?

 

I have done that also. I verified that my mobo is using the iGPU as primary also. I connected a monitor to the gpu to see if I can get anything but I just get the black screen. RDP work like a charm but with code 43 for the display driver.

[bungee91]

Questions, one possible dirty solution.

 

Where did the rom for the 780 come from, did you "cat" it yourself or grab it from the techpowerup?

Was there a condition other than this that prompted you to supply the rom for the card?

You have iGPU in the BIOS set as the primary GPU to boot from, and UnRAID console is displayed on that card?

 

Also (yes, yes, it's RC...), have you tried using 6.3.0? New QEMU, kernel, etc... worth trying, and extremely unlikely you're putting your data (if you even care; some don't) at risk.

 

Have you toggled advanced in the VM editor and turned off Hyper-v? This issue was supposedly fixed with Nvidia cards for 6.2, but could solve your issue for now and worth trying.

May have to reboot a time or two for it to take effect.

 

[doroyce05]

Sooo, I tried it again. i did the following:

 

Made sure the igpu is primary in the main bios

Clean install of win10

In the VM made sure that HT is off

Machine is set to Q35.25

Only attach vnc

 

once everything is up and activated i wen and shut down the vm from the vm. While it is off, I updated the gpu to use the GTX.  Powered up the vm and windows installed a driver then it asked me to restart. After restart, it was detecting the card without the code. Then i installed the newest driver found on the nvidia site.

 

With vm working correctly, i tackled the remote streaming with nvidia to ipad (moonlight). I also setup openvpn for that setup. The I also setup Hamachi with steam inhome stream fo the pc remote streaming.

 

 

So far everything is working and my Age of Empires hd is working perfectly remotely streamed to ipad, 2 different laptops and running it though a hotspot for testing.

 

Thanks guys