Quadro 4000 GPU-Passthrough BSOD


18 posts in this topic Last Reply

Recommended Posts

I have been trying to passthrough my quadro 4000 to a windows 7 or 10 vm for months now and have had no succes, I hope someone can help me.

 

System:

Hp Z800, running the latest Bios

CPU: 2x Xeon X5675

Ram: 4x 8GB 1333MHz DDR3 ECC

GPU1: Gt 210 for unraid screen

GPU2: Quadro 4000 (the one I am trying to passthrough)

Storage: 500GB Samsung 850 EVO SSD + 4x 2TB WD Red

Unraid version: 6.5.3

 

HVM and IOMMU are enabled.

 

What I am trying to do and how:

This is the setup one which I have come the farthest (tried on Windows 7 and 10):

I am getting BSOD with STOP code: SYSTEM_THREAD_EXCEPTION_NOT_HANDLED, and failed: nvlddmkm.sys

 

VM:

Machine: i440fx-2.11

Bios: SeaBios

Hyper-V: No

Primary vDisk Bus: SATA

GPU(s): (Tried with GPU1: VNC and GPU2: Quadro 4000 and just GPU1: Quadro 4000)

Sound Card: GF100 (Quadro 4000)

 

Syslinux configuration:

 

default menu.c32
menu title Lime Technology, Inc.
prompt 0
timeout 50
label unRAID OS
  menu default
  kernel /bzimage
  append pcie_acs_override=downstream vfio_iommu_type1.allow_unsafe_interrupts=1 kvm.ignore_msrs=1 initrd=/bzroot
label unRAID OS GUI Mode
  kernel /bzimage
  append pcie_acs_override=downstream vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot,/bzroot-gui
label unRAID OS Safe Mode (no plugins, no GUI)
  kernel /bzimage
  append pcie_acs_override=downstream initrd=/bzroot unraidsafemode
label unRAID OS GUI Safe Mode (no plugins)
  kernel /bzimage
  append pcie_acs_override=downstream initrd=/bzroot,/bzroot-gui unraidsafemode
label Memtest86+
  kernel /memtest

 

I hope someone can help me out, if more information is needed just ask for it.

Edited by JMineable
Link to post
Tried replacing the bzimage, but still the same result.
IIRC there's a setting that you can toggle for Hyper-V enhancements, try turning that off/on and see what you get, beyond that, attach a system log of your unraid server and maybe export your Event Viewer logs from Windows.

Sent from my SM-G955U using Tapatalk

Link to post

The VM will only boot in safe mode and I couldn't find any logs. Really don't know what you need.

 

VM log:

 

ErrorWarningSystemArrayLogin


2018-08-03 20:02:57.175+0000: starting up libvirt version: 4.0.0, qemu version: 2.11.1, hostname: TheCore
LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name 'guest=Windows 10 Sata,, GPU test,debug-threads=on' -S -object 'secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-2-Windows 10 Sata,, GPU/master-key.aes' -machine pc-i440fx-2.11,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host -m 8192 -realtime mlock=off -smp 8,sockets=1,cores=4,threads=2 -uuid 71c1e611-39fc-c3cc-2f04-dd10db395a97 -no-user-config -nodefaults -chardev 'socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-2-Windows 10 Sata,, GPU/monitor.sock,server,nowait' -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device ich9-usb-ehci1,id=usb,bus=pci.0,addr=0x7.0x7 -device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pci.0,multifunction=on,addr=0x7 -device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pci.0,addr=0x7.0x1 -de,server,nowait' -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device usb-tablet,id=input0,bus=usb.0,port=1 -vnc 0.0.0.0:1,websocket=5701 -k en-us -device qxl-vga,id=video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pci.0,addr=0x2 -device vfio-pci,host=42:00.0,id=hostdev0,bus=pci.0,addr=0x6 -device vfio-pci,host=42:00.1,id=hostdev1,bus=pci.0,addr=0x8 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x9 -msg timestamp=on
2018-08-03 20:02:57.175+0000: Domain id=2 is tainted: high-privileges
2018-08-03 20:02:57.175+0000: Domain id=2 is tainted: host-cpu
2018-08-03T20:02:57.239087Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/1 (label charserial0)
2018-08-03T20:06:20.561626Z qemu-system-x86_64: terminating on signal 15 from pid 21255 (/usr/sbin/libvirtd)
2018-08-03 20:06:22.362+0000: shutting down, reason=destroyed
2018-08-03 20:50:29.106+0000: starting up libvirt version: 4.0.0, qemu version: 2.11.1, hostname: TheCore
LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name 'guest=Windows 10 Sata,, GPU test,debug-threads=on' -S -object 'secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-3-Windows 10 Sata,, GPU/master-key.aes' -machine pc-i440fx-2.11,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host,hv_time,hv_relaxed,hv_vapic,hv_spinlocks=0x1fff,hv_vendor_id=none -m 8192 -realtime mlock=off -smp 8,sockets=1,cores=4,threads=2 -uuid 71c1e611-39fc-c3cc-2f04-dd10db395a97 -no-user-config -nodefaults -chardev 'socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-3-Windows 10 Sata,, GPU/monitor.sock,server,nowait' -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime -no-hpet -no-shutdown -boot strict=on -device ich9-usb-ehci1,id=usb,bus=pci.0,addr=0x7.0x7 -device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pci.0,multifunction=on,addr=0x7 -device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pci.0,addguest_agent.0,server,nowait' -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device usb-tablet,id=input0,bus=usb.0,port=1 -vnc 0.0.0.0:1,websocket=5701 -k en-us -device qxl-vga,id=video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pci.0,addr=0x2 -device vfio-pci,host=42:00.0,id=hostdev0,bus=pci.0,addr=0x6 -device vfio-pci,host=42:00.1,id=hostdev1,bus=pci.0,addr=0x8 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x9 -msg timestamp=on
2018-08-03 20:50:29.106+0000: Domain id=3 is tainted: high-privileges
2018-08-03 20:50:29.106+0000: Domain id=3 is tainted: host-cpu
2018-08-03T20:50:29.172517Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/1 (label charserial0)
2018-08-03T21:33:30.340630Z qemu-system-x86_64: warning: guest updated active QH
2018-08-03T21:33:44.947924Z qemu-system-x86_64: terminating on signal 15 from pid 21255 (/usr/sbin/libvirtd)
2018-08-03 21:33:46.775+0000: shutting down, reason=shutdown

thecore-syslog-20180803-2330.zip

Link to post

You could try dumping the vbios, or modifying one from tech powerup and passing that to the vm.

 

https://www.techpowerup.com/vgabios/?architecture=NVIDIA&manufacturer=NVIDIA&model=Quadro+4000&interface=&memType=&memSize=&since=

 

https://www.youtube.com/watch?v=1IP-h9IKof0

 

 

but also

 

2 hours ago, 1812 said:

that card might be too old if it's from 2010.

 

Link to post
You could try dumping the vbios, or modifying one from tech powerup and passing that to the vm.
 
https://www.techpowerup.com/vgabios/?architecture=NVIDIA&manufacturer=NVIDIA&model=Quadro+4000&interface=&memType=&memSize=&since=
 

 
 
but also
 
 
Ditto, had issues getting anything from Fermi down working. Once you go Kepler up then things start working.

Sent from my SM-G955U using Tapatalk

Link to post
If I get a Quadro k4000 wil I be fine? This card reasonable affordable.
If depends, you just have to try it to find out unfortunately.
Sorry to ask, what do you need Quadro for? I need a p4000 for Plex once the price falls more. I want unlimited streams, the two limit that normal GeForce cards have are too limited for me.

Sent from my SM-G955U using Tapatalk

Link to post
20 hours ago, AnnabellaRenee87 said:

Sorry to ask, what do you need Quadro for?

I am using it for a solid works export server.

 

5 hours ago, Siwat2545 said:

I also have a quadro 4000 the problem is that it doesn’t support pci power reset so basically you need a new gpu that support reset control Reference: https://wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF#Passing_through_a_device_that_does_not_support_resetting

Thanks!

Link to post
  • 2 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.