Replacement of GPU for passthrough

[darrenyorston]

As  a result of a GPU failing Im trying to add a replacement but am encountering difficulties. I am trying to use the VFIO-PCI Config app. The GPU is an NVIDIA RTX2060 Super OC.

 

VFIO-PCI shows the following IOMMU information:

 

Group 52 43:00.010de:1f06VGA compatible controller: NVIDIA Corporation TU106 [GeForce RTX 2060 SUPER] (rev a1)

Group 53 43:00.110de:10f9Audio device: NVIDIA Corporation TU106 High Definition Audio Controller (rev a1)

Group 54 43:00.210de:1adaUSB controller: NVIDIA Corporation TU106 USB 3.1 Host Controller (rev a1)

USB devices attached to this controller:

Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub

Group 55 43:00.310de:1adbSerial bus controller [0c80]: NVIDIA Corporation TU106 USB Type-C UCSI Controller (rev a1)

 

My previous GPU, a GTX 1080FTW, didnt have the two USB controllers onboard.

 

Ive checked the four IOMMU groups, saved and rebooted.

 

When I create a Windows 10 VM it says its running but there is no display. The log doesnt appear to report any errors, log below.

 

I not confident about the Graphics ROM bios. Ive found the correct one but when I look at it with a hex editor the text that Spaceinvader One said to look for is almost three quarters of the way through the file.

-------------------------

 

-device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \
-device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \
-device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \
-device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \
-device pcie-root-port,port=0xd,chassis=6,id=pci.6,bus=pcie.0,addr=0x1.0x5 \
-device pcie-root-port,port=0xe,chassis=7,id=pci.7,bus=pcie.0,addr=0x1.0x6 \
-device pcie-root-port,port=0xf,chassis=8,id=pci.8,bus=pcie.0,addr=0x1.0x7 \
-device ich9-usb-ehci1,id=usb,bus=pcie.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pcie.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pcie.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pcie.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.2,addr=0x0 \
-blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 10/vdisk1.img","node-name":"libvirt-3-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-3-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-3-storage"}' \
-device virtio-blk-pci,scsi=off,bus=pci.3,addr=0x0,drive=libvirt-3-format,id=virtio-disk2,bootindex=1,write-cache=on \
-blockdev '{"driver":"file","filename":"/mnt/user/isos/Windows10.iso","node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-2-format","read-only":true,"driver":"raw","file":"libvirt-2-storage"}' \
-device ide-cd,bus=ide.0,drive=libvirt-2-format,id=sata0-0-0,bootindex=2 \
-blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.173-2.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
-device ide-cd,bus=ide.1,drive=libvirt-1-format,id=sata0-0-1 \
-netdev tap,fd=35,id=hostnet0,vhost=on,vhostfd=36 \
-device virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:73:ad:d9,bus=pci.1,addr=0x0 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=38,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device vfio-pci,host=0000:43:00.0,id=hostdev0,x-vga=on,bus=pci.4,addr=0x0,romfile=/mnt/user/isos/Gigabyte.RTX2060SuperDump.rom \
-device vfio-pci,host=0000:43:00.1,id=hostdev1,bus=pci.5,addr=0x0 \
-device vfio-pci,host=0000:43:00.2,id=hostdev2,bus=pci.6,addr=0x0 \
-device vfio-pci,host=0000:43:00.3,id=hostdev3,bus=pci.7,addr=0x0 \
-device usb-host,hostbus=5,hostaddr=8,id=hostdev4,bus=usb.0,port=1 \
-device usb-host,hostbus=6,hostaddr=3,id=hostdev5,bus=usb.0,port=2 \
-device usb-host,hostbus=5,hostaddr=6,id=hostdev6,bus=usb.0,port=3 \
-device usb-host,hostbus=5,hostaddr=4,id=hostdev7,bus=usb.0,port=4 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-11-15 06:21:55.724+0000: Domain id=1 is tainted: high-privileges
2020-11-15 06:21:55.724+0000: Domain id=1 is tainted: host-cpu
char device redirected to /dev/pts/0 (label charserial0)

[Prokie]

Have you tried to dump the bios yourself? I could not get my GPU passthrough to with the ones online and had to flash my own vbios.

[darrenyorston]

No I have not. I dont have a PC other than my unraid server, or laptops but they are not helpful.

 

I think I may have resolved the issue, at the moment anyway. The RTX 2060 has two onboard USB controllers, whereas my GTX1080 didnt have either. I had to pass through the USB controllers through as another PCIe device. Also, I found that the edited vBIOS from TechPowerUP didnt work. I had tried to edit it as per SpaceinvadersOne's video. The raw vBIOS works though, but not with the Q35-4.2 Machine setting. I had to go back to the i440fx-4.2 setting.