ccowin Posted April 11, 2023 Share Posted April 11, 2023 (edited) Hello, As the title states, on paper, I should be able to passthrough my GPU to a VM but it just isn't working. I've followed multiple guides but when they select the video and boot their VM it boots and mine just doesnt. unRAID: Latest version, installed on Sunday M/B: Micro-Star International Co., Ltd. B450 GAMING PRO CARBON AC (MS-7B85) Version 1.0 - s/n: J316294684 BIOS: American Megatrends Inc. Version 1.B0. Dated: 11/08/2019 CPU: AMD Ryzen 7 2700X Eight-Core @ 3700 MHz GPU: Nvidia 2080 TI (MSI) Steps: Set up unRAID VM Manager settings: PCIe ACS override: Downstream Downloaded VirtIO drivers for windows Installed VM w/o passthrough (Windows 11) Bound IOMMU group to vfio Rebooted Changed video/sound to 2080ti start VM, no boot sad me When that didnt work i looked on the forms and found folks adding vfio_iommu_type1.allow_unsafe_interrupts=1 and video=efifb:off to the syslinux config but neither worked independently nor together. I also tried dumping my GPU vBIOS with spaceinvaderone's script but it was saying my GPU wasn't bound when unRAID said it was. I'm going to update my bios as I noticed it was pretty old but I doubt that will do anything. I've tried everything I can think of and everything seems to say its working but I don't know enough about this to be sure so any guidance would be greatly appreciated. Happy to provide any more logs, just not sure what you might need. IOMMU Bind log: Quote text error warn system array login Loading config from /boot/config/vfio-pci.cfg BIND=0000:26:00.0|10de:1e07 0000:26:00.1|10de:10f7 0000:26:00.2|10de:1ad6 0000:26:00.3|10de:1ad7 --- Processing 0000:26:00.0 10de:1e07 Vendor:Device 10de:1e07 found at 0000:26:00.0 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:26:00.0/iommu_group/devices/0000:26:00.0 /sys/bus/pci/devices/0000:26:00.0/iommu_group/devices/0000:26:00.1 /sys/bus/pci/devices/0000:26:00.0/iommu_group/devices/0000:26:00.2 /sys/bus/pci/devices/0000:26:00.0/iommu_group/devices/0000:26:00.3 Binding... Unbound 0000:26:00.2 from xhci_hcd Successfully bound the device 10de:1e07 at 0000:26:00.0 to vfio-pci --- Processing 0000:26:00.1 10de:10f7 Vendor:Device 10de:10f7 found at 0000:26:00.1 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:26:00.1/iommu_group/devices/0000:26:00.0 /sys/bus/pci/devices/0000:26:00.1/iommu_group/devices/0000:26:00.1 /sys/bus/pci/devices/0000:26:00.1/iommu_group/devices/0000:26:00.2 /sys/bus/pci/devices/0000:26:00.1/iommu_group/devices/0000:26:00.3 Binding... 0000:26:00.0 already bound to vfio-pci 0000:26:00.1 already bound to vfio-pci 0000:26:00.2 already bound to vfio-pci 0000:26:00.3 already bound to vfio-pci Successfully bound the device 10de:10f7 at 0000:26:00.1 to vfio-pci --- Processing 0000:26:00.2 10de:1ad6 Vendor:Device 10de:1ad6 found at 0000:26:00.2 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:26:00.2/iommu_group/devices/0000:26:00.0 /sys/bus/pci/devices/0000:26:00.2/iommu_group/devices/0000:26:00.1 /sys/bus/pci/devices/0000:26:00.2/iommu_group/devices/0000:26:00.2 /sys/bus/pci/devices/0000:26:00.2/iommu_group/devices/0000:26:00.3 Binding... 0000:26:00.0 already bound to vfio-pci 0000:26:00.1 already bound to vfio-pci 0000:26:00.2 already bound to vfio-pci 0000:26:00.3 already bound to vfio-pci Successfully bound the device 10de:1ad6 at 0000:26:00.2 to vfio-pci --- Processing 0000:26:00.3 10de:1ad7 Vendor:Device 10de:1ad7 found at 0000:26:00.3 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:26:00.3/iommu_group/devices/0000:26:00.0 /sys/bus/pci/devices/0000:26:00.3/iommu_group/devices/0000:26:00.1 /sys/bus/pci/devices/0000:26:00.3/iommu_group/devices/0000:26:00.2 /sys/bus/pci/devices/0000:26:00.3/iommu_group/devices/0000:26:00.3 Binding... 0000:26:00.0 already bound to vfio-pci 0000:26:00.1 already bound to vfio-pci 0000:26:00.2 already bound to vfio-pci 0000:26:00.3 already bound to vfio-pci Successfully bound the device 10de:1ad7 at 0000:26:00.3 to vfio-pci --- vfio-pci binding complete Devices listed in /sys/bus/pci/drivers/vfio-pci: lrwxrwxrwx 1 root root 0 Apr 11 01:54 0000:26:00.0 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:26:00.0 lrwxrwxrwx 1 root root 0 Apr 11 01:54 0000:26:00.1 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:26:00.1 lrwxrwxrwx 1 root root 0 Apr 11 01:54 0000:26:00.2 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:26:00.2 lrwxrwxrwx 1 root root 0 Apr 11 01:54 0000:26:00.3 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:26:00.3 VM Log: Quote text error warn system array login 2023-04-11 01:58:22.147+0000: Starting external device: TPM Emulator /usr/bin/swtpm socket --ctrl type=unixio,path=/run/libvirt/qemu/swtpm/2-W11-swtpm.sock,mode=0600 --tpmstate dir=/var/lib/libvirt/swtpm/68b39582-4815-b61c-0574-370045ab8fe7/tpm2,mode=0600 --log file=/var/log/swtpm/libvirt/qemu/W11-swtpm.log --terminate --tpm2 2023-04-11 01:58:22.181+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 5.19.17-Unraid, hostname: Tower LC_ALL=C \ PATH=/bin:/sbin:/usr/bin:/usr/sbin \ HOME=/var/lib/libvirt/qemu/domain-2-W11 \ XDG_DATA_HOME=/var/lib/libvirt/qemu/domain-2-W11/.local/share \ XDG_CACHE_HOME=/var/lib/libvirt/qemu/domain-2-W11/.cache \ XDG_CONFIG_HOME=/var/lib/libvirt/qemu/domain-2-W11/.config \ /usr/local/sbin/qemu \ -name guest=W11,debug-threads=on \ -S \ -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-2-W11/master-key.aes"}' \ -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \ -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/68b39582-4815-b61c-0574-370045ab8fe7_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \ -machine pc-i440fx-7.1,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \ -accel kvm \ -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \ -m 12800 \ -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":13421772800}' \ -overcommit mem-lock=off \ -smp 14,sockets=1,dies=1,cores=7,threads=2 \ -uuid 68b39582-4815-b61c-0574-370045ab8fe7 \ -display none \ -no-user-config \ -nodefaults \ -chardev socket,id=charmonitor,fd=36,server=on,wait=off \ -mon chardev=charmonitor,id=monitor,mode=control \ -rtc base=localtime \ -no-hpet \ -no-shutdown \ -boot strict=on \ -device '{"driver":"ich9-usb-ehci1","id":"usb","bus":"pci.0","addr":"0x7.0x7"}' \ -device '{"driver":"ich9-usb-uhci1","masterbus":"usb.0","firstport":0,"bus":"pci.0","multifunction":true,"addr":"0x7"}' \ -device '{"driver":"ich9-usb-uhci2","masterbus":"usb.0","firstport":2,"bus":"pci.0","addr":"0x7.0x1"}' \ -device '{"driver":"ich9-usb-uhci3","masterbus":"usb.0","firstport":4,"bus":"pci.0","addr":"0x7.0x2"}' \ -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \ -blockdev '{"driver":"file","filename":"/mnt/user/domains/W11/vdisk1.img","node-name":"libvirt-3-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-3-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-3-storage"}' \ -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x4","drive":"libvirt-3-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \ -blockdev '{"driver":"file","filename":"/mnt/user/isos/Win11_22H2_English_x64v1.iso","node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-2-format","read-only":true,"driver":"raw","file":"libvirt-2-storage"}' \ -device '{"driver":"ide-cd","bus":"ide.0","unit":0,"drive":"libvirt-2-format","id":"ide0-0-0","bootindex":2}' \ -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \ -device '{"driver":"ide-cd","bus":"ide.0","unit":1,"drive":"libvirt-1-format","id":"ide0-0-1"}' \ -netdev tap,fd=37,id=hostnet0 \ -device '{"driver":"virtio-net","netdev":"hostnet0","id":"net0","mac":"52:54:00:fd:38:a5","bus":"pci.0","addr":"0x2"}' \ -chardev pty,id=charserial0 \ -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \ -chardev socket,id=charchannel0,fd=35,server=on,wait=off \ -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \ -chardev socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/2-W11-swtpm.sock \ -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \ -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \ -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \ -audiodev '{"id":"audio1","driver":"none"}' \ -device '{"driver":"vfio-pci","host":"0000:26:00.0","id":"hostdev0","bus":"pci.0","addr":"0x5"}' \ -device '{"driver":"vfio-pci","host":"0000:26:00.1","id":"hostdev1","bus":"pci.0","addr":"0x6"}' \ -device '{"driver":"vfio-pci","host":"0000:26:00.2","id":"hostdev2","bus":"pci.0","addr":"0x8"}' \ -device '{"driver":"vfio-pci","host":"0000:26:00.3","id":"hostdev3","bus":"pci.0","addr":"0x9"}' \ -device '{"driver":"usb-host","hostdevice":"/dev/bus/usb/001/006","id":"hostdev4","bus":"usb.0","port":"2"}' \ -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \ -msg timestamp=on char device redirected to /dev/pts/1 (label charserial0) Edited April 11, 2023 by ccowin 1 Quote Link to comment
HTO Posted April 12, 2023 Share Posted April 12, 2023 (edited) Hi! Im in the same situation! and i send a ticket for to support! my server is Ryzen 7 3700X ASUS B450 PRIME GAMINR/BR 16 GB DDR4 @2666 (2X8) GPU RTX 3060 12GB GTX 1660 super (second to test) CRUCIAL SSD 250GB SATA 3 I have an error with my GPU Virtual Machine installation. When I start the VM the server gets a Black Screen and doesn't come back. In VNC mode it works fine! I do all the recommended steps, including on other youtube channels. I changed RTX 3060 for GTX 1660s and the error persists, imagining that it could be a mistake with the 3060. I tried to login with Google Remote Desktop and the VM run but, Too much lag and the GPU recognized but with error, and executed with Basic Microsoft Video in a fixed resolution 640x480p. And when I try to install the driver, it returns the message that "The best driver is installed" and it does not allow to update driver Can Support help install the VM correctly to work with nVidia GPU? Thanks Edited April 12, 2023 by HTO Quote Link to comment
Squid Posted April 12, 2023 Share Posted April 12, 2023 Have you tried specifying the vBIOS file for the GPU? There's a video here Quote Link to comment
ccowin Posted April 13, 2023 Author Share Posted April 13, 2023 I was unable to dump my own as the script wouldn't recognize my card. But I was able to get the copy online and edit with the hex editor but it still didnt work Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 On 4/12/2023 at 8:49 PM, Squid said: Have you tried specifying the vBIOS file for the GPU? There's a video here I make this and i have this errors now Quote Link to comment
SimonF Posted April 14, 2023 Share Posted April 14, 2023 10 minutes ago, HTO said: I make this and i have this errors now Are you able to post a copy of system devices? Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 (edited) 3 minutes ago, SimonF said: Você pode postar uma cópia dos dispositivos do sistema? Yes, PCI Devices and IOMMU Groups IOMMU group 0:[1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 1:[1022:1483] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 2:[1022:1483] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 3:[1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 4:[1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 5:[1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 6:[1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 7:[1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 8:[1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 9:[1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 10:[1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 11:[1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 12:[1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 13:[1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 14:[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61) [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) IOMMU group 15:[1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0 [1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1 [1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2 [1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3 [1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4 [1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5 [1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6 [1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7 IOMMU group 16:[c0a9:2263] 01:00.0 Non-Volatile memory controller: Micron/Crucial Technology P1 NVMe PCIe SSD (rev 03) [N:0:1:1] disk CT500P1SSD8__1 /dev/nvme0n1 500GB IOMMU group 17:[1022:43d5] 02:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset USB 3.1 XHCI Controller (rev 01) Bus 001 Device 001 Port 1-0 ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 002 Device 001 Port 2-0 ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 002 Device 002 Port 2-2 ID 0951:1666 Kingston Technology DataTraveler 100 G3/G4/SE9 G2/50 [1022:43c8] 02:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset SATA Controller (rev 01) [1:0:0:0] disk ATA Crucial_CT275MX3 R060 /dev/sdb 275GB [1022:43c6] 02:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Bridge (rev 01) [1022:43c7] 03:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [10ec:8168] 08:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15) IOMMU group 18:[10de:2503] 09:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060] (rev a1) [10de:228e] 09:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1) IOMMU group 19:[1022:148a] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function IOMMU group 20:[1022:1485] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP IOMMU group 21:[1022:1486] 0b:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP IOMMU group 22:[1022:149c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller Bus 003 Device 001 Port 3-0 ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 003 Device 002 Port 3-1 ID 2516:014f Cooler Master Co., Ltd. CK351 Gaming Optical Switch Keyboard Bus 003 Device 003 Port 3-2 ID 046d:c07e Logitech, Inc. G402 Gaming Mouse Bus 003 Device 004 Port 3-4 ID 046d:0a64 Logitech, Inc. Logi USB Headset Bus 004 Device 001 Port 4-0 ID 1d6b:0003 Linux Foundation 3.0 root hub IOMMU group 23:[1022:1487] 0b:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller IOMMU group 24:[1022:7901] 0c:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 25:[1022:7901] 0d:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) CPU Thread Pairings Pair 1:cpu 0 / cpu 8 Pair 2:cpu 1 / cpu 9 Pair 3:cpu 2 / cpu 10 Pair 4:cpu 3 / cpu 11 Pair 5:cpu 4 / cpu 12 Pair 6:cpu 5 / cpu 13 Pair 7:cpu 6 / cpu 14 Pair 8:cpu 7 / cpu 15 USB Devices Bus 001 Device 001 Port 1-0ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 002 Device 001 Port 2-0ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 002 Device 002 Port 2-2ID 0951:1666 Kingston Technology DataTraveler 100 G3/G4/SE9 G2/50 Bus 003 Device 001 Port 3-0ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 003 Device 002 Port 3-1ID 2516:014f Cooler Master Co., Ltd. CK351 Gaming Optical Switch Keyboard Bus 003 Device 003 Port 3-2ID 046d:c07e Logitech, Inc. G402 Gaming Mouse Bus 003 Device 004 Port 3-4ID 046d:0a64 Logitech, Inc. Logi USB Headset Bus 004 Device 001 Port 4-0ID 1d6b:0003 Linux Foundation 3.0 root hub SCSI Devices [0:0:0:0]disk Kingston DataTraveler 3.0 /dev/sda 30.9GB [1:0:0:0]disk ATA Crucial_CT275MX3 R060 /dev/sdb 275GB [N:0:1:1]disk CT500P1SSD8__1 /dev/nvme0n1 500GB Edited April 14, 2023 by HTO Quote Link to comment
SimonF Posted April 14, 2023 Share Posted April 14, 2023 2 minutes ago, HTO said: Yes, PCI Devices and IOMMU Groups IOMMU group 0:[1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 1:[1022:1483] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 2:[1022:1483] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 3:[1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 4:[1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 5:[1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 6:[1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 7:[1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 8:[1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 9:[1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 10:[1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 11:[1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 12:[1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 13:[1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 14:[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61) [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) IOMMU group 15:[1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0 [1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1 [1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2 [1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3 [1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4 [1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5 [1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6 [1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7 IOMMU group 16:[c0a9:2263] 01:00.0 Non-Volatile memory controller: Micron/Crucial Technology P1 NVMe PCIe SSD (rev 03) [N:0:1:1] disk CT500P1SSD8__1 /dev/nvme0n1 500GB IOMMU group 17:[1022:43d5] 02:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset USB 3.1 XHCI Controller (rev 01) Bus 001 Device 001 Port 1-0 ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 002 Device 001 Port 2-0 ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 002 Device 002 Port 2-2 ID 0951:1666 Kingston Technology DataTraveler 100 G3/G4/SE9 G2/50 [1022:43c8] 02:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset SATA Controller (rev 01) [1:0:0:0] disk ATA Crucial_CT275MX3 R060 /dev/sdb 275GB [1022:43c6] 02:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Bridge (rev 01) [1022:43c7] 03:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 03:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [10ec:8168] 08:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15) IOMMU group 18:[10de:2503] 09:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060] (rev a1) [10de:228e] 09:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1) IOMMU group 19:[1022:148a] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function IOMMU group 20:[1022:1485] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP IOMMU group 21:[1022:1486] 0b:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP IOMMU group 22:[1022:149c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller Bus 003 Device 001 Port 3-0 ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 003 Device 002 Port 3-1 ID 2516:014f Cooler Master Co., Ltd. CK351 Gaming Optical Switch Keyboard Bus 003 Device 003 Port 3-2 ID 046d:c07e Logitech, Inc. G402 Gaming Mouse Bus 003 Device 004 Port 3-4 ID 046d:0a64 Logitech, Inc. Logi USB Headset Bus 004 Device 001 Port 4-0 ID 1d6b:0003 Linux Foundation 3.0 root hub IOMMU group 23:[1022:1487] 0b:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller IOMMU group 24:[1022:7901] 0c:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 25:[1022:7901] 0d:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) You only have 9.0 and 9.1 not 9.3 where did that come from? IOMMU group 18:[10de:2503] 09:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060] (rev a1) [10de:228e] 09:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1) Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 Just now, SimonF said: You only have 9.0 and 9.1 not 9.3 where did that come from? IOMMU group 18:[10de:2503] 09:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060] (rev a1) [10de:228e] 09:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1) I dont know where come this 09:00.3 in error print... Here VM log, maybe can help: 2023-04-14 14:08:58.641+0000: Starting external device: TPM Emulator /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/3-Windows 11-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/2797c2c6-f64f-4527-71b3-d7bb395409fc/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Windows 11-swtpm.log' --terminate --tpm2 2023-04-14 14:08:58.666+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 5.19.17-Unraid, hostname: Tower LC_ALL=C \ PATH=/bin:/sbin:/usr/bin:/usr/sbin \ HOME='/var/lib/libvirt/qemu/domain-3-Windows 11' \ XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-3-Windows 11/.local/share' \ XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-3-Windows 11/.cache' \ XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-3-Windows 11/.config' \ /usr/local/sbin/qemu \ -name 'guest=Windows 11,debug-threads=on' \ -S \ -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-3-Windows 11/master-key.aes"}' \ -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \ -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/2797c2c6-f64f-4527-71b3-d7bb395409fc_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \ -machine pc-i440fx-7.1,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \ -accel kvm \ -cpu host,migratable=on,topoext=on,hv-time=on,host-cache-info=on,l3-cache=off \ -m 4096 \ -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":4294967296}' \ -overcommit mem-lock=off \ -smp 8,sockets=1,dies=1,cores=4,threads=2 \ -uuid 2797c2c6-f64f-4527-71b3-d7bb395409fc \ -display none \ -no-user-config \ -nodefaults \ -chardev socket,id=charmonitor,fd=36,server=on,wait=off \ -mon chardev=charmonitor,id=monitor,mode=control \ -rtc base=localtime \ -no-hpet \ -no-shutdown \ -boot strict=on \ -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \ -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x3"}' \ -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x4"}' \ -blockdev '{"driver":"file","filename":"/mnt/disk1/Windows 11/vdisk1.qcow2","node-name":"libvirt-3-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-3-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"qcow2","file":"libvirt-3-storage","backing":null}' \ -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-3-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \ -blockdev '{"driver":"file","filename":"/mnt/user/isos/Win11_22H2_BrazilianPortuguese_x64v1.iso","node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-2-format","read-only":true,"driver":"raw","file":"libvirt-2-storage"}' \ -device '{"driver":"ide-cd","bus":"sata0.0","drive":"libvirt-2-format","id":"sata0-0-0","bootindex":2}' \ -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \ -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \ -netdev tap,fd=37,id=hostnet0 \ -device '{"driver":"virtio-net","netdev":"hostnet0","id":"net0","mac":"52:54:00:d6:a7:01","bus":"pci.0","addr":"0x2"}' \ -chardev pty,id=charserial0 \ -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \ -chardev socket,id=charchannel0,fd=35,server=on,wait=off \ -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \ -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/3-Windows 11-swtpm.sock' \ -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \ -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \ -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \ -audiodev '{"id":"audio1","driver":"none"}' \ -device '{"driver":"vfio-pci","host":"0000:09:00.0","id":"hostdev0","bus":"pci.0","addr":"0xa","romfile":"/mnt/user/isos/vbios/rtx 3060 12g.rom"}' \ -device '{"driver":"vfio-pci","host":"0000:09:00.3","id":"hostdev1","bus":"pci.0","addr":"0xb"}' \ -device '{"driver":"vfio-pci","host":"0000:09:00.1","id":"hostdev2","bus":"pci.0","addr":"0x6"}' \ -device '{"driver":"vfio-pci","host":"0000:0b:00.4","id":"hostdev3","bus":"pci.0","addr":"0x8"}' \ -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \ -msg timestamp=on libvirt: error : libvirtd quit during handshake: Input/output error 2023-04-14 14:08:58.683+0000: shutting down, reason=failed Quote Link to comment
SimonF Posted April 14, 2023 Share Posted April 14, 2023 3 minutes ago, HTO said: -device '{"driver":"vfio-pci","host":"0000:09:00.3","id":"hostdev1","bus":"pci.0","addr":"0xb"}' \ you need to remove the hostdev for this part from xml. Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 4 minutes ago, SimonF said: you need to remove the hostdev for this part from xml. where i find XML to edit it? Can help, im new in Linux plataform and this is my first contact with this. Quote Link to comment
SimonF Posted April 14, 2023 Share Posted April 14, 2023 2 minutes ago, HTO said: where i find XML to edit it? Can help, im new in Linux plataform and this is my first contact with this. Edit VM then change to form view. Scroll down until you find the section <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/> </hostdev> that has source bus = 9 slot = 0 function = 3 and remove that hostdev section. Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 (edited) 36 minutes ago, SimonF said: Edit VM then change to form view. Scroll down until you find the section <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/> </hostdev> that has source bus = 9 slot = 0 function = 3 and remove that hostdev section. This error is gone... I can start VM, but, still in Black Screen The black screen still there Thanks for you helping in this situation but, the error still there Edited April 14, 2023 by HTO Quote Link to comment
SimonF Posted April 14, 2023 Share Posted April 14, 2023 2 hours ago, HTO said: This error is gone... I can start VM, but, still in Black Screen The black screen still there Thanks for you helping in this situation but, the error still there try adding this video=efifb:off to the append statement in syslinux, you can get to it by clicking on flash in main, example below, just add to end of append line yours may be differnet. You will need to reboot. label Unraid OS menu default kernel /bzimage append initrd=/bzroot pci=noaer pcie_acs_override=downstream,multifunction video=efifb:off If the above doesn't wok try without the vbios and/or using machine type Q35 as an option? Quote Link to comment
HTO Posted April 14, 2023 Share Posted April 14, 2023 35 minutes ago, SimonF said: try adding this video=efifb:off to the append statement in syslinux, you can get to it by clicking on flash in main, example below, just add to end of append line yours may be differnet. You will need to reboot. label Unraid OS menu default kernel /bzimage append initrd=/bzroot pci=noaer pcie_acs_override=downstream,multifunction video=efifb:off If the above doesn't wok try without the vbios and/or using machine type Q35 as an option? I try "video=efifb:off" but dont work When i try change to Q35 new error apear and cant change .... I'm already starting to give up and believe that unRaid doesn't work. I watched video drawings, tested several options, but still Black Screen. In VNC it works perfectly! But I need 2 VM to connect my wife and me on PC. ... Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.