fakh2006 Posted January 20, 2019 Share Posted January 20, 2019 Hi, I am having problem with video card passthrough, it worked on first try with nvidia drivers for 2070GTX then I formatted the array and redid the whole thing and it doesnt work anymore, I get the video card to appear disabled under windows 10. I tried these command : echo 0 > /sys/class/vtconsole/vtcon0/bind echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind I even put them in user script, sometimes it works, sometimes it doesnt. I have no idea what is going on, I attached the VM machine log file. hope someone can help. New Text Document.txt Quote Link to comment
fakh2006 Posted January 21, 2019 Author Share Posted January 21, 2019 So I think this link solved my problem in case someone is looking for a solution Quote Link to comment
fakh2006 Posted January 23, 2019 Author Share Posted January 23, 2019 In addition and most importantly, when you create the USB flash drive for Unraid, don't click the "allow UEFI boot" check box option at all !!!! this will make the unraid claim a single video card for it, so unless you want to do that and have multiple video cards in your system, it will cause your windows VM to never recognize the video card and will allways show as a failed device in the device manager. I found all of this after several research and old posts and youtube comments about videos.. so I hope it saves someones's time Quote Link to comment
fakh2006 Posted January 23, 2019 Author Share Posted January 23, 2019 For the sake of all new users, maybe there should be a sticky topic about all of this ?? so no one wastes..... Quote Link to comment
1812 Posted January 23, 2019 Share Posted January 23, 2019 3 hours ago, fakh2006 said: For the sake of all new users, maybe there should be a sticky topic about all of this ?? so no one wastes..... there are no less than 40-60 items this category would fall under, making it unreasonable to do. Quote Link to comment
Warrentheo Posted January 23, 2019 Share Posted January 23, 2019 In the future, https://forums.unraid.net/forum/51-vm-engine-kvm/ is a better place to go looking for VM support... Something you can do to prevent the video card issues is add the video card to the VFIO driver before UnRaid can get ahold of it... This will make UnRaid not have a GPU, but on some setups it is OK to go headless after it is setup... To do this, try adding something like: vfio-pci.ids=10de:1b81,10de:10f0 to your sysconfig file so that it looks like this: append vfio-pci.ids=10de:1b81,10de:10f0 initrd=/bzroot (edited for your devices, make sure to pass everything from the same IOMMU group...) or something changing in 6.7.0-RC you can change it to something like this: append BIND=01:00.0 initrd=/bzroot (Again edited for your device, but this time only needs one device in the IOMMU group) It will auto-add all the rest from the same group... Be careful enabling or modifying devices on your system after that though, since a hardware change can modify the slot mappings... The upside of this one though is if you have multiple devices with the same hardware ID, you can specify specifically which one... Quote Link to comment
fakh2006 Posted January 27, 2019 Author Share Posted January 27, 2019 On 1/24/2019 at 12:55 AM, Warrentheo said: In the future, https://forums.unraid.net/forum/51-vm-engine-kvm/ is a better place to go looking for VM support... Something you can do to prevent the video card issues is add the video card to the VFIO driver before UnRaid can get ahold of it... This will make UnRaid not have a GPU, but on some setups it is OK to go headless after it is setup... To do this, try adding something like: vfio-pci.ids=10de:1b81,10de:10f0 to your sysconfig file so that it looks like this: append vfio-pci.ids=10de:1b81,10de:10f0 initrd=/bzroot (edited for your devices, make sure to pass everything from the same IOMMU group...) or something changing in 6.7.0-RC you can change it to something like this: append BIND=01:00.0 initrd=/bzroot (Again edited for your device, but this time only needs one device in the IOMMU group) It will auto-add all the rest from the same group... Be careful enabling or modifying devices on your system after that though, since a hardware change can modify the slot mappings... The upside of this one though is if you have multiple devices with the same hardware ID, you can specify specifically which one... Thanks for the reply, I added another video card 2070 RTX for the 2nd VM, but now I am back to same old problem, seems like I can have on enabled at a time, but I have to try your method above. so I need to append both videocards to the sysconfig ? Quote Link to comment
fakh2006 Posted January 27, 2019 Author Share Posted January 27, 2019 This is my devices list - I have two video cards in two different IOMMU groups IOMMU group 0:[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 1:[1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 2:[1022:1453] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 3:[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 4:[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 5:[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 6:[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 7:[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 8:[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 9:[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 10:[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 11:[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 12:[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59) [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) IOMMU group 13:[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 14:[1022:1460] 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 15:[1022:1460] 00:1a.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:1a.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:1a.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:1a.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:1a.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:1a.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:1a.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:1a.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 16:[1022:1460] 00:1b.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:1b.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:1b.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:1b.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:1b.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:1b.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:1b.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:1b.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 17:[1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02) IOMMU group 18:[1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02) IOMMU group 19:[1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02) IOMMU group 20:[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1b21:2142] 03:00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller IOMMU group 21:[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) IOMMU group 22:[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [8086:2526] 05:00.0 Network controller: Intel Corporation Wireless-AC 9260 (rev 29) IOMMU group 23:[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) IOMMU group 24:[1022:43b4] 02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) IOMMU group 25:[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [8086:1539] 08:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) IOMMU group 26:[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [8086:1539] 09:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) IOMMU group 27:[144d:a808] 0a:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 IOMMU group 28:[14e4:168e] 0b:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10) IOMMU group 29:[14e4:168e] 0b:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10) IOMMU group 30:[10de:1f07] 0c:00.0 VGA compatible controller: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] (rev a1) IOMMU group 31:[10de:10f9] 0c:00.1 Audio device: NVIDIA Corporation Device 10f9 (rev a1) IOMMU group 32:[10de:1ada] 0c:00.2 USB controller: NVIDIA Corporation Device 1ada (rev a1) IOMMU group 33:[10de:1adb] 0c:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device 1adb (rev a1) IOMMU group 34:[1022:145a] 0d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a IOMMU group 35:[1022:1456] 0d:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 36:[1022:145f] 0d:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] USB 3.0 Host controller IOMMU group 37:[1022:1455] 0e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455 IOMMU group 38:[1022:7901] 0e:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 39:[1022:1457] 0e:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller IOMMU group 40:[1022:1452] 20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 41:[1022:1452] 20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 42:[1022:1452] 20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 43:[1022:1452] 20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 44:[1022:1452] 20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 45:[1022:1454] 20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 46:[1022:1452] 20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 47:[1022:1454] 20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 48:[1022:145a] 21:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a IOMMU group 49:[1022:1456] 21:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 50:[1022:1455] 22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455 IOMMU group 51:[1022:1452] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 52:[1022:1453] 40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 53:[1022:1453] 40:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 54:[1022:1452] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 55:[1022:1452] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 56:[1022:1453] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 57:[1022:1452] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 58:[1022:1452] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 59:[1022:1454] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 60:[1022:1452] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 61:[1022:1454] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 62:[144d:a808] 41:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 IOMMU group 63:[144d:a808] 42:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 IOMMU group 64:[10de:1f07] 43:00.0 VGA compatible controller: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] (rev a1) IOMMU group 65:[10de:10f9] 43:00.1 Audio device: NVIDIA Corporation Device 10f9 (rev a1) IOMMU group 66:[10de:1ada] 43:00.2 USB controller: NVIDIA Corporation Device 1ada (rev a1) IOMMU group 67:[10de:1adb] 43:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device 1adb (rev a1) IOMMU group 68:[1022:145a] 44:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a IOMMU group 69:[1022:1456] 44:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 70:[1022:145f] 44:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] USB 3.0 Host controller IOMMU group 71:[1022:1455] 45:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455 IOMMU group 72:[1022:7901] 45:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 73:[1022:1452] 60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 74:[1022:1452] 60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 75:[1022:1452] 60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 76:[1022:1452] 60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 77:[1022:1452] 60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 78:[1022:1454] 60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 79:[1022:1452] 60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge IOMMU group 80:[1022:1454] 60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 81:[1022:145a] 61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a IOMMU group 82:[1022:1456] 61:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 83:[1022:1455] 62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455 Quote Link to comment
Warrentheo Posted January 27, 2019 Share Posted January 27, 2019 This is a pretty complex setup, can you post your diagnostics file and the VM XML file? Quote Link to comment
fakh2006 Posted January 27, 2019 Author Share Posted January 27, 2019 Solved I added the following line to my config file on the flash for all 4 address that belonged to the same IOMMU group : label Unraid OS menu default kernel /bzimage append vfio-pci.ids=10de:1f07,10de:10f9,10de:1ada,10de:1adb initrd=/bzroot Quote Link to comment
fakh2006 Posted January 27, 2019 Author Share Posted January 27, 2019 2 hours ago, Warrentheo said: This is a pretty complex setup, can you post your diagnostics file and the VM XML file? Here are the files VM XML.txt towerunraid-diagnostics-20190128-0232.zip Quote Link to comment
jonp Posted January 29, 2019 Share Posted January 29, 2019 I think your issue may be related to the fact that with these newer RTX series cards, each card actually has a VGA component, a audio component, a serial controller component, and a USB controller component. You probably need to stub those additional devices in order to ensure the entire device works properly in a VM. Here are your GPUs and their additional components from the System Devices section. Please add the other controllers to the stubbing (see the devices highlighted in red). 43:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] [10de:1f07] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci 43:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:10f9] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci43:00.2 USB controller [0c03]: NVIDIA Corporation Device [10de:1ada] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: xhci_hcd 43:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device [10de:1adb] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] 0c:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] [10de:1f07] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci 0c:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:10f9] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci0c:00.2 USB controller [0c03]: NVIDIA Corporation Device [10de:1ada] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: xhci_hcd 0c:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device [10de:1adb] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Quote Link to comment
fakh2006 Posted January 31, 2019 Author Share Posted January 31, 2019 On 1/30/2019 at 1:56 AM, jonp said: I think your issue may be related to the fact that with these newer RTX series cards, each card actually has a VGA component, a audio component, a serial controller component, and a USB controller component. You probably need to stub those additional devices in order to ensure the entire device works properly in a VM. Here are your GPUs and their additional components from the System Devices section. Please add the other controllers to the stubbing (see the devices highlighted in red). 43:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] [10de:1f07] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci 43:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:10f9] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci43:00.2 USB controller [0c03]: NVIDIA Corporation Device [10de:1ada] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: xhci_hcd 43:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device [10de:1adb] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] 0c:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU106 [GeForce RTX 2070 Rev. A] [10de:1f07] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci 0c:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:10f9] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: vfio-pci0c:00.2 USB controller [0c03]: NVIDIA Corporation Device [10de:1ada] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Kernel driver in use: xhci_hcd 0c:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device [10de:1adb] (rev a1) Subsystem: eVga.com. Corp. Device [3842:2172] Hi, I did that already for the 43:00 IOMMU group for all the device range, you can see from my text above. Funny thing is the 2nd card the one at 0c:00 doesnt cause any issues, it on PCIe bus 3 though, while the 43:00 is on bus 1. Thanks Quote Link to comment
jonp Posted February 4, 2019 Share Posted February 4, 2019 On 1/31/2019 at 10:05 AM, fakh2006 said: Hi, I did that already for the 43:00 IOMMU group for all the device range, you can see from my text above. Funny thing is the 2nd card the one at 0c:00 doesnt cause any issues, it on PCIe bus 3 though, while the 43:00 is on bus 1. Thanks Hmm, have you tried adjusting the 4G Decoding setting in the motherboard BIOS? Turning it on usually helps. Sometimes issues like these are the result of the motherboard, and it can be hard to track down. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.