Problems with multiple gpu passthrough (1xAMD and 1xNvidia)

[souljatechie]

I apologize up front if this has been solved in another post, but this is my first time using Unraid.  As such, I am still getting the hang of all the things.  Most of the problems I ran into, I was able to figure out, but the last great hurdle is the GPU's.  For the life of me, I cannot get either gpu to correctly update the drivers once inside the VM.   Thanks in advance for the help

 

So the question is how do i get the GPU's to updated drivers, so that i am not locked to 800x600 res... and for my 5500xt, able to use multiple monitors?

 

For reference, the GT710 is just for my wife vm's as a daily driver / photoshop editor, and the RX5500 is for my gaming / multi monitor work from home station. 

 

Here are the things I have tried:

q35 and i440

editing the xml to put the audio and gpu on the same slot

updating the gpus with the gpu disabled in the vm

updating the gpus in safe mode (this appears to work, but fails as soon as i go back to regular mode)

updating using older drivers (even using the old drivers, the GT710 still updates to the most current one)

using vifo (it was probably my fault for trying to pass the nic, but that caused unraid to not boot after the restart)

• with that being said i had to redo unraid.  Not sur if i had to or not, but i started the parity check again (2.5 hour wait time)

installing with one card in and one card out.

using seabios and ovfm

 

I have not tried VNC or vbios passthrough yet (but i can try those after the parity check and rebuild are finish.

 

Here is the hardware:

Model: Custom

M/B: Micro-Star International Co., Ltd. B450 GAMING PRO CARBON MAX WIFI (MS-7B85) Version 1.0 - s/n: K416822104

BIOS: American Megatrends Inc. Version 2.00. Dated: 03/28/2020

CPU: AMD Ryzen 7 3700X 8-Core @ 3600 MHz

HVM: Enabled

IOMMU: Enabled

Cache: 512 KiB, 4096 KiB, 32768 KiB

Memory: 32 GiB DDR4 (max. installable capacity 128 GiB)

Network: bond0: fault-tolerance (active-backup), mtu 1500
 eth0: 1000 Mbps, full duplex, mtu 1500

Kernel: Linux 4.19.107-Unraid x86_64

OpenSSL: 1.1.1d

Uptime: 0 days, 00:45:16

 

IOMMU group 0:[1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 1:[1022:1483] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 2:[1022:1483] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 3:[1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 4:[1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 5:[1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 6:[1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 7:[1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 8:[1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 9:[1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 10:[1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 11:[1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 12:[1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 13:[1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 14:[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)

[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)

IOMMU group 15:[1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0

[1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1

[1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2

[1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3

[1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4

[1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5

[1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6

[1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7

IOMMU group 16:[10ec:5762] 01:00.0 Non-Volatile memory controller: Realtek Semiconductor Co., Ltd. Device 5762 (rev 01)

IOMMU group 17:[1022:43d5] 03:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset USB 3.1 XHCI Controller (rev 01)

[1022:43c8] 03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset SATA Controller (rev 01)

[1022:43c6] 03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Bridge (rev 01)

[1022:43c7] 20:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01)

[1022:43c7] 20:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01)

[1022:43c7] 20:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01)

[8086:2526] 21:00.0 Network controller: Intel Corporation Wireless-AC 9260 (rev 29)

[8086:1539] 22:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)

[10de:128b] 25:00.0 VGA compatible controller: NVIDIA Corporation GK208B [GeForce GT 710] (rev a1)

[10de:0e0f] 25:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)

IOMMU group 18:[1002:1478] 26:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev c5)

IOMMU group 19:[1002:1479] 27:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch

IOMMU group 20:[1002:7340] 28:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 14 [Radeon RX 5500/5500M / Pro 5500M] (rev c5)

IOMMU group 21:[1002:ab38] 28:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 HDMI Audio

IOMMU group 22:[1022:148a] 29:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function

IOMMU group 23:[1022:1485] 2a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP

IOMMU group 24:[1022:1486] 2a:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP

IOMMU group 25:[1022:149c] 2a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller

IOMMU group 26:[1022:1487] 2a:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller

IOMMU group 27:[1022:7901] 30:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

IOMMU group 28:[1022:7901] 31:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

 

CPU Thread Pairings

This displays a list of CPU thread pairings.

Pair 1:cpu 0 / cpu 8

Pair 2:cpu 1 / cpu 9

Pair 3:cpu 2 / cpu 10

Pair 4:cpu 3 / cpu 11

Pair 5:cpu 4 / cpu 12

Pair 6:cpu 5 / cpu 13

Pair 7:cpu 6 / cpu 14

Pair 8:cpu 7 / cpu 15

 

USB Devices

This displays the output of the lsusb command. The numeric identifiers are used to configure PCI pass-through.

Bus 001 Device 001:ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 001 Device 002:ID 046d:c534 Logitech, Inc. Unifying Receiver

Bus 002 Device 001:ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 003 Device 001:ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 003 Device 002:ID 1462:7b85 Micro Star International PRO CARBON

Bus 003 Device 003:ID 8087:0025 Intel Corp.

Bus 004 Device 001:ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 004 Device 002:ID 090c:1000 Silicon Motion, Inc. - Taiwan (formerly Feiya Technology Corp.) Flash Drive

 

SCSI Devices

This displays the output of the lsscsi command. The numeric identifiers are used to configure PCI pass-through.

Note that linux groups ATA, SATA and SAS devices with true SCSI devices.

[0:0:0:0]disk General USB Flash Disk 1100 /dev/sda 31.0GB

[1:0:0:0]disk ATA ST1000LM010-9YH1 CC9F /dev/sdb 1.00TB

[6:0:0:0]disk ATA WDC WD10EZEX-08W 1A01 /dev/sdc 1.00TB

[N:0:1:1]disk ADATA SX8100NP__1 /dev/nvme0n1 512GB

 

 

Edited June 16, 2020 by souljatechie