Hi, I posted in another subforum, but I think this is a better place for it, since it deals specifically with PCI passthrough.

 

I have the following equipment:

 

ASUS Z10PE-D16 WS

2x Xeon E5 2620 v3

64GB DDR4 2133 Registered ECC

2x2TB WD Red

1x1TB WD Black

2x960GB Sandisk Ultra II

EVGA SuperNova PS 1000W

IOMMU group 43
	[10de:1b80] 02:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
	[10de:10f0] 02:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 44
	[1b73:1100] 03:00.0 USB controller: Fresco Logic FL1100 USB 3.0 Host Controller (rev 10)
IOMMU group 47
	[144d:a802] 07:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM951/PM951 (rev 01)
IOMMU group 52
	[12ab:0380] 81:00.0 Non-VGA unclassified device: YUAN High-Tech Development Co., Ltd. Device 0380 (rev ff)
IOMMU group 53
	[10de:1185] 82:00.0 VGA compatible controller: NVIDIA Corporation GK104 [GeForce GTX 660 OEM] (rev a1)
	[10de:0e0a] 82:00.1 Audio device: NVIDIA Corporation GK104 HDMI Audio Controller (rev a1)

Bus 003 Device 002: ID 0781:5151 SanDisk Corp. Cruzer Micro Flash Drive
Bus 003 Device 003: ID b58e:9e84 Blue Microphones Yeti Stereo Microphone
Bus 003 Device 004: ID 046d:c539 Logitech, Inc. 
Bus 003 Device 005: ID 04d9:1818 Holtek Semiconductor, Inc. 

 

I currently have two guests setup:

 

Windows 10 on SeaBIOS and i440fx using virtio-win-0.1.126-2

Windows 10 on OVMF and Q35-2.7

Arch Linux on OVMF and Q35-2.7

 

I created two Windows 10 guests to see if SeaBIOS and/or i440fx was causing the issue. I only run one at a time.

 

Now, I am passing through the following to the Windows 10 guests:

 

07:00.0 - NVME Drive

82:00.0 - GTX 760

82.00.1 - GTX 760 HDMI Audio

81:00.0 - Elgato HD60 Pro

Bus 3, Device 4 - Logitech G900 Wireless

Bus 3, Device 5 - Filco Majestouch 2 TKL

 

And the following to the Arch Linux machine:

 

02:00.0 - GTX 1080

02:00.1 - GTX 1080 HDMI Audio

03:00.0 - PCI-E to 7 Port USB 3.0 with:

 - Input Club ErgoDox Infinity

 - Logitech G900 (Wired)

 - Microsoft LifeCam HD

 - Belkin Easy Transfer Cable

 

Normally, the USB card and 1080 are on the Windows VM for gaming and the 760 is on the Arch VM. I normally do not have the Filco keyboard plugged in, and I use Synergy to share my mouse and keyboard. I swapped them temporarily because I am working on the Arch VM right now.

 

I have attached the XML if you would like to see how the machines are set up right now.

 

Now, in the Windows 10 VM, I am passing through the NVME drive and the Elgato. The NVME drive is showing properly (right now), but it tends to run into the same issue that the Elgato does. The issue is that the Elgato gets stuck in D3 power mode and fails in the function level reset. I also do not get the video capture device showing in the VM at all in any case (cold boot neither). The *sound* capture device does show up, though.

 

My syslinux.cfg simply uses vfio-pci.ids on the NVME drive. I also tried disabling D3 in the syslinux.cfg, which changed nothing. The logs when I boot up the Windows 10 VM are attached.

 

I saw someone else fixed this issue by recompiling the kernel, but that was with version 4.4.5, which was 32-bit. The Wiki explicitly states that the recompilation for 6.0.0 and up is different, but has not been updated with further instructions. How can I make the two devices properly passthrough to the Windows VM?

ArchBox.xml

Windows_10_OVMF.xml

unRAIDLog

VMLog

Where you able to find any solution for this?

 

I am currently trying to start unRAID with 4 x NVIDIA 1080 GTX. I have assigned 1 GPU to each. But I just get black screen for the ones with address:
81:00.0

82:00.0

Were you able to make them work at all?

Sorry if this is a bit unrelated.