GPU Pass-Through MMU Groups Good?

Hi Folks

 

Very clear that if I wish to pass through a GPU, I need to ensure that it is either in it's own MMU group OR I have to pass-though everything in the MMU group where the GPU is.

 

The issue I'm facing is that all 'sub-devices' of the GPU (and the GPU it's self) are split into separate groups due to:

 

PCIe ACS override = Both

Unsafe Interrupts = Yes

 

Group 33 0a:00.010de:21c4VGA compatible controller: NVIDIA Corporation TU116 [GeForce GTX 1660 SUPER] (rev a1)

Group 34 0a:00.110de:1aebAudio device: NVIDIA Corporation TU116 High Definition Audio Controller (rev a1)

Group 35 0a:00.210de:1aecUSB controller: NVIDIA Corporation TU116 USB 3.1 Host Controller (rev a1)

*USB devices attached to controllers bound to vfio are not visible to unRAID*

Group 36 0a:00.310de:1aedSerial bus controller [0c80]: NVIDIA Corporation TU116 USB Type-C UCSI Controller (rev a1)

*USB devices attached to controllers bound to vfio are not visible to unRAID*

 

append vfio-pci.ids=1106:3483,10de:21c4,10de:1aeb,10de:1aec,10de:1aed

modprobe.blacklist=dvb_usb_rtl28xxu

isolcpus=0-7,16-23

pcie_acs_override=downstream,multifunction vfio_iommu_type1.allow_unsafe_interrupts=1

initrd=/bzroot mitigations=off

 

I'm then at a loss to understand why, when I select my GPU, Sound card and both USB and Bus Controllers (which I've stubbed...see below), all that are in their OWN MMU (with no other devices), do I receive the dreaded:

 

2020-09-19 06:42:05.714+0000: 25586: error : qemuProcessReportLogError:2103 : internal error: qemu unexpectedly closed the monitor: 2020-09-19T06:42:05.316795Z qemu-system-x86_64: -device vfio-pci,host=0000:0a:00.1,id=hostdev1,bus=pci.11,addr=0x0: vfio 0000:0a:00.1: failed to setup container for group 34: Failed to set iommu for container: Operation not permitted

 

Group 34 only includes the GPU device and nothing more...and thus have no idea why the VM won't start.

 

Any ideas greatly received as I'm sure this may be quite common.

 

HP ML350P Gen 8 with latest BIOS et al

Unraid 6.9.0 Beta 25

 

Thanks

 

Mo