I swapped my VGA and a sata expansion card. VGA was in a PCIe x16 v3 slot, now it's in a v2 one.

Now I can't create a (linux mint 22) VM:

 

Logs:

2024-10-26 17:32:25.442+0000: 25653: warning : qemuDomainObjTaintMsg:7164 : Domain id=3 name='mainmint' uuid=f2c2a99c-b682-1055-3f61-d81ba4872679 is tainted: high-privileges
2024-10-26 17:32:25.666+0000: 540951: error : qemuMonitorIORead:397 : Unable to read from monitor: Connection reset by peer
2024-10-26 17:32:25.666+0000: 540951: error : qemuProcessReportLogError:1933 : internal error: QEMU unexpectedly closed the monitor (vm='mainmint'): qxl_send_events: spice-server bug: guest stopped, ignoring
2024-10-26T17:32:25.633251Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:25:00.0","id":"hostdev0","bus":"pci.0","addr":"0x5"}: vfio 0000:25:00.0: group 15 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

 

I can boot into my Ubuntu OS on the same machine without any issue. Is there a way to reset libvirt state? Or do you have some recommendation?

 

(I couldn't connect to my existing VM with another error but along these lines)

Edited October 26, 20241 yr by steelsoap

You need to go back to system devices and check all vfio binds.

Ideally you should remove all of them before any hardware change then redo them afterwards as any change can modify the addresses the mobo gives.

Edited October 26, 20241 yr by Kilrah

There are checkboxes I can't check, 2 groups', one of which has my VGA. So this will require me to delve deeper in to sysconfig modification.

I added my PCI bridge's id to the syslinux configuration as pcie_acs_override, like so:

1. Find this id at Tools System devices; looks like this for me: [<PCI bridge id>] 03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Bridge (rev 01)
2. Go to Main tab, find your Flash device, click on it
3. Scoll down to Syslinux Configuration
4. At Unraid OS section change "append initrd=/bzroot" to "append initrd=/bzroot pcie_acs_override=id:<PCI bridge id>"

I tried vfio-pci.ids=... method but that resulted in erroneous boot.

 

This guided me:

 

EDIT:

On ther other hand, unfortunately, the virtualized guest functions way slower so something's not right.

 

Edited October 29, 20241 yr by steelsoap