- Minor
Trying to get a mellanox-3 card passed through to a VM and having some troubles. To set the stage, I have two of these cards in my unraid server, I am using one of them for the OS. I used the Tools / System Devices / Bind Selected to VFIO at boot method and have verified that the card is added:
cat vfio-pci.cfg
BIND=0000:03:00.0|15b3:1003
Here is the log showing it was successful in being bound at boot of unraid:
Loading config from /boot/config/vfio-pci.cfg
BIND=0000:03:00.0|15b3:1003
---
Processing 0000:03:00.0 15b3:1003
Vendor:Device 15b3:1003 found at 0000:03:00.0
IOMMU group members (sans bridges):
/sys/bus/pci/devices/0000:03:00.0/iommu_group/devices/0000:03:00.0
Binding...
Successfully bound the device 15b3:1003 at 0000:03:00.0 to vfio-pci
---
vfio-pci binding complete
Devices listed in /sys/bus/pci/drivers/vfio-pci:
lrwxrwxrwx 1 root root 0 Aug 3 18:56 0000:03:00.0 -> ../../../../devices/pci0000:00/0000:00:1c.4/0000:03:00.0
ls -l /dev/vfio/
total 0
crw------- 1 root root 249, 0 Aug 3 18:56 12
crw-rw-rw- 1 root root 10, 196 Aug 3 18:56 vfio
This card shows up when setting up the VM :
Other PCI Devices:
Mellanox Technologies MT27500 Family [ConnectX-3] | Ethernet controller (03:00.0)
When that box is checked and the VM is started, this error shows up in the log:
2020-08-04T00:24:59.369033Z qemu-system-x86_64: -device vfio-pci,host=0000:03:00.0,id=hostdev0,bus=pci.0,addr=0x8: vfio 0000:03:00.0: Failed to set up TRIGGER eventfd signaling for interrupt INTX-0: VFIO_DEVICE_SET_IRQS failure: Device or resource busy 2020-08-04 00:25:00.476+0000: shutting down, reason=failed
I'm confused as to how / why it is in use since it is allocated to VFIO at boot.
I have tried enabling "PCIe ACS override" and for the fun of it did the "VFIO allow unsafe interrupts" Neither helped (didn't think they would but tried anyways.
Does anyone have any thoughts on other things to try? I am working to setup a RockNSM VM and need to pass through this NIC so the VM can capture the 10g mirror of my uplink to my router.
Thanks in advance for any assistance.