[email protected] Posted October 13, 2021 Share Posted October 13, 2021 Hi, I am getting this error whe I strar the VM using the NVIDIA card in passthrough mode. Oct 13 03:06:12 MyUnraid-1U kernel: vfio-pci 0000:81:00.0: enabling device (0140 -> 0141) Oct 13 03:06:12 MyUnraid-1U kernel: vfio-pci 0000:81:00.0: vfio_ecap_init: hiding ecap 0x1e@0x258 Oct 13 03:06:12 MyUnraid-1U kernel: vfio-pci 0000:81:00.0: vfio_ecap_init: hiding ecap 0x19@0x900 Oct 13 03:06:12 MyUnraid-1U kernel: qemu-system-x86[6080]: segfault at a8 ip 00005618620c812a sp 00007ffc610531b0 error 4 in qemu-system-x86_64[561861fbb000+51d000] Oct 13 03:06:12 MyUnraid-1U kernel: Code: ef ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 55 53 48 89 fb 48 83 ec 08 48 8b 6f 58 e8 4e de ff ff 48 89 df e8 16 e9 ff ff <48> 8b 85 a8 00 00 00 48 85 c0 74 52 8b 93 a0 00 00 00 eb 0e 66 90 Oct 13 03:06:13 MyUnraid-1U avahi-daemon[3536]: Interface vnet0.IPv6 no longer relevant for mDNS. I enabled vfio-pci correclty: IOMMU group 29:[10de:13bb] 81:00.0 VGA compatible controller: NVIDIA Corporation GM107GL [Quadro K620] (rev a2) [10de:0fbc] 81:00.1 Audio device: NVIDIA Corporation GM107 High Definition Audio Controller [GeForce 940MX] (rev a1) Here is the log: Loading config from /boot/config/vfio-pci.cfg BIND=0000:81:00.0|10de:13bb 0000:81:00.1|10de:0fbc 0000:7f:10.0|8086:2f1d 0000:7f:10.1|8086:2f34 0000:7f:10.5|8086:2f1e 0000:7f:10.6|8086:2f7d 0000:7f:10.7|8086:2f1f 0000:ff:10.0|8086:2f1d 0000:ff:10.1|8086:2f34 0000:ff:10.5|8086:2f1e 0000:ff:10.6|8086:2f7d 0000:ff:10.7|8086:2f1f --- Processing 0000:81:00.0 10de:13bb Vendor:Device 10de:13bb found at 0000:81:00.0 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:81:00.0/iommu_group/devices/0000:81:00.0 /sys/bus/pci/devices/0000:81:00.0/iommu_group/devices/0000:81:00.1 Binding... Successfully bound the device 10de:13bb at 0000:81:00.0 to vfio-pci --- Processing 0000:81:00.1 10de:0fbc Vendor:Device 10de:0fbc found at 0000:81:00.1 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:81:00.1/iommu_group/devices/0000:81:00.0 /sys/bus/pci/devices/0000:81:00.1/iommu_group/devices/0000:81:00.1 Binding... 0000:81:00.0 already bound to vfio-pci 0000:81:00.1 already bound to vfio-pci Successfully bound the device 10de:0fbc at 0000:81:00.1 to vfio-pci --- Processing 0000:7f:10.0 8086:2f1d Vendor:Device 8086:2f1d found at 0000:7f:10.0 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:7f:10.0/iommu_group/devices/0000:7f:10.0 /sys/bus/pci/devices/0000:7f:10.0/iommu_group/devices/0000:7f:10.1 /sys/bus/pci/devices/0000:7f:10.0/iommu_group/devices/0000:7f:10.5 /sys/bus/pci/devices/0000:7f:10.0/iommu_group/devices/0000:7f:10.6 /sys/bus/pci/devices/0000:7f:10.0/iommu_group/devices/0000:7f:10.7 Binding... Successfully bound the device 8086:2f1d at 0000:7f:10.0 to vfio-pci --- Processing 0000:7f:10.1 8086:2f34 Vendor:Device 8086:2f34 found at 0000:7f:10.1 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:7f:10.1/iommu_group/devices/0000:7f:10.0 /sys/bus/pci/devices/0000:7f:10.1/iommu_group/devices/0000:7f:10.1 /sys/bus/pci/devices/0000:7f:10.1/iommu_group/devices/0000:7f:10.5 /sys/bus/pci/devices/0000:7f:10.1/iommu_group/devices/0000:7f:10.6 /sys/bus/pci/devices/0000:7f:10.1/iommu_group/devices/0000:7f:10.7 Binding... 0000:7f:10.0 already bound to vfio-pci 0000:7f:10.1 already bound to vfio-pci 0000:7f:10.5 already bound to vfio-pci 0000:7f:10.6 already bound to vfio-pci 0000:7f:10.7 already bound to vfio-pci Successfully bound the device 8086:2f34 at 0000:7f:10.1 to vfio-pci --- Processing 0000:7f:10.5 8086:2f1e Vendor:Device 8086:2f1e found at 0000:7f:10.5 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:7f:10.5/iommu_group/devices/0000:7f:10.0 /sys/bus/pci/devices/0000:7f:10.5/iommu_group/devices/0000:7f:10.1 /sys/bus/pci/devices/0000:7f:10.5/iommu_group/devices/0000:7f:10.5 /sys/bus/pci/devices/0000:7f:10.5/iommu_group/devices/0000:7f:10.6 /sys/bus/pci/devices/0000:7f:10.5/iommu_group/devices/0000:7f:10.7 Binding... 0000:7f:10.0 already bound to vfio-pci 0000:7f:10.1 already bound to vfio-pci 0000:7f:10.5 already bound to vfio-pci 0000:7f:10.6 already bound to vfio-pci 0000:7f:10.7 already bound to vfio-pci Successfully bound the device 8086:2f1e at 0000:7f:10.5 to vfio-pci --- Processing 0000:7f:10.6 8086:2f7d Vendor:Device 8086:2f7d found at 0000:7f:10.6 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:7f:10.6/iommu_group/devices/0000:7f:10.0 /sys/bus/pci/devices/0000:7f:10.6/iommu_group/devices/0000:7f:10.1 /sys/bus/pci/devices/0000:7f:10.6/iommu_group/devices/0000:7f:10.5 /sys/bus/pci/devices/0000:7f:10.6/iommu_group/devices/0000:7f:10.6 /sys/bus/pci/devices/0000:7f:10.6/iommu_group/devices/0000:7f:10.7 Binding... 0000:7f:10.0 already bound to vfio-pci 0000:7f:10.1 already bound to vfio-pci 0000:7f:10.5 already bound to vfio-pci 0000:7f:10.6 already bound to vfio-pci 0000:7f:10.7 already bound to vfio-pci Successfully bound the device 8086:2f7d at 0000:7f:10.6 to vfio-pci --- Processing 0000:7f:10.7 8086:2f1f Vendor:Device 8086:2f1f found at 0000:7f:10.7 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:7f:10.7/iommu_group/devices/0000:7f:10.0 /sys/bus/pci/devices/0000:7f:10.7/iommu_group/devices/0000:7f:10.1 /sys/bus/pci/devices/0000:7f:10.7/iommu_group/devices/0000:7f:10.5 /sys/bus/pci/devices/0000:7f:10.7/iommu_group/devices/0000:7f:10.6 /sys/bus/pci/devices/0000:7f:10.7/iommu_group/devices/0000:7f:10.7 Binding... 0000:7f:10.0 already bound to vfio-pci 0000:7f:10.1 already bound to vfio-pci 0000:7f:10.5 already bound to vfio-pci 0000:7f:10.6 already bound to vfio-pci 0000:7f:10.7 already bound to vfio-pci Successfully bound the device 8086:2f1f at 0000:7f:10.7 to vfio-pci --- Processing 0000:ff:10.0 8086:2f1d Vendor:Device 8086:2f1d found at 0000:ff:10.0 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:ff:10.0/iommu_group/devices/0000:ff:10.0 /sys/bus/pci/devices/0000:ff:10.0/iommu_group/devices/0000:ff:10.1 /sys/bus/pci/devices/0000:ff:10.0/iommu_group/devices/0000:ff:10.5 /sys/bus/pci/devices/0000:ff:10.0/iommu_group/devices/0000:ff:10.6 /sys/bus/pci/devices/0000:ff:10.0/iommu_group/devices/0000:ff:10.7 Binding... Successfully bound the device 8086:2f1d at 0000:ff:10.0 to vfio-pci --- Processing 0000:ff:10.1 8086:2f34 Vendor:Device 8086:2f34 found at 0000:ff:10.1 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:ff:10.1/iommu_group/devices/0000:ff:10.0 /sys/bus/pci/devices/0000:ff:10.1/iommu_group/devices/0000:ff:10.1 /sys/bus/pci/devices/0000:ff:10.1/iommu_group/devices/0000:ff:10.5 /sys/bus/pci/devices/0000:ff:10.1/iommu_group/devices/0000:ff:10.6 /sys/bus/pci/devices/0000:ff:10.1/iommu_group/devices/0000:ff:10.7 Binding... 0000:ff:10.0 already bound to vfio-pci 0000:ff:10.1 already bound to vfio-pci 0000:ff:10.5 already bound to vfio-pci 0000:ff:10.6 already bound to vfio-pci 0000:ff:10.7 already bound to vfio-pci Successfully bound the device 8086:2f34 at 0000:ff:10.1 to vfio-pci --- Processing 0000:ff:10.5 8086:2f1e Vendor:Device 8086:2f1e found at 0000:ff:10.5 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:ff:10.5/iommu_group/devices/0000:ff:10.0 /sys/bus/pci/devices/0000:ff:10.5/iommu_group/devices/0000:ff:10.1 /sys/bus/pci/devices/0000:ff:10.5/iommu_group/devices/0000:ff:10.5 /sys/bus/pci/devices/0000:ff:10.5/iommu_group/devices/0000:ff:10.6 /sys/bus/pci/devices/0000:ff:10.5/iommu_group/devices/0000:ff:10.7 Binding... 0000:ff:10.0 already bound to vfio-pci 0000:ff:10.1 already bound to vfio-pci 0000:ff:10.5 already bound to vfio-pci 0000:ff:10.6 already bound to vfio-pci 0000:ff:10.7 already bound to vfio-pci Successfully bound the device 8086:2f1e at 0000:ff:10.5 to vfio-pci --- Processing 0000:ff:10.6 8086:2f7d Vendor:Device 8086:2f7d found at 0000:ff:10.6 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:ff:10.6/iommu_group/devices/0000:ff:10.0 /sys/bus/pci/devices/0000:ff:10.6/iommu_group/devices/0000:ff:10.1 /sys/bus/pci/devices/0000:ff:10.6/iommu_group/devices/0000:ff:10.5 /sys/bus/pci/devices/0000:ff:10.6/iommu_group/devices/0000:ff:10.6 /sys/bus/pci/devices/0000:ff:10.6/iommu_group/devices/0000:ff:10.7 Binding... 0000:ff:10.0 already bound to vfio-pci 0000:ff:10.1 already bound to vfio-pci 0000:ff:10.5 already bound to vfio-pci 0000:ff:10.6 already bound to vfio-pci 0000:ff:10.7 already bound to vfio-pci Successfully bound the device 8086:2f7d at 0000:ff:10.6 to vfio-pci --- Processing 0000:ff:10.7 8086:2f1f Vendor:Device 8086:2f1f found at 0000:ff:10.7 IOMMU group members (sans bridges): /sys/bus/pci/devices/0000:ff:10.7/iommu_group/devices/0000:ff:10.0 /sys/bus/pci/devices/0000:ff:10.7/iommu_group/devices/0000:ff:10.1 /sys/bus/pci/devices/0000:ff:10.7/iommu_group/devices/0000:ff:10.5 /sys/bus/pci/devices/0000:ff:10.7/iommu_group/devices/0000:ff:10.6 /sys/bus/pci/devices/0000:ff:10.7/iommu_group/devices/0000:ff:10.7 Binding... 0000:ff:10.0 already bound to vfio-pci 0000:ff:10.1 already bound to vfio-pci 0000:ff:10.5 already bound to vfio-pci 0000:ff:10.6 already bound to vfio-pci 0000:ff:10.7 already bound to vfio-pci Successfully bound the device 8086:2f1f at 0000:ff:10.7 to vfio-pci --- vfio-pci binding complete Devices listed in /sys/bus/pci/drivers/vfio-pci: lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:7f:10.0 -> ../../../../devices/pci0000:7f/0000:7f:10.0 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:7f:10.1 -> ../../../../devices/pci0000:7f/0000:7f:10.1 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:7f:10.5 -> ../../../../devices/pci0000:7f/0000:7f:10.5 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:7f:10.6 -> ../../../../devices/pci0000:7f/0000:7f:10.6 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:7f:10.7 -> ../../../../devices/pci0000:7f/0000:7f:10.7 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:81:00.0 -> ../../../../devices/pci0000:80/0000:80:02.0/0000:81:00.0 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:81:00.1 -> ../../../../devices/pci0000:80/0000:80:02.0/0000:81:00.1 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:ff:10.0 -> ../../../../devices/pci0000:ff/0000:ff:10.0 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:ff:10.1 -> ../../../../devices/pci0000:ff/0000:ff:10.1 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:ff:10.5 -> ../../../../devices/pci0000:ff/0000:ff:10.5 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:ff:10.6 -> ../../../../devices/pci0000:ff/0000:ff:10.6 lrwxrwxrwx 1 root root 0 Oct 13 05:02 0000:ff:10.7 -> ../../../../devices/pci0000:ff/0000:ff:10.7 ls -l /dev/vfio/ total 0 crw------- 1 root root 249, 0 Oct 13 05:02 29 crw------- 1 root root 249, 1 Oct 13 05:02 35 crw------- 1 root root 249, 2 Oct 13 05:02 49 crw-rw-rw- 1 root root 10, 196 Oct 13 05:02 vfio What am I missing? I'm using a Lenovo x3550 M2 with K620 installed inte PCIe Raiser card attached to CPU2 Quote Link to comment
UknowEtheG Posted November 6, 2021 Share Posted November 6, 2021 search for "nvidia vm passthrough" until you come across instructions on modifying the nvidia VBios for your card. There is a header which must be removed from the vbios file(using a hex editor) I do believe SpaceInvader has more than one video on YouTube demonstrating the procedure. I have the same gpu and this step was necessary Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.