Skip to content
View in the app

A better way to browse. Learn more.
Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.
Unraid Summer Sale in live: 20% off Starter and Unleashed + buy one, get one 50% off

Unable to boot system with GPU passthrough

colinhough
in VM Engine (KVM)

Featured Replies

Hello I'm new to the whole unraid thing but i was trying to boot up a vm with a gpu passed through and i get the below error ive tried some of the options ive found with no luck any help would be great

 

Execution error

 

internal error: early end of file from monitor: possible problem:

2016-06-06T14:59:43.409104Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to set iommu for container: Operation not permitted

2016-06-06T14:59:43.409127Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to setup container for group 14

2016-06-06T14:59:43.409134Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to get group 14

2016-06-06T14:59:43.409143Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device initialization failed

2016-06-06T14:59:43.409151Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: Device 'vfio-pci' could not be initialized

 

 

My systems specs as follows.

 

Motherboard: Sabertooth X58 with all pass-through options enabled

CPU: Intel I7 960

Memory: 16gb ddr3

hdds and ssds

2 GTX 560ti

1 hd 7750 if needed for testing

  • Quote

    1. Did you passthrough your gpu using qemu:arg, hostdev or did you use the gui?

     

    2. Click on "Info" in the web interface, is "IOMMU" Enabled?

     

    3. Which version of unraid are you using? (Stable or Beta)

     

    4. Does your CPU have an internal GPU? If not, which gpu is in the first pci-e slot and which gpu(s) are you are you passing through to the VM?

  • Quote
    • Author

    1) I used the gui didn't know how to do any other way.

     

    2) yes it is all enabled and showing so in the info tab.

     

    3) latest stable as well as the beta. currently on beta.

     

    4) no on board I have tried both with an amd HD7750 is slot 1 as well as a gtx560ti I'm trying to pass through the nvidia but I also tried to pass the amd with no succsess

     

     

    any help or guiding me through this would be amazing my wife's pc died and we don't want to buy a second but we have the parts to do it this way so would save alot

     

    2

     

    Sent from my SM-G920W8 using Tapatalk

     

     

  • Quote
    • Author

    I'll upload tommorow

     

    Sent from my SM-G920W8 using Tapatalk

     

     

  • Quote
    • Author

    I have attached in text the vm xml as well as a diag report and sys log

     

     

     

    VM XML:

     

    <domain type='kvm'>

      <name>Windows 10</name>

      <uuid>e4c8ebf2-b4d8-5604-0967-4e42b9897eec</uuid>

      <metadata>

        <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>

      </metadata>

      <memory unit='KiB'>2097152</memory>

      <currentMemory unit='KiB'>2097152</currentMemory>

      <memoryBacking>

        <nosharepages/>

        <locked/>

      </memoryBacking>

      <vcpu placement='static'>2</vcpu>

      <cputune>

        <vcpupin vcpu='0' cpuset='0'/>

        <vcpupin vcpu='1' cpuset='1'/>

      </cputune>

      <os>

        <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type>

        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>

        <nvram>/etc/libvirt/qemu/nvram/e4c8ebf2-b4d8-5604-0967-4e42b9897eec_VARS-pure-efi.fd</nvram>

      </os>

      <features>

        <acpi/>

        <apic/>

        <hyperv>

          <relaxed state='on'/>

          <vapic state='on'/>

          <spinlocks state='on' retries='8191'/>

          <vendor id='none'/>

        </hyperv>

      </features>

      <cpu mode='host-passthrough'>

        <topology sockets='1' cores='1' threads='2'/>

      </cpu>

      <clock offset='localtime'>

        <timer name='hypervclock' present='yes'/>

        <timer name='hpet' present='no'/>

      </clock>

      <on_poweroff>destroy</on_poweroff>

      <on_reboot>restart</on_reboot>

      <on_crash>restart</on_crash>

      <devices>

        <emulator>/usr/local/sbin/qemu</emulator>

        <disk type='file' device='disk'>

          <driver name='qemu' type='raw' cache='writeback'/>

          <source file='/mnt/user/vDisks02/Windows 10/vdisk1.img'/>

          <target dev='hdc' bus='virtio'/>

          <boot order='1'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>

        </disk>

        <disk type='file' device='cdrom'>

          <driver name='qemu' type='raw'/>

          <source file='/mnt/user/ISOs/Windows.iso'/>

          <target dev='hda' bus='ide'/>

          <readonly/>

          <boot order='2'/>

          <address type='drive' controller='0' bus='0' target='0' unit='0'/>

        </disk>

        <disk type='file' device='cdrom'>

          <driver name='qemu' type='raw'/>

          <source file='/mnt/user/ISOs/virtio-win-0.1.102.iso'/>

          <target dev='hdb' bus='ide'/>

          <readonly/>

          <address type='drive' controller='0' bus='0' target='0' unit='1'/>

        </disk>

        <controller type='usb' index='0' model='ich9-ehci1'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci1'>

          <master startport='0'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci2'>

          <master startport='2'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci3'>

          <master startport='4'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>

        </controller>

        <controller type='pci' index='0' model='pci-root'/>

        <controller type='ide' index='0'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>

        </controller>

        <controller type='virtio-serial' index='0'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>

        </controller>

        <interface type='bridge'>

          <mac address='52:54:00:32:da:8c'/>

          <source bridge='br0'/>

          <model type='virtio'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>

        </interface>

        <serial type='pty'>

          <target port='0'/>

        </serial>

        <console type='pty'>

          <target type='serial' port='0'/>

        </console>

        <channel type='unix'>

          <source mode='connect'/>

          <target type='virtio' name='org.qemu.guest_agent.0'/>

          <address type='virtio-serial' controller='0' bus='0' port='1'/>

        </channel>

        <hostdev mode='subsystem' type='pci' managed='yes'>

          <driver name='vfio'/>

          <source>

            <address domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>

          </source>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>

        </hostdev>

        <memballoon model='virtio'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>

        </memballoon>

      </devices>

    </domain>

    voodoo_magic-diagnostics-20160607-1241.zip

    voodoo_magic-syslog-20160607-1242.zip

  • Quote
    • Author

    Also im using unraid 6.2 beta and i have 2 gtx 560ti and 1 hd7750 in the system.

     

    Slot 1: nvidia

    slot 2: nvidia

    slot 3: amd

  • Quote

    It looks like you are trying to pass through just the video but not audio. Since they are both in the same iommu group (12), you'll have to pass both of them through to the vm

  • Quote
    • Author

    Same issue i have attempted to pass through both the audio and video card see below.

     

    domain type='kvm'>

      <name>Windows 10</name>

      <uuid>e4c8ebf2-b4d8-5604-0967-4e42b9897eec</uuid>

      <metadata>

        <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>

      </metadata>

      <memory unit='KiB'>2097152</memory>

      <currentMemory unit='KiB'>2097152</currentMemory>

      <memoryBacking>

        <nosharepages/>

        <locked/>

      </memoryBacking>

      <vcpu placement='static'>2</vcpu>

      <cputune>

        <vcpupin vcpu='0' cpuset='0'/>

        <vcpupin vcpu='1' cpuset='1'/>

      </cputune>

      <os>

        <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type>

        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>

        <nvram>/etc/libvirt/qemu/nvram/e4c8ebf2-b4d8-5604-0967-4e42b9897eec_VARS-pure-efi.fd</nvram>

      </os>

      <features>

        <acpi/>

        <apic/>

        <hyperv>

          <relaxed state='on'/>

          <vapic state='on'/>

          <spinlocks state='on' retries='8191'/>

          <vendor id='none'/>

        </hyperv>

      </features>

      <cpu mode='host-passthrough'>

        <topology sockets='1' cores='1' threads='2'/>

      </cpu>

      <clock offset='localtime'>

        <timer name='hypervclock' present='yes'/>

        <timer name='hpet' present='no'/>

      </clock>

      <on_poweroff>destroy</on_poweroff>

      <on_reboot>restart</on_reboot>

      <on_crash>restart</on_crash>

      <devices>

        <emulator>/usr/local/sbin/qemu</emulator>

        <disk type='file' device='disk'>

          <driver name='qemu' type='raw' cache='writeback'/>

          <source file='/mnt/user/vDisks02/Windows 10/vdisk1.img'/>

          <target dev='hdc' bus='virtio'/>

          <boot order='1'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>

        </disk>

        <disk type='file' device='cdrom'>

          <driver name='qemu' type='raw'/>

          <source file='/mnt/user/ISOs/Windows.iso'/>

          <target dev='hda' bus='ide'/>

          <readonly/>

          <boot order='2'/>

          <address type='drive' controller='0' bus='0' target='0' unit='0'/>

        </disk>

        <disk type='file' device='cdrom'>

          <driver name='qemu' type='raw'/>

          <source file='/mnt/user/ISOs/virtio-win-0.1.102.iso'/>

          <target dev='hdb' bus='ide'/>

          <readonly/>

          <address type='drive' controller='0' bus='0' target='0' unit='1'/>

        </disk>

        <controller type='usb' index='0' model='ich9-ehci1'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci1'>

          <master startport='0'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci2'>

          <master startport='2'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>

        </controller>

        <controller type='usb' index='0' model='ich9-uhci3'>

          <master startport='4'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>

        </controller>

        <controller type='pci' index='0' model='pci-root'/>

        <controller type='ide' index='0'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>

        </controller>

        <controller type='virtio-serial' index='0'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>

        </controller>

        <interface type='bridge'>

          <mac address='52:54:00:32:da:8c'/>

          <source bridge='br0'/>

          <model type='virtio'/>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>

        </interface>

        <serial type='pty'>

          <target port='0'/>

        </serial>

        <console type='pty'>

          <target type='serial' port='0'/>

        </console>

        <channel type='unix'>

          <source mode='connect'/>

          <target type='virtio' name='org.qemu.guest_agent.0'/>

          <address type='virtio-serial' controller='0' bus='0' port='1'/>

        </channel>

        <hostdev mode='subsystem' type='pci' managed='yes'>

          <driver name='vfio'/>

          <source>

            <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>

          </source>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>

        </hostdev>

        <hostdev mode='subsystem' type='pci' managed='yes'>

          <driver name='vfio'/>

          <source>

            <address domain='0x0000' bus='0x04' slot='0x00' function='0x1'/>

          </source>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>

        </hostdev>

        <memballoon model='virtio'>

          <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>

        </memballoon>

      </devices>

    </domain>

     

  • Quote
    • Author

    Also here is the error im getting

     

     

    Execution error

     

    internal error: process exited while connecting to monitor: 2016-06-07T17:31:56.906093Z qemu-system-x86_64: -device vfio-pci,host=04:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio: failed to set iommu for container: Operation not permitted

    2016-06-07T17:31:56.906118Z qemu-system-x86_64: -device vfio-pci,host=04:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio: failed to setup container for group 13

    2016-06-07T17:31:56.906125Z qemu-system-x86_64: -device vfio-pci,host=04:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio: failed to get group 13

    2016-06-07T17:31:56.906134Z qemu-system-x86_64: -device vfio-pci,host=04:00.0,id=hostdev0,bus=pci.0,addr=0x5: Device initialization failed

  • Quote
    • Author

    just let me know what you require in order to help troubleshooting.

     

    Sent from my SM-G920W8 using Tapatalk

     

     

  • Quote

    I see that you have 3 gpus. Can you pass any of them through to the VMs?

    Which one is unraid using for its gui/console? You won't be able to pass that one through as it is already in use.

     

    Are you trying to use multiple VMs at the same time? If so, make sure that you are not trying to pass the same gpu to multiple VMs or you'll get that error.

  • Quote
    • Author

    1 vm can't pass any gpu through and I'm using the amd atm for unraid

     

    Sent from my SM-G920W8 using Tapatalk

     

     

  • Quote
    • Author

    System Devices

     

    PCI Devices

     

    00:00.0 Host bridge [0600]: Intel Corporation 5520/5500/X58 I/O Hub to ESI Port [8086:3405] (rev 13)

    00:01.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 [8086:3408] (rev 13)

    00:02.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 2 [8086:3409] (rev 13)

    00:03.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 [8086:340a] (rev 13)

    00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [8086:340e] (rev 13)

    00:14.0 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub System Management Registers [8086:342e] (rev 13)

    00:14.1 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers [8086:3422] (rev 13)

    00:14.2 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers [8086:3423] (rev 13)

    00:14.3 PIC [0800]: Intel Corporation 7500/5520/5500/X58 I/O Hub Throttle Registers [8086:3438] (rev 13)

    00:1a.0 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4 [8086:3a37]

    00:1a.1 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5 [8086:3a38]

    00:1a.2 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6 [8086:3a39]

    00:1a.7 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2 [8086:3a3c]

    00:1c.0 PCI bridge [0604]: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1 [8086:3a40]

    00:1c.4 PCI bridge [0604]: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 5 [8086:3a48]

    00:1d.0 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1 [8086:3a34]

    00:1d.1 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2 [8086:3a35]

    00:1d.2 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3 [8086:3a36]

    00:1d.7 USB controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1 [8086:3a3a]

    00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev 90)

    00:1f.0 ISA bridge [0601]: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller [8086:3a16]

    00:1f.2 SATA controller [0106]: Intel Corporation 82801JI (ICH10 Family) SATA AHCI Controller [8086:3a22]

    00:1f.3 SMBus [0c05]: Intel Corporation 82801JI (ICH10 Family) SMBus Controller [8086:3a30]

    02:00.0 USB controller [0c03]: NEC Corporation uPD720200 USB 3.0 Host Controller [1033:0194] (rev 03)

    03:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] [10de:1200] (rev a1)

    03:00.1 Audio device [0403]: NVIDIA Corporation GF114 HDMI Audio Controller [10de:0e0c] (rev a1)

    04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] [10de:1200] (rev a1)

    04:00.1 Audio device [0403]: NVIDIA Corporation GF114 HDMI Audio Controller [10de:0e0c] (rev a1)

    05:00.0 SATA controller [0106]: JMicron Technology Corp. JMB362 SATA Controller [197b:2362] (rev 10)

    06:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde PRO [Radeon HD 7750/8740 / R7 250E] [1002:683f]

    06:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series] [1002:aab0]

    07:01.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL-8110SC/8169SC Gigabit Ethernet [10ec:8167] (rev 10)

    07:02.0 FireWire (IEEE 1394) [0c00]: VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller [1106:3044] (rev c0)

    ff:00.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers [8086:2c41] (rev 05)

    ff:00.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder [8086:2c01] (rev 05)

    ff:02.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 0 [8086:2c10] (rev 05)

    ff:02.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Physical 0 [8086:2c11] (rev 05)

    ff:03.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller [8086:2c18] (rev 05)

    ff:03.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Target Address Decoder [8086:2c19] (rev 05)

    ff:03.4 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Test Registers [8086:2c1c] (rev 05)

    ff:04.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Control Registers [8086:2c20] (rev 05)

    ff:04.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Address Registers [8086:2c21] (rev 05)

    ff:04.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Rank Registers [8086:2c22] (rev 05)

    ff:04.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Thermal Control Registers [8086:2c23] (rev 05)

    ff:05.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Control Registers [8086:2c28] (rev 05)

    ff:05.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Address Registers [8086:2c29] (rev 05)

    ff:05.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Rank Registers [8086:2c2a] (rev 05)

    ff:05.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Thermal Control Registers [8086:2c2b] (rev 05)

    ff:06.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Control Registers [8086:2c30] (rev 05)

    ff:06.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Address Registers [8086:2c31] (rev 05)

    ff:06.2 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Rank Registers [8086:2c32] (rev 05)

    ff:06.3 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Thermal Control Registers [8086:2c33] (rev 05)

     

    IOMMU Groups

     

    /sys/kernel/iommu_groups/0/devices/0000:00:00.0

    /sys/kernel/iommu_groups/1/devices/0000:00:01.0

    /sys/kernel/iommu_groups/2/devices/0000:00:02.0

    /sys/kernel/iommu_groups/3/devices/0000:00:03.0

    /sys/kernel/iommu_groups/4/devices/0000:00:07.0

    /sys/kernel/iommu_groups/5/devices/0000:00:14.0

    /sys/kernel/iommu_groups/5/devices/0000:00:14.1

    /sys/kernel/iommu_groups/5/devices/0000:00:14.2

    /sys/kernel/iommu_groups/5/devices/0000:00:14.3

    /sys/kernel/iommu_groups/6/devices/0000:00:1a.0

    /sys/kernel/iommu_groups/6/devices/0000:00:1a.1

    /sys/kernel/iommu_groups/6/devices/0000:00:1a.2

    /sys/kernel/iommu_groups/6/devices/0000:00:1a.7

    /sys/kernel/iommu_groups/7/devices/0000:00:1c.0

    /sys/kernel/iommu_groups/7/devices/0000:00:1c.4

    /sys/kernel/iommu_groups/7/devices/0000:05:00.0

    /sys/kernel/iommu_groups/7/devices/0000:06:00.0

    /sys/kernel/iommu_groups/7/devices/0000:06:00.1

    /sys/kernel/iommu_groups/8/devices/0000:00:1d.0

    /sys/kernel/iommu_groups/8/devices/0000:00:1d.1

    /sys/kernel/iommu_groups/8/devices/0000:00:1d.2

    /sys/kernel/iommu_groups/8/devices/0000:00:1d.7

    /sys/kernel/iommu_groups/9/devices/0000:00:1e.0

    /sys/kernel/iommu_groups/9/devices/0000:07:01.0

    /sys/kernel/iommu_groups/9/devices/0000:07:02.0

    /sys/kernel/iommu_groups/10/devices/0000:00:1f.0

    /sys/kernel/iommu_groups/10/devices/0000:00:1f.2

    /sys/kernel/iommu_groups/10/devices/0000:00:1f.3

    /sys/kernel/iommu_groups/11/devices/0000:02:00.0

    /sys/kernel/iommu_groups/12/devices/0000:03:00.0

    /sys/kernel/iommu_groups/12/devices/0000:03:00.1

    /sys/kernel/iommu_groups/13/devices/0000:04:00.0

    /sys/kernel/iommu_groups/13/devices/0000:04:00.1

    /sys/kernel/iommu_groups/14/devices/0000:ff:00.0

    /sys/kernel/iommu_groups/14/devices/0000:ff:00.1

    /sys/kernel/iommu_groups/15/devices/0000:ff:02.0

    /sys/kernel/iommu_groups/15/devices/0000:ff:02.1

    /sys/kernel/iommu_groups/16/devices/0000:ff:03.0

    /sys/kernel/iommu_groups/16/devices/0000:ff:03.1

    /sys/kernel/iommu_groups/16/devices/0000:ff:03.4

    /sys/kernel/iommu_groups/17/devices/0000:ff:04.0

    /sys/kernel/iommu_groups/17/devices/0000:ff:04.1

    /sys/kernel/iommu_groups/17/devices/0000:ff:04.2

    /sys/kernel/iommu_groups/17/devices/0000:ff:04.3

    /sys/kernel/iommu_groups/18/devices/0000:ff:05.0

    /sys/kernel/iommu_groups/18/devices/0000:ff:05.1

    /sys/kernel/iommu_groups/18/devices/0000:ff:05.2

    /sys/kernel/iommu_groups/18/devices/0000:ff:05.3

    /sys/kernel/iommu_groups/19/devices/0000:ff:06.0

    /sys/kernel/iommu_groups/19/devices/0000:ff:06.1

    /sys/kernel/iommu_groups/19/devices/0000:ff:06.2

    /sys/kernel/iommu_groups/19/devices/0000:ff:06.3

     

    CPU Thread Pairings

     

    0 <===> 4

    1 <===> 5

    2 <===> 6

    3 <===> 7

     

    USB Devices

     

    Bus 002 Device 005: ID 0951:1666 Kingston Technology DataTraveler G4

    Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 008 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 007 Device 003: ID 1532:0025 Razer USA, Ltd

    Bus 007 Device 002: ID 1b1c:1b1b Corsair

    Bus 007 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 006 Device 002: ID 1532:011a Razer USA, Ltd

    Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 005 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub

    Bus 009 Device 002: ID 2109:2812 VIA Labs, Inc. VL812 Hub

    Bus 009 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 010 Device 002: ID 2109:0812 VIA Labs, Inc. VL812 Hub

    Bus 010 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub

     

    SCSI Devices

     

    [0:0:0:0]    disk    Kingston DataTraveler 3.0 PMAP  /dev/sda

    [1:0:0:0]    disk    ATA      KINGSTON SV300S3 BBF0  /dev/sdb

    [2:0:0:0]    disk    ATA      ST500DM002-1BD14 KC65  /dev/sdc

    [3:0:0:0]    cd/dvd  HL-DT-ST DVDRAM GH15F    EG00  /dev/sr0

    [4:0:0:0]    disk    ATA      ST500DM002-1BD14 KC65  /dev/sdd

    [5:0:0:0]    disk    ATA      ST31000524AS    JC45  /dev/sde

    [6:0:0:0]    disk    ATA      WDC WD10EZEX-75M 1A01  /dev/sdf

     

  • Quote

    1. Does "Info" in the GUI report that HVM and IOMMU are enabled?

    2. are all Visualization settings enabled in the BIOS? (eg VT-d)

    3. Post your syslinux.cfg file (click "Flash"on the main tab). Seems you may need to add a couple of options to get pass-through working

  • Quote

    ok lets start

     

    03:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] [10de:1200] (rev a1)
03:00.1 Audio device [0403]: NVIDIA Corporation GF114 HDMI Audio Controller [10de:0e0c] (rev a1)
04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] [10de:1200] (rev a1)
04:00.1 Audio device [0403]: NVIDIA Corporation GF114 HDMI Audio Controller [10de:0e0c] (rev a1)

06:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde PRO [Radeon HD 7750/8740 / R7 250E] [1002:683f]
06:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series] [1002:aab0]

     

    above are the gpus device id

     

     

    /sys/kernel/iommu_groups/7/devices/0000:00:1c.4
/sys/kernel/iommu_groups/7/devices/0000:05:00.0
/sys/kernel/iommu_groups/7/devices/0000:06:00.0
/sys/kernel/iommu_groups/7/devices/0000:06:00.1
/sys/kernel/iommu_groups/12/devices/0000:03:00.0
/sys/kernel/iommu_groups/12/devices/0000:03:00.1
/sys/kernel/iommu_groups/13/devices/0000:04:00.0
/sys/kernel/iommu_groups/13/devices/0000:04:00.1

     

    above is the iommu groups the gpus are in

     

     

    amd is in group 7 with some other devices so i would expect probs passing that through.

    the nvidea are in group 12 and 13 and are on their own which is good.

     

    The strange thing i see is in your error message.

     

    internal error: early end of file from monitor: possible problem:
2016-06-06T14:59:43.409104Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to set iommu for container: Operation not permitted
2016-06-06T14:59:43.409127Z qemu-system-x86_64: -device vfio-pci,host=03:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on: vfio: failed to setup container for group 14

     

    it says it cant set the iommu for group 14.(failed to setup container for group 14) But from your iommu groups no gpus are in 14

     

    the hardware according to your system devices in group 14 is

    ff:00.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers [8086:2c41] (rev 05)
ff:00.1 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder [8086:2c01] (rev 05)
ff:02.0 Host bridge [0600]: Intel Corporation Xeon 5500/Core i7 QPI Link 0 [8086:2c10] (rev 05)

     

    i would guess you have swapped the slots since the error message you posted??

     

    What i would do now is

    1. put the amd in slot 1 and nvidea in 2 and 3.

    2. make sure in bios the primary display is set for slot 1

    3. once booted into unraid check the graphics you wish to pass through are in their own iommu groups with no other devices present.

    4. if other devices present enable acs overide in the settings vm mangaer (you will need to reboot afterwards)

    5. again check iommu groups.

    7. go back into your web gui and reassigne the gpu you want to passthrough (as changing slots etc will give them a different device id no)

    start the vm and cross fingers!!

     

  • Quote

    Kind of a last resort, but you can try to edit the file /etc/libvirt/qemu.conf while VM manager is enabled, find the line for "cgroup_device_acl" and add the iommu groups for your gpus you are trying to pass through ie. "/dev/vfio/12","/dev/vfio/13","/dev/vfio/14"

    After that restart the VM manager and see if it works

  • Quote
    • Author

    I'll try tonight

     

    Sent from my SM-G920W8 using Tapatalk

     

     

  • Quote

    • Archived

    This topic is now archived and is closed to further replies.

    Go to topic listing

    Account

    Navigation

    Search

    Search

    Configure browser push notifications
    Chrome (Android)
    1. Tap the lock icon next to the address bar.
    2. Tap Permissions → Notifications.
    3. Adjust your preference.
    Chrome (Desktop)
    1. Click the padlock icon in the address bar.
    2. Select Site settings.
    3. Find Notifications and adjust your preference.