GPU passthrough with one Nvidia card


Recommended Posts

Hello,

 

I have been testing and reading through the forum and wiki for the past week trying to add vm and use the only GPU i have on the system with no success! My GPU is Zotac GT 730 Senerygy Edition

 

Part 1

 

System Information

Model: 1.0
M/B: Intel Corporation - DH55TC
CPU: Intel® Core™ i5 CPU 650 @ 3.20GHz
HVM: Enabled
IOMMU: Enabled
Cache: 64 kB, 512 kB, 4096 kB
Memory: 8192 MB (max. installable capacity 16 GB)
Network: eth0: 1000Mb/s - Full Duplex
Kernel: Linux 4.1.18-unRAID x86_64
OpenSSL: 1.0.1s

 

 

PCI Devices

00:00.0 Host bridge: Intel Corporation Core Processor DRAM Controller (rev 02)
00:01.0 PCI bridge: Intel Corporation Core Processor PCI Express x16 Root Port (rev 02)
00:16.0 Communication controller: Intel Corporation 5 Series/3400 Series Chipset HECI Controller (rev 06)
00:16.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset PT IDER Controller (rev 06)
00:16.3 Serial controller: Intel Corporation 5 Series/3400 Series Chipset KT Controller (rev 06)
00:19.0 Ethernet controller: Intel Corporation 82578DC Gigabit Network Connection (rev 06)
00:1a.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06)
00:1b.0 Audio device: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio (rev 06)
00:1d.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a6)
00:1f.0 ISA bridge: Intel Corporation 5 Series Chipset LPC Interface Controller (rev 06)
00:1f.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA IDE Controller (rev 06)
00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 06)
00:1f.5 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 2 port SATA IDE Controller (rev 06)
01:00.0 VGA compatible controller: NVIDIA Corporation GF108 [GeForce GT 730] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GF108 High Definition Audio Controller (rev a1)
3f:00.0 Host bridge: Intel Corporation Core Processor QuickPath Architecture Generic Non-core Registers (rev 02)
3f:00.1 Host bridge: Intel Corporation Core Processor QuickPath Architecture System Address Decoder (rev 02)
3f:02.0 Host bridge: Intel Corporation Core Processor QPI Link 0 (rev 02)
3f:02.1 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor QPI Physical 0 (rev 02)
3f:02.2 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)
3f:02.3 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)

 

 

IOMMU Groups

/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/1/devices/0000:01:00.0
/sys/kernel/iommu_groups/1/devices/0000:01:00.1
/sys/kernel/iommu_groups/2/devices/0000:00:16.0
/sys/kernel/iommu_groups/2/devices/0000:00:16.2
/sys/kernel/iommu_groups/2/devices/0000:00:16.3
/sys/kernel/iommu_groups/3/devices/0000:00:19.0
/sys/kernel/iommu_groups/4/devices/0000:00:1a.0
/sys/kernel/iommu_groups/5/devices/0000:00:1b.0
/sys/kernel/iommu_groups/6/devices/0000:00:1d.0
/sys/kernel/iommu_groups/7/devices/0000:00:1e.0
/sys/kernel/iommu_groups/8/devices/0000:00:1f.0
/sys/kernel/iommu_groups/8/devices/0000:00:1f.2
/sys/kernel/iommu_groups/8/devices/0000:00:1f.3
/sys/kernel/iommu_groups/8/devices/0000:00:1f.5
/sys/kernel/iommu_groups/9/devices/0000:3f:00.0
/sys/kernel/iommu_groups/9/devices/0000:3f:00.1
/sys/kernel/iommu_groups/10/devices/0000:3f:02.0
/sys/kernel/iommu_groups/10/devices/0000:3f:02.1
/sys/kernel/iommu_groups/10/devices/0000:3f:02.2
/sys/kernel/iommu_groups/10/devices/0000:3f:02.3

 

 

USB Devices


Bus 002 Device 003: ID 04d9:1702 Holtek Semiconductor, Inc. Keyboard LKS02
Bus 002 Device 004: ID 04b3:310c IBM Corp. Wheel Mouse
Bus 002 Device 002: ID 8087:0020 Intel Corp. Integrated Rate Matching Hub
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 007: ID 0781:5571 SanDisk Corp. Cruzer Fit
Bus 001 Device 002: ID 8087:0020 Intel Corp. Integrated Rate Matching Hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

 

 

SCSI Devices

[0:0:0:0]    disk    SanDisk  Cruzer Fit       1.27  /dev/sda 
[1:0:0:0]    disk    ATA      WDC WD10EAVS-00D 1A01  /dev/sdb 
[1:0:1:0]    disk    ATA      BIWIN SSD        0C    /dev/sdc 
[2:0:0:0]    disk    ATA      APPLE HDD ST1000 0008  /dev/sdd

 

 

syslinux.cfg


default /syslinux/menu.c32
menu title Lime Technology
prompt 0
timeout 50
label unRAID OS
  menu default
  kernel /bzimage
  append vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot
label unRAID OS Safe Mode (no plugins)
  kernel /bzimage
  append initrd=/bzroot unraidsafemode
label Memtest86+
  kernel /memtest

 

 

VM XML

<domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
  <name>Tower</name>
  <uuid>6f01f9d1-8f2e-02cc-f4ea-15e260611ed6</uuid>
  <metadata>
    <vmtemplate name="Custom" icon="windows7.png" os="windows7"/>
  </metadata>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <memoryBacking>
    <nosharepages/>
    <locked/>
  </memoryBacking>
  <vcpu placement='static'>2</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='1'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.1'>hvm</type>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough'>
    <topology sockets='1' cores='2' threads='1'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/bin/qemu-system-x86_64</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/user/VDisk/Tower/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/ISO/en_windows_7_professional_x64_dvd_X15-65805.iso'/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/ISO/virtio-win-0.1.102.iso'/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='usb' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:b2:06:e4'/>
      <source bridge='br0'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target port='0'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/Tower.org.qemu.guest_agent.0'/>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <hostdev mode='subsystem' type='usb' managed='yes'>
      <source>
        <vendor id='0x04d9'/>
        <product id='0x1702'/>
      </source>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='yes'>
      <source>
        <vendor id='0x04b3'/>
        <product id='0x310c'/>
      </source>
    </hostdev>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </memballoon>
  </devices>
  <qemu:commandline>
    <qemu:arg value='-device'/>
    <qemu:arg value='ioh3420,bus=pci.0,addr=1c.0,multifunction=on,port=2,chassis=1,id=root.1'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='vfio-pci,host=01:00.1,bus=root.1,addr=00.1'/>
  </qemu:commandline>
</domain>

 

 

unraid_tower-diagnostics-20160518-1413.zip

Link to comment

Part 2

 

root@UNRAID:~# lspci -v
00:00.0 Host bridge: Intel Corporation Core Processor DRAM Controller (rev 02)
Subsystem: Intel Corporation Device 0036
Flags: bus master, fast devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:01.0 PCI bridge: Intel Corporation Core Processor PCI Express x16 Root Port (rev 02) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: fa000000-fb0fffff
Prefetchable memory behind bridge: 00000000f0000000-00000000f9ffffff
Capabilities: [88] Subsystem: Intel Corporation Device 0036
Capabilities: [80] Power Management version 3
Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [a0] Express Root Port (Slot+), MSI 00
Capabilities: [100] Virtual Channel
Kernel driver in use: pcieport

00:16.0 Communication controller: Intel Corporation 5 Series/3400 Series Chipset HECI Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at fb129000 (64-bit, non-prefetchable) [size=16]
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:16.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset PT IDER Controller (rev 06) (prog-if 85 [Master SecO PriO])
Subsystem: Intel Corporation Device 0036
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 3
I/O ports at f150 [size=8]
I/O ports at f140 [size=4]
I/O ports at f130 [size=8]
I/O ports at f120 [size=4]
I/O ports at f110 [size=16]
Capabilities: [c8] Power Management version 3
Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+

00:16.3 Serial controller: Intel Corporation 5 Series/3400 Series Chipset KT Controller (rev 06) (prog-if 02 [16550])
Subsystem: Intel Corporation Device 0036
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 17
I/O ports at f100 [size=8]
Memory at fb128000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [c8] Power Management version 3
Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
Kernel driver in use: serial

00:19.0 Ethernet controller: Intel Corporation 82578DC Gigabit Network Connection (rev 06)
Subsystem: Intel Corporation Device 0036
Flags: bus master, fast devsel, latency 0, IRQ 27
Memory at fb100000 (32-bit, non-prefetchable) [size=128K]
Memory at fb127000 (32-bit, non-prefetchable) [size=4K]
I/O ports at f020 [size=32]
Capabilities: [c8] Power Management version 2
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [e0] PCI Advanced Features
Kernel driver in use: e1000e
Kernel modules: e1000e

00:1a.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06) (prog-if 20 [EHCI])
Subsystem: Intel Corporation Device 0036
Flags: bus master, medium devsel, latency 0, IRQ 16
Memory at fb126000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci-pci

00:1b.0 Audio device: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio (rev 06)
Subsystem: Intel Corporation Device 0036
Flags: fast devsel, IRQ 22
Memory at fb120000 (64-bit, non-prefetchable) [disabled] [size=16K]
Capabilities: [50] Power Management version 2
Capabilities: [60] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [130] Root Complex Link
Kernel driver in use: vfio-pci

00:1d.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06) (prog-if 20 [EHCI])
Subsystem: Intel Corporation Device 0036
Flags: bus master, medium devsel, latency 0, IRQ 23
Memory at fb125000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci-pci

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a6) (prog-if 01 [subtractive decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=32
Capabilities: [50] Subsystem: Intel Corporation Device 0036

00:1f.0 ISA bridge: Intel Corporation 5 Series Chipset LPC Interface Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Flags: bus master, medium devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=10 <?>

00:1f.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA IDE Controller (rev 06) (prog-if 8f [Master SecP SecO PriP PriO])
Subsystem: Intel Corporation Device 0036
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 19
I/O ports at f0f0 [size=8]
I/O ports at f0e0 [size=4]
I/O ports at f0d0 [size=8]
I/O ports at f0c0 [size=4]
I/O ports at f0b0 [size=16]
I/O ports at f0a0 [size=16]
Capabilities: [70] Power Management version 3
Capabilities: [b0] PCI Advanced Features
Kernel driver in use: ata_piix
Kernel modules: ata_piix

00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Flags: medium devsel, IRQ 18
Memory at fb124000 (64-bit, non-prefetchable) [size=256]
I/O ports at f000 [size=32]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801

00:1f.5 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 2 port SATA IDE Controller (rev 06) (prog-if 85 [Master SecO PriO])
Subsystem: Intel Corporation Device 0036
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 19
I/O ports at f090 [size=8]
I/O ports at f080 [size=4]
I/O ports at f070 [size=8]
I/O ports at f060 [size=4]
I/O ports at f050 [size=16]
I/O ports at f040 [size=16]
Capabilities: [70] Power Management version 3
Capabilities: [b0] PCI Advanced Features
Kernel driver in use: ata_piix
Kernel modules: ata_piix

01:00.0 VGA compatible controller: NVIDIA Corporation GF108 [GeForce GT 730] (rev a1) (prog-if 00 [VGA controller])
Subsystem: ZOTAC International (MCO) Ltd. Device 8231
Flags: fast devsel, IRQ 16
Memory at fa000000 (32-bit, non-prefetchable) [size=16M]
Memory at f0000000 (64-bit, prefetchable) [size=128M]
Memory at f8000000 (64-bit, prefetchable) [size=32M]
I/O ports at e000 [size=128]
Expansion ROM at fb000000 [disabled] [size=512K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [b4] Vendor Specific Information: Len=14 <?>
Capabilities: [100] Virtual Channel
Capabilities: [128] Power Budgeting <?>
Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Kernel driver in use: vfio-pci

01:00.1 Audio device: NVIDIA Corporation GF108 High Definition Audio Controller (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. Device 8231
Flags: fast devsel, IRQ 17
Memory at fb080000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Kernel driver in use: vfio-pci

3f:00.0 Host bridge: Intel Corporation Core Processor QuickPath Architecture Generic Non-core Registers (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

3f:00.1 Host bridge: Intel Corporation Core Processor QuickPath Architecture System Address Decoder (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

3f:02.0 Host bridge: Intel Corporation Core Processor QPI Link 0 (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

3f:02.1 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor QPI Physical 0 (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

3f:02.2 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

3f:02.3 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)
Subsystem: Intel Corporation Device 8086
Flags: bus master, fast devsel, latency 0

root@UNRAID:~#

 

root@UNRAID:~# lspci -k
00:00.0 Host bridge: Intel Corporation Core Processor DRAM Controller (rev 02)
Subsystem: Intel Corporation Device 0036
00:01.0 PCI bridge: Intel Corporation Core Processor PCI Express x16 Root Port (rev 02)
Kernel driver in use: pcieport
00:16.0 Communication controller: Intel Corporation 5 Series/3400 Series Chipset HECI Controller (rev 06)
Subsystem: Intel Corporation Device 0036
00:16.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset PT IDER Controller (rev 06)
Subsystem: Intel Corporation Device 0036
00:16.3 Serial controller: Intel Corporation 5 Series/3400 Series Chipset KT Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: serial
00:19.0 Ethernet controller: Intel Corporation 82578DC Gigabit Network Connection (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: e1000e
Kernel modules: e1000e
00:1a.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: ehci-pci
00:1b.0 Audio device: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: vfio-pci
00:1d.0 USB controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: ehci-pci
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a6)
00:1f.0 ISA bridge: Intel Corporation 5 Series Chipset LPC Interface Controller (rev 06)
Subsystem: Intel Corporation Device 0036
00:1f.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA IDE Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: ata_piix
Kernel modules: ata_piix
00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801
00:1f.5 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 2 port SATA IDE Controller (rev 06)
Subsystem: Intel Corporation Device 0036
Kernel driver in use: ata_piix
Kernel modules: ata_piix
01:00.0 VGA compatible controller: NVIDIA Corporation GF108 [GeForce GT 730] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. Device 8231
Kernel driver in use: vfio-pci
01:00.1 Audio device: NVIDIA Corporation GF108 High Definition Audio Controller (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. Device 8231
Kernel driver in use: vfio-pci
3f:00.0 Host bridge: Intel Corporation Core Processor QuickPath Architecture Generic Non-core Registers (rev 02)
Subsystem: Intel Corporation Device 8086
3f:00.1 Host bridge: Intel Corporation Core Processor QuickPath Architecture System Address Decoder (rev 02)
Subsystem: Intel Corporation Device 8086
3f:02.0 Host bridge: Intel Corporation Core Processor QPI Link 0 (rev 02)
Subsystem: Intel Corporation Device 8086
3f:02.1 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor QPI Physical 0 (rev 02)
Subsystem: Intel Corporation Device 8086
3f:02.2 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)
Subsystem: Intel Corporation Device 8086
3f:02.3 Host bridge: Intel Corporation 1st Generation Core i3/5/7 Processor Reserved (rev 02)
Subsystem: Intel Corporation Device 8086
root@UNRAID:~#

 

 

VM error log

 

2016-05-18 11:20:19.698+0000: starting up libvirt version: 1.2.18, qemu version: 2.3.0

LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/bin/qemu-system-x86_64 -name Tower -S -machine pc-i440fx-2.1,accel=kvm,usb=off,mem-merge=off -cpu host -m 4096 -realtime mlock=on -smp 2,sockets=1,cores=2,threads=1 -uuid 6f01f9d1-8f2e-02cc-f4ea-15e260611ed6 -nographic -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/Tower.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x3 -drive file=/mnt/user/VDisk/Tower/vdisk1.img,if=none,id=drive-virtio-disk2,format=raw,cache=writeback -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk2,id=virtio-disk2,bootindex=1 -drive file=/mnt/user/ISO/en_windows_7_professional_x64_dvd_X15-65805.iso,if=none,id=drive-ide0-st=01:00.1,bus=root.1,addr=00.1 -msg timestamp=on

Domain id=8 is tainted: high-privileges

Domain id=8 is tainted: custom-argv

Domain id=8 is tainted: host-cpu

char device redirected to /dev/pts/0 (label charserial0)

 

Link to comment

Update,

 

In BIOS if i select in Video Configuration

 

1- IGD Primary Video port ---> Auto,VGA or Dvi ---> i can see unraid booting screen but i must keep it ( Auto or PCIe Graphics ) in Primary Video Adaptor to see my GPU in Devices list and no passthrough.

 

 

2- Primary Video Adaptor ---> Int Graphics (IGD)---->i can see unraid boot screen connected from ( Integrated HDMI port on the motherboard ) but i lose my GPU from the devices list and no matter what i select in  ( IGD Primary Video port ).

 

 

3- Primary Video Adaptor ---> Ext PCIe Graphics (PEG) ---> i can see unraid boot screen connected from ( my GPU HDMI port ) and no passthrough.

 

 

4- Primary Video Adaptor ---> Ext PCI Graphics --> can't see unriad boot screen and lost access to my BIOS Settings, i had to reset my BIOS.

 

 

5- Primary Video port ---> Auto ---> I can see unraid boot screen and My GPU is in devices list and no passthrough.

 

 

I hope this is not confusing. Thanks.

 

 

TvU1pS.png

ziUt4h.png

Link to comment

You primary graphics should be the integrated graphics on cpu, as it is very difficult to pass though an nvidea card as the only card in system.

 

The problem to me looks like it could be your iommu groups.

 

Your nvidea gpu is in group 1 with a PCI bridge:

/sys/kernel/iommu_groups/1/devices/0000:00:01.0 *************
/sys/kernel/iommu_groups/1/devices/0000:01:00.0
/sys/kernel/iommu_groups/1/devices/0000:01:00.1

 

You need to isolate the gpu in its own iommu group for sucessful passthrough.

 

Try enabling acs overide in the vm settings. You will need to reboot server after doing this. Then see if that puts the gpu in it own isolated group

 

Link to comment

Thanks for your reply grid runner,

 

Here is group list after enabling acs override

 

IOMMU Groups

 

/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/2/devices/0000:00:16.0
/sys/kernel/iommu_groups/2/devices/0000:00:16.2
/sys/kernel/iommu_groups/2/devices/0000:00:16.3
/sys/kernel/iommu_groups/3/devices/0000:00:19.0
/sys/kernel/iommu_groups/4/devices/0000:00:1a.0
/sys/kernel/iommu_groups/5/devices/0000:00:1b.0
/sys/kernel/iommu_groups/6/devices/0000:00:1d.0
/sys/kernel/iommu_groups/7/devices/0000:00:1e.0
/sys/kernel/iommu_groups/8/devices/0000:00:1f.0
/sys/kernel/iommu_groups/8/devices/0000:00:1f.2
/sys/kernel/iommu_groups/8/devices/0000:00:1f.3
/sys/kernel/iommu_groups/8/devices/0000:00:1f.5
/sys/kernel/iommu_groups/9/devices/0000:01:00.0
/sys/kernel/iommu_groups/9/devices/0000:01:00.1
/sys/kernel/iommu_groups/10/devices/0000:3f:00.0
/sys/kernel/iommu_groups/10/devices/0000:3f:00.1
/sys/kernel/iommu_groups/11/devices/0000:3f:02.0
/sys/kernel/iommu_groups/11/devices/0000:3f:02.1
/sys/kernel/iommu_groups/11/devices/0000:3f:02.2
/sys/kernel/iommu_groups/11/devices/0000:3f:02.3

 

 

still can't passthrough even i tried different  BIOS settings in VM check screenshot below

 

 

 

 

 

UNRAID_Tower-UpdateVM_Safari_Today_at_8_36.53_PM.png.b0500a0a6dabc8f1ce2472a4356a311f.png

UNRAID_Tower-UpdateVM_Safari_Today_at_8_20.19_PM.png.c2b6e7ec5515922bef5ae10102490d52.png

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.