Nvidia GT710 GPU Passthrough Strange


Recommended Posts

My system overview is:

 

System Overview
TITLE	INFORMATION
System Overview	
unRAID system:	unRAID server Plus, version 6.8.2
Model:	
Motherboard:	ASUSTeK COMPUTER INC. - WS C246 PRO
Processor:	Intel® Xeon® E-2176G CPU @ 3.70GHz
HVM:	Enabled
IOMMU:	Enabled
Cache:	L1 Cache = 384 kB (max. capacity 384 kB)
L2 Cache = 1536 kB (max. capacity 1536 kB)
L3 Cache = 12288 kB (max. capacity 12288 kB)
Memory:	64 GB (max. installable capacity 64 GB)
ChannelA-DIMM1 = 16384 MB, 2666 MT/s
ChannelA-DIMM2 = 16384 MB, 2666 MT/s
ChannelB-DIMM1 = 16384 MB, 2666 MT/s
ChannelB-DIMM2 = 16384 MB, 2666 MT/s
Network:	eth0: 1000Mb/s, full duplex, mtu 1500
eth1: 1000Mb/s, full duplex, mtu 1500
Kernel:	Linux 4.19.98-Unraid x86_64
OpenSSL:	1.1.1d
P + Q algorithm:	22287 MB/s + 33066 MB/s
Uptime:	0 days, 1 hours, 50 minutes, 32 seconds

BIOS
TITLE	INFORMATION
BIOS Information	
Vendor:	American Megatrends Inc.
Version:	1102
Release Date:	11/08/2019
Address:	0xF0000
Runtime Size:	64 kB
ROM Size:	32 MB
Characteristics:	PCI is supported
APM is supported
BIOS is upgradeable
BIOS shadowing is allowed
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
8042 keyboard services are supported (int 9h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Targeted content distribution is supported
UEFI is supported
BIOS Revision:	5.13

Motherboard
TITLE	INFORMATION
Base Board Information	
Manufacturer:	ASUSTeK COMPUTER INC.
Product Name:	WS C246 PRO
Version:	Rev 1.xx
Serial Number:	
Asset Tag:	Default string
Features:	Board is a hosting board
Board is replaceable
Location In Chassis:	Default string
Type:	Motherboard

Processor
TITLE	INFORMATION
Processor Information	
Socket Designation:	LGA1151
Type:	Central
Family:	Xeon
Manufacturer:	Intel® Corporation
ID:	
Signature:	Type 0, Family 6, Model 158, Stepping 10
Flags:	FPU (Floating-point unit on-chip)
VME (Virtual mode extension)
DE (Debugging extension)
PSE (Page size extension)
TSC (Time stamp counter)
MSR (Model specific registers)
PAE (Physical address extension)
MCE (Machine check exception)
CX8 (CMPXCHG8 instruction supported)
APIC (On-chip APIC hardware supported)
SEP (Fast system call)
MTRR (Memory type range registers)
PGE (Page global enable)
MCA (Machine check architecture)
CMOV (Conditional move instruction supported)
PAT (Page attribute table)
PSE-36 (36-bit page size extension)
CLFSH (CLFLUSH instruction supported)
DS (Debug store)
ACPI (ACPI supported)
MMX (MMX technology supported)
FXSR (FXSAVE and FXSTOR instructions supported)
SSE (Streaming SIMD extensions)
SSE2 (Streaming SIMD extensions 2)
SS (Self-snoop)
HTT (Multi-threading)
TM (Thermal monitor supported)
PBE (Pending break enabled)
Version:	Intel® Xeon® E-2176G CPU @ 3.70GHz
Voltage:	1.1 V
External Clock:	100 MHz
Max Speed:	8300 MHz
Current Speed:	3663 MHz
Status:	Populated, Enabled
Upgrade:	Socket LGA1151
Serial Number:	To Be Filled By O.E.M.
Asset Tag:	To Be Filled By O.E.M.
Part Number:	To Be Filled By O.E.M.
Core Count:	6
Core Enabled:	6
Thread Count:	12
Characteristics:	64-bit capable
Multi-Core
Hardware Thread
Execute Protection
Enhanced Virtualization
Power/Performance Control

Cache Memory
TITLE	INFORMATION
Cache Information	
Socket Designation:	L1 Cache
Configuration:	Enabled, Not Socketed, Level 1
Operational Mode:	Write Back
Location:	Internal
Installed Size:	384 kB
Maximum Size:	384 kB
Supported SRAM Types:	Synchronous
Installed SRAM Type:	Synchronous
Speed:	Unknown
Error Correction Type:	Parity
System Type:	Unified
Associativity:	8-way Set-associative
 
Cache Information	
Socket Designation:	L2 Cache
Configuration:	Enabled, Not Socketed, Level 2
Operational Mode:	Write Back
Location:	Internal
Installed Size:	1536 kB
Maximum Size:	1536 kB
Supported SRAM Types:	Synchronous
Installed SRAM Type:	Synchronous
Speed:	Unknown
Error Correction Type:	Single-bit ECC
System Type:	Unified
Associativity:	4-way Set-associative
 
Cache Information	
Socket Designation:	L3 Cache
Configuration:	Enabled, Not Socketed, Level 3
Operational Mode:	Write Back
Location:	Internal
Installed Size:	12288 kB
Maximum Size:	12288 kB
Supported SRAM Types:	Synchronous
Installed SRAM Type:	Synchronous
Speed:	Unknown
Error Correction Type:	Multi-bit ECC
System Type:	Unified
Associativity:	16-way Set-associative

Memory Summary
TITLE	INFORMATION
Physical Memory Array	
Location:	System Board Or Motherboard
Use:	System Memory
Error Correction Type:	Single-bit ECC
Maximum Capacity:	64 GB
Number Of Devices:	4
Memory Devices

Configured Memory Speed:	2666 MT/s
Minimum Voltage:	Unknown
Maximum Voltage:	Unknown
Configured Voltage:	1.2 V

Ethernet
TITLE	INFORMATION
Port eth0 Information	
Supported ports:	[ TP ]
Supported link modes:	10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use:	Symmetric
Supports auto-negotiation:	Yes
Supported FEC modes:	Not reported
Advertised link modes:	10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use:	No
Advertised auto-negotiation:	Yes
Advertised FEC modes:	Not reported
Speed:	1000Mb/s
Duplex:	Full
Port:	Twisted Pair
PHYAD:	1
Transceiver:	internal
Auto-negotiation:	on
MDI-X:	on (auto)
Supports Wake-on:	pumbg
Wake-on:	g
Current message level:	0x00000007 (7)
drv probe link
Link detected:	yes
MTU size:	1500 bytes
 
Port eth1 Information	
Supported ports:	[ TP ]
Supported link modes:	10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use:	No
Supports auto-negotiation:	Yes
Supported FEC modes:	Not reported
Advertised link modes:	10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use:	No
Advertised auto-negotiation:	Yes
Advertised FEC modes:	Not reported
Speed:	1000Mb/s
Duplex:	Full
Port:	Twisted Pair
PHYAD:	1
Transceiver:	internal
Auto-negotiation:	on
MDI-X:	on (auto)
Supports Wake-on:	pumbg
Wake-on:	g
Current message level:	0x00000007 (7)
drv probe link
Link detected:	yes
MTU size:	1500 bytes

 

 

I followed the @SpaceInvaderOne Win10 Gaming VM video on Youtube.  I had my PCIe ACS Override set to - Downstream.  I have onboard HDMI, a Nvidia 1080ti and an NVidia GT710.

I can change the passthrough graphics card in my Win10 gaming config and it boots fine, audio switches over and both cards run well.  So - VM works, passthrough works and both cards test good.  The 1080ti is a great gaming card, so that one I want to leave paried with the Win10 machine.

 

 

Problem:

I want to run a second, full time VM with the GT710.  This VM is based on Debian, and the image file is here:  https://volumio.org/get-started/  This will be a hifi, efficient media player that is in the Unraid box and will output audio via HDMI to my preamp.

 

If I load the video as VNC, it boots and runs fine and I can get to the web gui, but of course there is no sound output.  If I pass through ONLY the GT710, it fails to boot.  I have tried a downloaded Rom, a dump of my ROM and No ROM attached.  All configurations fail to fully boot.  There are no obvious errors (to me) in the log, it just stops here:

Quote

display none \
-no-user-config \
-nodefaults \
-chardev socket,id=charmonitor,fd=33,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=control \
-rtc base=utc,driftfix=slew \
-global kvm-pit.lost_tick_policy=delay \
-no-hpet \
-no-shutdown \
-boot strict=on \
-device pcie-root-port,port=0x8,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x1 \
-device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \
-device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \
-device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \
-device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \
-device pcie-root-port,port=0xd,chassis=6,id=pci.6,bus=pcie.0,addr=0x1.0x5 \
-device pcie-pci-bridge,id=pci.7,bus=pci.1,addr=0x0 \
-device ich9-usb-ehci1,id=usb,bus=pcie.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pcie.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pcie.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pcie.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.2,addr=0x0 \
-blockdev '{"driver":"file","filename":"/mnt/disks/nongamingvm/guildnoise666/Volumio-buster-kernel.rc3-2019-12-02-x86.img","node-name":"libvirt-1-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-1-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-1-storage"}' \
-device ide-hd,bus=ide.2,drive=libvirt-1-format,id=sata0-0-2,bootindex=1,write-cache=on \
-netdev tap,fd=36,id=hostnet0 \
-device e1000-82545em,netdev=hostnet0,id=net0,mac=52:54:00:0e:c1:68,bus=pci.3,addr=0x0 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=37,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device usb-tablet,id=input0,bus=usb.0,port=1 \
-device vfio-pci,host=0000:06:00.0,id=hostdev0,bus=pci.4,addr=0x0,romfile=/mnt/disks/nongamingvm/guildnoise666/GT710Zotac8028A60010.rom \
-device vfio-pci,host=0000:06:00.1,id=hostdev1,bus=pci.5,addr=0x0 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-01-31 19:36:51.293+0000: Domain id=12 is tainted: high-privileges
2020-01-31 19:36:51.293+0000: Domain id=12 is tainted: host-cpu
char device redirected to /dev/pts/0 (label charserial0)

 

I tried setting my PCIe ACS Override to - Downsteam/multi or "both" in the gui.

My current IOMMU output (set to "both") is:

Quote

IOMMU group 0:[8086:3ec6] 00:00.0 Host bridge: Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers (rev 07)

IOMMU group 1:[8086:1901] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 07)

IOMMU group 2:[8086:1905] 00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x8) (rev 07)

IOMMU group 3:[8086:3e96] 00:02.0 VGA compatible controller: Intel Corporation HD Graphics P630

IOMMU group 4:[8086:a36d] 00:14.0 USB controller: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller (rev 10)

[8086:a36f] 00:14.2 RAM memory: Intel Corporation Cannon Lake PCH Shared SRAM (rev 10)

IOMMU group 5:[8086:a360] 00:16.0 Communication controller: Intel Corporation Cannon Lake PCH HECI Controller (rev 10)

IOMMU group 6:[8086:a352] 00:17.0 SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)

IOMMU group 7:[8086:a340] 00:1b.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #17 (rev f0)

IOMMU group 8:[8086:a32c] 00:1b.4 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #21 (rev f0)

IOMMU group 9:[8086:a338] 00:1c.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #1 (rev f0)

IOMMU group 10:[8086:a33b] 00:1c.3 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #4 (rev f0)

IOMMU group 11:[8086:a33c] 00:1c.4 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #5 (rev f0)

IOMMU group 12:[8086:a330] 00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #9 (rev f0)

IOMMU group 13:[8086:a332] 00:1d.2 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #11 (rev f0)

IOMMU group 14:[8086:a309] 00:1f.0 ISA bridge: Intel Corporation Cannon Point-LP LPC Controller (rev 10)

[8086:a348] 00:1f.3 Audio device: Intel Corporation Cannon Lake PCH cAVS (rev 10)

[8086:a323] 00:1f.4 SMBus: Intel Corporation Cannon Lake PCH SMBus Controller (rev 10)

[8086:a324] 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake PCH SPI Controller (rev 10)

[8086:15bb] 00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (7) I219-LM (rev 10)

IOMMU group 15:[10de:1b06] 01:00.0 VGA compatible controller: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] (rev a1)

IOMMU group 16:[10de:10ef] 01:00.1 Audio device: NVIDIA Corporation GP102 HDMI Audio Controller (rev a1)

IOMMU group 17:[1000:0097] 02:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)

IOMMU group 18:[144d:a808] 04:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983

IOMMU group 19:[10de:128b] 06:00.0 VGA compatible controller: NVIDIA Corporation GK208B [GeForce GT 710] (rev a1)

IOMMU group 20:[10de:0e0f] 06:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)

IOMMU group 21:[1b21:1242] 07:00.0 USB controller: ASMedia Technology Inc. ASM1142 USB 3.1 Host Controller

IOMMU group 22:[15b7:5003] 08:00.0 Non-Volatile memory controller: Sandisk Corp WD Black 2018/PC SN520 NVMe SSD (rev 01)

IOMMU group 23:[8086:1533] 09:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)

 

I can use the exact same xml and put the 1080ti into it and it boots and runs fine.  I can play audio.  This isn't a satisfactory resolution, I don't need a 1080ti for an audio card :)

 

The next two posts will be the XML from the working 1080ti version and the XML from the not working GT710 version.  I can't figure this out 😫

 

Link to comment

This is the XML and boot log from the currently working 1080ti volumio VM.

 

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm' id='2'>
  <name>1080ti Volumio</name>
  <uuid>15df200f-3a9e-03a5-9d05-62f31c4f95d0</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Debian" icon="debian.png" os="debian"/>
  </metadata>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>2</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='2'/>
    <vcpupin vcpu='1' cpuset='8'/>
  </cputune>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-q35-4.2'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/15df200f-3a9e-03a5-9d05-62f31c4f95d0_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='1' cores='1' threads='2'/>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/disks/nongamingvm/1080viotest/Volumio-buster-kernel.rc3-2019-12-02-x86.img' index='1'/>
      <backingStore/>
      <target dev='hdc' bus='sata'/>
      <boot order='1'/>
      <alias name='sata0-0-2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <alias name='usb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <alias name='usb'/>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <alias name='usb'/>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <alias name='usb'/>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='sata' index='0'>
      <alias name='ide'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'>
      <alias name='pcie.0'/>
    </controller>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x8'/>
      <alias name='pci.1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x9'/>
      <alias name='pci.2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0xa'/>
      <alias name='pci.3'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0xb'/>
      <alias name='pci.4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x3'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0xc'/>
      <alias name='pci.5'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x4'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <alias name='virtio-serial0'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:f8:60:08'/>
      <source bridge='br0'/>
      <target dev='vnet0'/>
      <model type='e1000-82545em'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <source path='/dev/pts/0'/>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
      <alias name='serial0'/>
    </serial>
    <console type='pty' tty='/dev/pts/0'>
      <source path='/dev/pts/0'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <channel type='unix'>
      <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-2-1080ti Volumio/org.qemu.guest_agent.0'/>
      <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
      <alias name='channel0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'>
      <alias name='input0'/>
    </input>
    <input type='keyboard' bus='ps2'>
      <alias name='input1'/>
    </input>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
  <seclabel type='dynamic' model='dac' relabel='yes'>
    <label>+0:+100</label>
    <imagelabel>+0:+100</imagelabel>
  </seclabel>
</domain>
Quote

-m 4096 \
-overcommit mem-lock=off \
-smp 2,sockets=1,cores=1,threads=2 \
-uuid 15df200f-3a9e-03a5-9d05-62f31c4f95d0 \
-display none \
-no-user-config \
-nodefaults \
-chardev socket,id=charmonitor,fd=33,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=control \
-rtc base=utc,driftfix=slew \
-global kvm-pit.lost_tick_policy=delay \
-no-hpet \
-no-shutdown \
-boot strict=on \
-device pcie-root-port,port=0x8,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x1 \
-device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \
-device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \
-device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \
-device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \
-device ich9-usb-ehci1,id=usb,bus=pcie.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pcie.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pcie.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pcie.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.2,addr=0x0 \
-blockdev '{"driver":"file","filename":"/mnt/disks/nongamingvm/1080viotest/Volumio-buster-kernel.rc3-2019-12-02-x86.img","node-name":"libvirt-1-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-1-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-1-storage"}' \
-device ide-hd,bus=ide.2,drive=libvirt-1-format,id=sata0-0-2,bootindex=1,write-cache=on \
-netdev tap,fd=35,id=hostnet0 \
-device e1000-82545em,netdev=hostnet0,id=net0,mac=52:54:00:f8:60:08,bus=pci.1,addr=0x0 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=36,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device vfio-pci,host=0000:01:00.0,id=hostdev0,bus=pci.3,addr=0x0 \
-device vfio-pci,host=0000:01:00.1,id=hostdev1,bus=pci.4,addr=0x0 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-01-31 22:49:06.858+0000: Domain id=5 is tainted: high-privileges
2020-01-31 22:49:06.858+0000: Domain id=5 is tainted: host-cpu
char device redirected to /dev/pts/0 (label charserial0)

 

Edited by NOLA_DireWolff
Added Logs
Link to comment

This XML doesn't work with = No ROM, My rom Dump and an internet downloaded rom version.... I'm guessing it isn't a ROM issue?

 

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>gt710 Volumio</name>
  <uuid>a2cad0ce-e67f-de37-8481-433641c8146b</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Debian" icon="debian.png" os="debian"/>
  </metadata>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>2</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='2'/>
    <vcpupin vcpu='1' cpuset='8'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-q35-4.2'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/a2cad0ce-e67f-de37-8481-433641c8146b_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='1' cores='1' threads='2'/>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/disks/nongamingvm/710viotest/Volumio-buster-kernel.rc3-2019-12-02-x86.img'/>
      <target dev='hdc' bus='sata'/>
      <boot order='1'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x8'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x9'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0xa'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0xb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x3'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0xc'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x4'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:e9:6a:de'/>
      <source bridge='br0'/>
      <model type='e1000-82545em'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
</domain>

 

Quote

-m 4096 \
-overcommit mem-lock=off \
-smp 2,sockets=1,cores=1,threads=2 \
-uuid a2cad0ce-e67f-de37-8481-433641c8146b \
-display none \
-no-user-config \
-nodefaults \
-chardev socket,id=charmonitor,fd=34,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=control \
-rtc base=utc,driftfix=slew \
-global kvm-pit.lost_tick_policy=delay \
-no-hpet \
-no-shutdown \
-boot strict=on \
-device pcie-root-port,port=0x8,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x1 \
-device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \
-device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \
-device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \
-device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \
-device ich9-usb-ehci1,id=usb,bus=pcie.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pcie.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pcie.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pcie.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.2,addr=0x0 \
-blockdev '{"driver":"file","filename":"/mnt/disks/nongamingvm/710viotest/Volumio-buster-kernel.rc3-2019-12-02-x86.img","node-name":"libvirt-1-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
-blockdev '{"node-name":"libvirt-1-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-1-storage"}' \
-device ide-hd,bus=ide.2,drive=libvirt-1-format,id=sata0-0-2,bootindex=1,write-cache=on \
-netdev tap,fd=36,id=hostnet0 \
-device e1000-82545em,netdev=hostnet0,id=net0,mac=52:54:00:e9:6a:de,bus=pci.1,addr=0x0 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=37,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device vfio-pci,host=0000:06:00.0,id=hostdev0,bus=pci.3,addr=0x0 \
-device vfio-pci,host=0000:06:00.1,id=hostdev1,bus=pci.4,addr=0x0 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-01-31 22:51:40.284+0000: Domain id=6 is tainted: high-privileges
2020-01-31 22:51:40.284+0000: Domain id=6 is tainted: host-cpu
char device redirected to /dev/pts/1 (label charserial0)

 

Edited by NOLA_DireWolff
Added Logs
Link to comment
32 minutes ago, NOLA_DireWolff said:

I followed the @SpaceInvaderOne Win10 Gaming VM video on Youtube.  I had my PCIe ACS Override set to - Downstream.  I have onboard HDMI, a Nvidia 1080ti and an NVidia GT710.

I can change the passthrough graphics card in my Win10 gaming config and it boots fine, audio switches over and both cards run well.  So - VM works, passthrough works and both cards test good.  The 1080ti is a great gaming card, so that one I want to leave paried with the Win10 machine.

 

Problem:

I want to run a second, full time VM with the GT710.  This VM is based on Debian, and the image file is here:  https://volumio.org/get-started/  This will be a hifi, efficient media player that is in the Unraid box and will output audio via HDMI to my preamp.

 

If I load the video as VNC, it boots and runs fine and I can get to the web gui, but of course there is no sound output.  If I pass through ONLY the GT710, it fails to boot.  I have tried a downloaded Rom, a dump of my ROM and No ROM attached.  All configurations fail to fully boot.  There are no obvious errors (to me) in the log, it just stops here:

When you said "both cards test good", you meant they both work fine if passed through to a Windows VM?

Which card does Unraid boot with?

Link to comment
1 hour ago, testdasi said:

When you said "both cards test good", you meant they both work fine if passed through to a Windows VM?

Which card does Unraid boot with?

I plug a HDMI into my MOBO HDMI, the BIOS post and UNRAID boot go through that.  I have a preamp input dedicated to the 1080ti hdmi out and a preamp hdmi input dedicated to the GT710 hdmi out.

 

By both test good, Yes - The 710 and the 1080 will both run great in my windows VM when I select either one for passthrough.  No bugs, no errors.  I don't think the 710 is "broken".

 

It appears both Passthroughs are successful, moving the hardware to the vfio driver:

Quote

In the 1080ti Volumio VM, it displays the same video as the web gui.  lspci -vnn output is:

 

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] [10de:1b06] (rev a1) (prog-if 00 [VGA controller])
        Subsystem: ASUSTeK Computer Inc. GP102 [GeForce GTX 1080 Ti] [1043:85e4]
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at 82000000 (32-bit, non-prefetchable)
        [virtual] Memory at 6000000000 (64-bit, prefetchable)
        Memory at 6010000000 (64-bit, prefetchable)
        I/O ports at 6000
        Expansion ROM at 83000000 [disabled]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Legacy Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [250] Latency Tolerance Reporting
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [420] Advanced Error Reporting
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Capabilities: [900] Secondary PCI Express <?>
        Kernel driver in use: vfio-pci

01:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
        Subsystem: ASUSTeK Computer Inc. GP102 HDMI Audio Controller [1043:85e4]
        Flags: bus master, fast devsel, latency 0, IRQ 17
        Memory at 83080000 (32-bit, non-prefetchable)
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Kernel driver in use: vfio-pci

 


 

Quote

In the gt710 Volumio VM, the HDMI port powers up and the monitor turns black, as if it is receiving a signal.  The VM never finishes booting, doesn't end up accessible on my network and there is no booting of the VM from that point, it hangs.  lspci -vnn output is:

06:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK208B [GeForce GT 710] [10de:128b] (rev a1) (prog-if 00 [VGA controller])
        Subsystem: ZOTAC International (MCO) Ltd. GK208 [GeForce GT 710B] [19da:5360]
        Flags: bus master, fast devsel, latency 0, IRQ 19
        Memory at 80000000 (32-bit, non-prefetchable)
        Memory at 6018000000 (64-bit, prefetchable)
        Memory at 6020000000 (64-bit, prefetchable)
        I/O ports at 4000
        Expansion ROM at 81000000 [disabled]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Legacy Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Kernel driver in use: vfio-pci

06:00.1 Audio device [0403]: NVIDIA Corporation GK208 HDMI/DP Audio Controller [10de:0e0f] (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. GK208 HDMI/DP Audio Controller [19da:5360]
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at 81080000 (32-bit, non-prefetchable)
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Kernel driver in use: vfio-pci

 

 

Edited by NOLA_DireWolff
Added detail
Link to comment
11 hours ago, NOLA_DireWolff said:

I plug a HDMI into my MOBO HDMI, the BIOS post and UNRAID boot go through that.  I have a preamp input dedicated to the 1080ti hdmi out and a preamp hdmi input dedicated to the GT710 hdmi out.

 

By both test good, Yes - The 710 and the 1080 will both run great in my windows VM when I select either one for passthrough.  No bugs, no errors.  I don't think the 710 is "broken".

 

It appears both Passthroughs are successful, moving the hardware to the vfio driver:

 

 

If the GT710 runs well with Windows VM then the problem lies with the Volumio OS then.

Could be driver, settings, many things but I don't think it would be Unraid related.

 

Link to comment

I had that feeling, and I definitely don't blame Unraid.  I just don't know if I'm doing it improperly, or, if the card seems to be presenting itself to VFIO in a strange manner.  Is there a way to show it as something else to the guest OS?


Its a shame it won't easily work - I don't believe there are any other bitperfect VM/Docker media player options to output audio from my server.  Everything else I could find is a separate physical unit.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.