February 14, 201610 yr So, I recently upgraded to Unraid 6 and have setup a Win 10 VM which is working pretty well for the most part. However, every time I shut the VM down and try to restart it, the monitors stay black even though no errors show up and it seems to be running. If I shut down the array and reboot the computer entirely it will start up again. I've updated both my bios and my graphics drivers with no luck so far. I'm still quite new to all of this, so if you could let me know what information you need to help me with this I could be glad to provide it. Thank you in advance!
February 14, 201610 yr I know it's not help, but I'm having a similar issue and searching for an answer myself. I'll be sure to report back if I find anything.
February 14, 201610 yr It sounds like when you shutdown the vm its not releasing the graphics card, so when you start it again the screen is black. restarting the server releases the card hence the vm works again. best to post your pci devices iommu groups and xml so we can see that
February 14, 201610 yr It sounds like your graphic cards doesn't support to be reset, hence the need to reboot the host. Which cards do you have?
February 14, 201610 yr In the XEN days, I had to eject the card during shutdown, not certain if needed with current tech http://lime-technology.com/forum/index.php?topic=33396.0
February 14, 201610 yr In the XEN days, I had to eject the card during shutdown, not certain if needed with current tech http://lime-technology.com/forum/index.php?topic=33396.0 I think I saw someone mentioned that they did this now with KVM, so it's worth a try.
February 14, 201610 yr Author It is kind of an old card, below is my setup and all the other relevant information. I'm going to read up on one of the ideas posted, but figured i'd post all my info in case a solution was obvious. ASRock EC3224 Xeon 1231 v3 16GB ECC Ram GeForce GTX 550ti (The one for the VM) Radeon HD 2350 (for unraid) PCIe USB 3.0 Card PCI sound card (not working yet) 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Controller (rev 06) 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller (rev 06) 00:01.1 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x8 Controller (rev 06) 00:14.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI (rev 05) 00:16.0 Communication controller: Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #1 (rev 04) 00:16.1 Communication controller: Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #2 (rev 04) 00:1a.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 (rev 05) 00:1c.0 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 (rev d5) 00:1c.1 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 (rev d5) 00:1c.4 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #5 (rev d5) 00:1c.5 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #6 (rev d5) 00:1c.6 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #7 (rev d5) 00:1c.7 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #8 (rev d5) 00:1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 (rev 05) 00:1f.0 ISA bridge: Intel Corporation C224 Series Chipset Family Server Standard SKU LPC Controller (rev 05) 00:1f.2 SATA controller: Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Controller 1 [AHCI mode] (rev 05) 00:1f.3 SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller (rev 05) 01:00.0 VGA compatible controller: NVIDIA Corporation GF116 [GeForce GTX 550 Ti] (rev a1) 01:00.1 Audio device: NVIDIA Corporation GF116 High Definition Audio Controller (rev a1) 02:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] RV610 [Radeon HD 2400 PRO] 02:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] RV610 HDMI Audio [Radeon HD 2350/2400 Series] 03:00.0 PCI bridge: ASMedia Technology Inc. ASM1083/1085 PCIe to PCI Bridge (rev 03) 04:00.0 Multimedia audio controller: VIA Technologies Inc. VT1720/24 [Envy24PT/HT] PCI Multi-Channel Audio Controller (rev 01) 05:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) 06:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03) 07:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03) 08:00.0 USB controller: Fresco Logic Device 1100 (rev 10) 09:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 02) 0a:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 21) /sys/kernel/iommu_groups/0/devices/0000:00:00.0 /sys/kernel/iommu_groups/1/devices/0000:00:01.0 /sys/kernel/iommu_groups/1/devices/0000:00:01.1 /sys/kernel/iommu_groups/1/devices/0000:01:00.0 /sys/kernel/iommu_groups/1/devices/0000:01:00.1 /sys/kernel/iommu_groups/1/devices/0000:02:00.0 /sys/kernel/iommu_groups/1/devices/0000:02:00.1 /sys/kernel/iommu_groups/2/devices/0000:00:14.0 /sys/kernel/iommu_groups/3/devices/0000:00:16.0 /sys/kernel/iommu_groups/3/devices/0000:00:16.1 /sys/kernel/iommu_groups/4/devices/0000:00:1a.0 /sys/kernel/iommu_groups/5/devices/0000:00:1c.0 /sys/kernel/iommu_groups/6/devices/0000:00:1c.1 /sys/kernel/iommu_groups/7/devices/0000:00:1c.4 /sys/kernel/iommu_groups/8/devices/0000:00:1c.5 /sys/kernel/iommu_groups/9/devices/0000:00:1c.6 /sys/kernel/iommu_groups/10/devices/0000:00:1c.7 /sys/kernel/iommu_groups/11/devices/0000:00:1d.0 /sys/kernel/iommu_groups/12/devices/0000:00:1f.0 /sys/kernel/iommu_groups/12/devices/0000:00:1f.2 /sys/kernel/iommu_groups/12/devices/0000:00:1f.3 /sys/kernel/iommu_groups/13/devices/0000:03:00.0 /sys/kernel/iommu_groups/13/devices/0000:04:00.0 /sys/kernel/iommu_groups/14/devices/0000:05:00.0 /sys/kernel/iommu_groups/15/devices/0000:06:00.0 /sys/kernel/iommu_groups/16/devices/0000:07:00.0 /sys/kernel/iommu_groups/17/devices/0000:08:00.0 /sys/kernel/iommu_groups/18/devices/0000:09:00.0 /sys/kernel/iommu_groups/18/devices/0000:0a:00.0 <domain type='kvm' id='7' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'> <name>Windows 10 Virtual Desktop</name> <uuid>cf6f7a1d-dcbf-e404-7701-6a9c3bb9673d</uuid> <metadata> <vmtemplate name="Custom" icon="windows.png" os="windows"/> </metadata> <memory unit='KiB'>4194304</memory> <currentMemory unit='KiB'>4194304</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>4</vcpu> <cputune> <vcpupin vcpu='0' cpuset='4'/> <vcpupin vcpu='1' cpuset='5'/> <vcpupin vcpu='2' cpuset='6'/> <vcpupin vcpu='3' cpuset='7'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.3'>hvm</type> </os> <features> <acpi/> <apic/> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> <clock offset='localtime'> <timer name='rtc' tickpolicy='catchup'/> <timer name='pit' tickpolicy='delay'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/bin/qemu-system-x86_64</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/vdisks/Windows 10 Virtual Desktop/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/ISOs/Windows.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/ISOs/virtio-win-0.1.102.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:4e:aa:a4'/> <source bridge='br0'/> <target dev='vnet1'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/1'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/1'> <source path='/dev/pts/1'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/Windows 10 Virtual Desktop.org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x172f'/> <product id='0x0031'/> <address bus='3' device='4'/> </source> <alias name='hostdev0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x046d'/> <product id='0xc30a'/> <address bus='3' device='5'/> </source> <alias name='hostdev1'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x046d'/> <product id='0xc52b'/> <address bus='3' device='2'/> </source> <alias name='hostdev2'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x413c'/> <product id='0x5124'/> <address bus='1' device='7'/> </source> <alias name='hostdev3'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x1941'/> <product id='0x8021'/> <address bus='1' device='9'/> </source> <alias name='hostdev4'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='yes'> <source> <vendor id='0x1f44'/> <product id='0x0050'/> <address bus='1' device='15'/> </source> <alias name='hostdev5'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </memballoon> </devices> <qemu:commandline> <qemu:arg value='-device'/> <qemu:arg value='ioh3420,bus=pci.0,addr=1c.0,multifunction=on,port=2,chassis=1,id=root.1'/> <qemu:arg value='-device'/> <qemu:arg value='vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on'/> </qemu:commandline> </domain>
February 14, 201610 yr If I remember correctly, the 550 card is known to cause this error. Don't remember if the workaround to eject it before rebooting helps, but it's worth the try
February 14, 201610 yr Author If I remember correctly, the 550 card is known to cause this error. Don't remember if the workaround to eject it before rebooting helps, but it's worth the try Thanks! I'll give it shot when I get home later today and, if it seems to be more trouble than it's worth, I might just get a different GPU.
February 14, 201610 yr It is kind of an old card, below is my setup and all the other relevant information. I'm going to read up on one of the ideas posted, but figured i'd post all my info in case a solution was obvious. ASRock EC3224 Xeon 1231 v3 16GB ECC Ram GeForce GTX 550ti (The one for the VM) Radeon HD 2350 (for unraid) PCIe USB 3.0 Card PCI sound card (not working yet) ***redacted for length*** Interesting, I'm running an Asus 550ti as well
February 14, 201610 yr https://www.linuxserver.io/index.php/2013/09/12/xen-4-3-windows-8-with-vga-passthrough-on-arch-linux/
February 14, 201610 yr https://www.linuxserver.io/index.php/2013/09/12/xen-4-3-windows-8-with-vga-passthrough-on-arch-linux/ This is helpful, but the reboot scripts link is dead on the page.
February 14, 201610 yr Author Hey, I found this post which I think is about what we need and might have the script. I'm not really savy when it comes to this stuff, maybe you can run with it. https://forum.linuxserver.io/index.php?threads/windows-8-1-reboot-script-issue.241/
February 15, 201610 yr I have a 550TI and i have to shut down the whole system and power it back on to reboot the VM. I have a 970 on the way to hopefully fix that problem.
February 15, 201610 yr Looking at your iommu groups both your graphics cards are in the same iommu group /sys/kernel/iommu_groups/1/devices/0000:00:01.0 (Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Controller) /sys/kernel/iommu_groups/1/devices/0000:00:01.1 (00:01.0 PCI bridge: Intel Corporation Xeon E3-1200) /sys/kernel/iommu_groups/1/devices/0000:01:00.0 (01:00.0 VGA compatible controller: NVIDIA Corporation GF116 [GeForce GTX 550 Ti) /sys/kernel/iommu_groups/1/devices/0000:01:00.1 (01:00.1 Audio device: NVIDIA Corporation GF116 High Definition Audio Controller) /sys/kernel/iommu_groups/1/devices/0000:02:00.0 (02:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]) /sys/kernel/iommu_groups/1/devices/0000:02:00.1 (02:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] RV610 HDMI Audio) This will cause problems. You must split them up. Have you tried PCIe ACS Override set to yes?
February 15, 201610 yr Looking at your iommu groups both your graphics cards are in the same iommu group /sys/kernel/iommu_groups/1/devices/0000:00:01.0 (Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Controller) /sys/kernel/iommu_groups/1/devices/0000:00:01.1 (00:01.0 PCI bridge: Intel Corporation Xeon E3-1200) /sys/kernel/iommu_groups/1/devices/0000:01:00.0 (01:00.0 VGA compatible controller: NVIDIA Corporation GF116 [GeForce GTX 550 Ti) /sys/kernel/iommu_groups/1/devices/0000:01:00.1 (01:00.1 Audio device: NVIDIA Corporation GF116 High Definition Audio Controller) /sys/kernel/iommu_groups/1/devices/0000:02:00.0 (02:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]) /sys/kernel/iommu_groups/1/devices/0000:02:00.1 (02:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] RV610 HDMI Audio) This will cause problems. You must split them up. Have you tried PCIe ACS Override set to yes? Good catch To the OP, why don't you use the aspeed graphics for unraid console? Then you don't need to use the amd card and can throw it out or pass it through to another VM (if its possible to pass through correctly).
Archived
This topic is now archived and is closed to further replies.