RichardBoelens

300$/h is a bit much for a home user unfortunately Hopefully someone will be able to point me in the right direction. Other than the Motherboard Model, I've done the exact same configuration with my other build and did not have any issues so I suspect that there is something else at play.

Anyone? This is kinda a make or break for this. I'm having him run windows off a Temp SSD till i get this resolved. But without being able to launch the VM, it makes the computer completely unusable for him. Is there paid support options?

Bump!

@John_M Thanks, I didn't know that. I will shift the Core Assignments next reboot. @cyberdude Yes, it was resolved. I am running it without issues on 4x EVGA 1080ti FTW3s I only had to apply the VBIOS to the First card, the other 3 work fine without I've only tested with 4x VMs with 1x 1080ti going to each VM, I haven't tested 4x 1080ti going to 1x VM I am currently on a different rig, trying to get 2x 1080tis going to the same VM, but I am struggling with an issue with similar symptoms, but different problem. That Thread is Here. Excuse the Cable Management (Or Lack Thereof) in the Pic. It's still a work in progress and I've yet to receive the cables I ordered from Cablemod.

Goal I just rebuilt my father's computer and he's not very computer savvy. The intent was to put him on a Hypervisor so that I can provision him Hardware as he needs it without him worrying about the physical layer. He Games on occasion, and GPU Mines, so Passthrough is important (which is why we went UnRAID instead of HyperV). Problem Whenever trying to start the VM, It shows the Tiannacore Logo. Then one of two different things happen. Either 1) If the VM was improperly shutdown previously, itll take a few minutes, but the windows spinning circles will appear and Windows Recovery pops up. Rebooting after recovery brings you to #2 2) The screen hangs at the Tiannacore Logo (before the spinning circles show up) OR The spinning circles show up, spin once, then hangs halfway through the spin. The VM does not recover from this and freezes. I've been able to boot with VNC + 1 GPU a total of 2 times, in which both cases, I rebooted, and despite making no provisioning changes, after the reboot, the VM fails to boot again. Not sure why/how it booted those times, as I was not able to reproduce that success on demand. Host Specs UnRAID Ver 6.5.1 Asus ROG Maximus X (Has Onboard HDMI + DP used only for UnRAID) Intel I7-8700k 8GB Kingston Memory (Yes I know its kinda low, I intend to replace it with better/more in the near future) EVGA 1080ti FTW3 EVGA 1080ti FTW3 VM Specs All 6 CPU Cores, All 12 Threads 4GB RAM GPU : 1080ti 1.00.0 - HDMI GPU : 1080ti 2.00.0 Audio : 1080ti 1.00.1 - HDMI Troubleshooting done so far 1) Removing Both Passthrough GPUs and only using VNC allows me to boot normally without fail. Adding one or both cards causes it to fail. Tried many combinations. VNC + GPU 1, VNC + GPU 2, VNC + GPU 1+2, GPU 1, GPU 2, GPU 1 + 2 etc etc 2) Tried with and Without GPU's HDMI Audio to see if that affected it, it did not. 3) I had an issue previously with a different Rig that had similar symptoms, Here, Applied the same fix with VBIOS, but this did not resolve the issue. I should also note, that with the other Rig, There was no onboard, just 4x Dedicated GPUs, while in this case, there is an onboard, with 2x Dedicated GPUs. This issue shouldn't happen according to research on this rig because there is onboard VGA. 4) Increased/Decreased Resources such as RAM and CPU to see if there is a difference. No Difference. VM Logs 2018-05-14 23:19:51.682+0000: starting up libvirt version: 4.0.0, qemu version: 2.11.1, hostname: CB-URHost01 LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name guest=CB-01,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-3-CB-01/master-key.aes -machine pc-i440fx-2.11,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host -drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on -drive file=/etc/libvirt/qemu/nvram/c1fc581a-40df-a97d-2753-43497501e9f6_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 -m 4096 -realtime mlock=off -smp 12,sockets=1,cores=6,threads=2 -uuid c1fc581a-40df-a97d-2753-43497501e9f6 -display none -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-3-CB-01/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device nec-usb-xhci,p2=15,p3=15,id=usb,bus=pci.0,-3-CB-01/org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device 'vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x6,romfile=/mnt/user/ISO Repository/Graphics ROM BIOS/EVGA 1080ti FTW3 GPU BIOS.dump' -device vfio-pci,host=02:00.0,id=hostdev1,bus=pci.0,addr=0x8 -device vfio-pci,host=01:00.1,id=hostdev2,bus=pci.0,addr=0x9 -device usb-host,hostbus=1,hostaddr=5,id=hostdev3,bus=usb.0,port=1 -device usb-host,hostbus=1,hostaddr=2,id=hostdev4,bus=usb.0,port=2 -device usb-host,hostbus=1,hostaddr=7,id=hostdev5,bus=usb.0,port=3 -device usb-host,hostbus=1,hostaddr=8,id=hostdev6,bus=usb.0,port=4 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0xa -msg timestamp=on 2018-05-14 23:19:51.682+0000: Domain id=3 is tainted: high-privileges 2018-05-14 23:19:51.682+0000: Domain id=3 is tainted: host-cpu 2018-05-14T23:19:51.723700Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/0 (label charserial0)

Thanks John, BIOS ROM fixed it. You put me on the right track. This was the Video I used to walk me through the process

Cores 1/2 + Threads 5/6 = VM 1 Core 3 + Thread 7 = VM 2 Core 4 + Thread 8 = VM 3 Core 5 + Thread 9 = VM 4 Core 6 + Thread 10 = Spare, might give to VM 1 or 2, not sure yet I don't know about BIOS Roms. I've never heard anything about it. Can you elaborate? Yes, PCIE slots are all blocked and used up as they are disabled due to me running an NVME Drive I haven't really used any guides. Just got the idea from watching LinusTechTips once

UnRAID 6.5.1 Asus Rampage V Ed10 Intel I7-6850K 64GB Trident Z 3333Mhz RAM EVGA 1080ti EVGA 1080ti EVGA 1080ti EVGA 1080ti Ok, So I have a Gaming Rig which I specifically built for the purpose of VR + LAN Parties in my Livingroom. Concept is to pull up 2 folding tables out, plug in 4 Monitors, Keyboards and Mice and have a 4 person LAN Party going. The board (Asus Rampage V Ed 10) has 4x PCI-E16 slots with 4x 1080tis . The board is capable of running all 4 and all 4 was running fine on a previous Windows OS (Before Unraid) so I know hardware compatibility wise is fine. This is how I have it laid out VM1 (Main VM) <- Does not load Nvidia 1080ti 02:0:0 > Monitor 1 VM2 (Gaming VM) <- Loads Fine Nvidia 1080ti 04:0:0 > Monitor 2 VM3 (Gaming VM) <- Loads Fine NVidia 1080ti 05:0:0 > Monitor 3 VM4 (Gaming VM) <- Loads Fine NVidia 1080ti 06:0:0 > Monitor 4 This is what I've observed. VM 2,3,4 will load without issues, and upon initial boot of UnRAID, Monitor 1 will show UnRAIDs CLI. When VM 1 is started, Monitor 1 conks out then turns on again (as if to get signal), backlight comes on, blue light comes on, then loses signal, and blue light turns orange (to show no signal) again. I have tried adding VNC to VM1 so that I can also see what is happening, and when attempting to connect to the VM via VNC (and the monitor which is still showing no signal), the initial starting splash screen shows (the logo for the Virtual Driver before windows starts loading) but seems to be frozen there. No spinning circles that windows typical shows before boot. This is my VM Logs (But I have no idea what I'm looking at 2018-05-13 19:07:23.771+0000: starting up libvirt version: 4.0.0, qemu version: 2.11.1, hostname: AN-URHost01 LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name guest=AN-03,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-3-AN-03/master-key.aes -machine pc-i440fx-2.11,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host -drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on -drive file=/etc/libvirt/qemu/nvram/9bffe904-dfa7-c20d-526c-f24a2b010059_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 -m 12288 -realtime mlock=off -smp 4,sockets=1,cores=2,threads=2 -uuid 9bffe904-dfa7-c20d-526c-f24a2b010059 -display none -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-3-AN-03/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device nec-usb-xhci,p2=15,p3=15,id=usb,bus=pci.0,-3-AN-03/org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device vfio-pci,host=02:00.0,id=hostdev0,bus=pci.0,addr=0x6 -device vfio-pci,host=02:00.1,id=hostdev1,bus=pci.0,addr=0x8 -device usb-host,hostbus=3,hostaddr=7,id=hostdev2,bus=usb.0,port=1 -device usb-host,hostbus=3,hostaddr=3,id=hostdev3,bus=usb.0,port=2 -device usb-host,hostbus=3,hostaddr=10,id=hostdev4,bus=usb.0,port=3 -device usb-host,hostbus=3,hostaddr=5,id=hostdev5,bus=usb.0,port=4 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x9 -msg timestamp=on 2018-05-13 19:07:23.771+0000: Domain id=3 is tainted: high-privileges 2018-05-13 19:07:23.771+0000: Domain id=3 is tainted: host-cpu 2018-05-13T19:07:23.840522Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/2 (label charserial0) libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind libusb: error [udev_hotplug_event] ignoring udev action bind 2018-05-13T19:15:12.183026Z qemu-system-x86_64: terminating on signal 15 from pid 3897 (/usr/sbin/libvirtd) 2018-05-13 19:15:13.583+0000: shutting down, reason=destroyed 2018-05-13 19:17:25.182+0000: starting up libvirt version: 4.0.0, qemu version: 2.11.1, hostname: AN-URHost01 LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name guest=AN-03,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-6-AN-03/master-key.aes -machine pc-i440fx-2.11,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host -drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on -drive file=/etc/libvirt/qemu/nvram/9bffe904-dfa7-c20d-526c-f24a2b010059_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 -m 12288 -realtime mlock=off -smp 4,sockets=1,cores=2,threads=2 -uuid 9bffe904-dfa7-c20d-526c-f24a2b010059 -display none -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-6-AN-03/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device nec-usb-xhci,p2=15,p3=15,id=usb,bus=pci.0,-6-AN-03/org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device vfio-pci,host=02:00.0,id=hostdev0,bus=pci.0,addr=0x6 -device vfio-pci,host=02:00.1,id=hostdev1,bus=pci.0,addr=0x8 -device usb-host,hostbus=3,hostaddr=7,id=hostdev2,bus=usb.0,port=1 -device usb-host,hostbus=3,hostaddr=3,id=hostdev3,bus=usb.0,port=2 -device usb-host,hostbus=3,hostaddr=10,id=hostdev4,bus=usb.0,port=3 -device usb-host,hostbus=3,hostaddr=5,id=hostdev5,bus=usb.0,port=4 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x9 -msg timestamp=on 2018-05-13 19:17:25.182+0000: Domain id=6 is tainted: high-privileges 2018-05-13 19:17:25.182+0000: Domain id=6 is tainted: host-cpu 2018-05-13T19:17:25.250534Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/3 (label charserial0) VM 2,3,4 during all this works fine and independent of this issue. Sometimes VM 1 will shut down on its own (Maybe its timing out on the boot?) Board only has 4 slots for GPUs so I cannot add a 5th crappy GPU to put UnRAID's CLI onto it. Long story short. 5th PCI-E GPU is not an option, Everything has already been Waterblocked. Id be OK with getting a USB VGA Card if there was a way to set it as the Default GPU for UnRAID to solve this issue.