Mythzz

I remember it taking 10 - 15 mins to recognize the card AFTER attching the GPU. So I`m assuming Windows. I tried installing the Nvidia one, but th edarn thing keeps hanging before the install even finishes.

Thanks 1812. I did happen to bump into the Unraid wiki which clearly says 6xx and above. I should have paid more attention. I got so caught up in testing this, I missed that detail. Btw any idea about the weird Windows VM issue i`m seeing? The one with the 980ti and white streaks across the screen a monute after booting? I can reproduce that on the fly, no matter what CPU core I assign to the VM. Or.....Shall I open this in a separate thread? Happy to.

So far, I havent been able to pinpoint or workaround the problem. Additionally I`m also seeing that any Windows VM I create (via the 560Ti or the 980Ti) seems to go into a "Paused" state if you leave it running for about 10 mins. It also causes UNRAID to hang, and become unresponsive. The screen on the Windows VM will go all Glitchy (White lines from top to bottom) before migrating to a black screen. I`m not sure if these 2 issues are related. Its stable if not passed through the GPU.

Been trying a few things over the week, to see if I could reduce the problem, but nothing so far: When the VM boots fine I see the following line in the UNRAID system logs: Jun 1 14:33:49 MythzUNRAID kernel: vfio-pci 0000:01:00.0: enabling device (0000 -> 0003) No Clues found in the VM logs of late. I wonder if this has anything to do with the monitor its connected to? Read that in a random forum while researching. But I did try connecting it to a different screen which didnt help. I earlier thought that the error, pointed to some issue with the ROM I was using. Doesnt explain why it works sporadically. If anyone knows of any logs I should be looking at, happy to oblige.

I`m seeing this strange issue when you start any sort of VM on UNRAID. If I run a passthrough my 560Ti, it will boot (and reboot) fine a few times. Post which it will blank out completely, and I notice the 560Ti GPU Fan kicks in at full throttle (Though nothings rendering on the screen). I DONT see this happening on my 980Ti. If I reboot UNRAID, the issue goes away for some time, and then the problem comes back after a few VM reboots. Has anyone experienced this? My rig has the current steup: i5-6600K AsRock Fatal1ty Z170 Gaming K4/D3 32 GB DDR3 RAM Asus 980Ti Strix 6GB (Secondary Slot) Zotac 560Ti 1GB (Primary Slot) MY IOMMU Groups have all been separated correctly. In the VM logs I dont see any error pointing to something obvious. However in the system logs I do see this line: May 30 13:59:27 MythzUNRAID kernel: vfio-pci 0000:01:00.0: Invalid PCI ROM header signature: expecting 0xaa55, got 0xffff 0000:01:00.0 as per the IOMMU groups points to my 560Ti GPU. IOMMU group 14:[10de:1200] 01:00.0 VGA compatible controller: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] (rev a1) Now the VBIOS`s Ive tried are ALL from Techpowerup, as well as a dump from GPU-Z. They all bring back the same line above. MY IOMMU Groups have all been separated correctly. (It has ACS overide set to "BOTH".) Any clues?

After many attempts (with both my display cards) : I cannot bring the Windows VM to display anything but a black screen, during the install process. But I can {thanks to spies} run the install via VNC, remote in and install the nvidia driver msi manually. That seems to be the only way for me as of now. And for a lot of other people i imagine. Thanks again Spies for all your help.

I tried multiple templates of Windows, changing certain parameters to match what I had on the Working Ubuntu Profile. Just refused to display after I tried attaching it else where. I was able to RDP to the machine, and noticed the card vanished! Both cards didnt get detected, which is strange. I then tried to attach it back to the WORKING Ubuntu profile and it wouldnt display. Really weird. I`m going to make a new W10 machine via VNC, upto the point it installs the MS Basic driver and see if I can replicate the process.

Ah this is such a relief, thanks to you. Lemme try swapping it with a regular W10 template and see what it does.

Dude it worked!!! I just restarted the machine a couple of times to make sure I wasnt seeing things. I could even see the OVMF screen pop up. Does this mean each time I make a Windows VM, ill have to first VNC the VM, then use an RDP console to install drivers manually each time?

Interesting.....i dont see the Nvidia card listed here: Ill install the nvidia package manually and see what happens.

I tried to attach a Windows VM from the Ubuntu profile......Darn thing keeps reveting back to the original one. I tried a New Ubuntu Profile and the same thing happened there as well. Edit : Ignore the last one. I got it to attach. No dosplay again though 😞 Heres the log of the Ubuntu VM profile, with the attached Windows HDD: -overcommit mem-lock=off \ -smp 1,sockets=1,cores=1,threads=1 \ -uuid 58769148-74e7-be3c-1f20-6ab31d4c8219 \ -display none \ -no-user-config \ -nodefaults \ -chardev socket,id=charmonitor,fd=33,server,nowait \ -mon chardev=charmonitor,id=monitor,mode=control \ -rtc base=utc,driftfix=slew \ -global kvm-pit.lost_tick_policy=delay \ -no-hpet \ -no-shutdown \ -boot strict=on \ -device pcie-root-port,port=0x8,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x1 \ -device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \ -device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \ -device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \ -device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \ -device ich9-usb-ehci1,id=usb,bus=pcie.0,addr=0x7.0x7 \ -device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pcie.0,multifunction=on,addr=0x7 \ -device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pcie.0,addr=0x7.0x1 \ -device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pcie.0,addr=0x7.0x2 \ -device virtio-serial-pci,id=virtio-serial0,bus=pci.2,addr=0x0 \ -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 10 - VNC/vdisk1.img","node-name":"libvirt-1-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \ -blockdev '{"node-name":"libvirt-1-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-1-storage"}' \ -device ide-hd,bus=ide.2,drive=libvirt-1-format,id=sata0-0-2,bootindex=1,write-cache=on \ -netdev tap,fd=35,id=hostnet0,vhost=on,vhostfd=36 \ -device virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:d3:c6:ba,bus=pci.1,addr=0x0 \ -chardev pty,id=charserial0 \ -device isa-serial,chardev=charserial0,id=serial0 \ -chardev socket,id=charchannel0,fd=37,server,nowait \ -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \ -device vfio-pci,host=0000:07:00.0,id=hostdev0,bus=pci.3,addr=0x0,romfile=/vROM/Asus.GTX980Ti.6144.151012.rom \ -device vfio-pci,host=0000:07:00.1,id=hostdev1,bus=pci.4,addr=0x0 \ -device usb-host,hostbus=1,hostaddr=2,id=hostdev2,bus=usb.0,port=1 \ -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \ -msg timestamp=on 2020-05-25 10:41:01.892+0000: Domain id=1 is tainted: high-privileges 2020-05-25 10:41:01.892+0000: Domain id=1 is tainted: host-cpu char device redirected to /dev/pts/0 (label charserial0) No errors sadly.......

Thats a good idea. Do you think this is a good approach? I`ll create a WIndows VM using VNC as the display driver. So i can at least complete the installation. That way once I attach the Windows IMG to the Ubuntu profile (even if it doesnt display anything via the GPU), we can at least TRY to RDP to it to see whats wrong.

Just stubbed the 560Ti in the VFI app: Rebooted UNRAID, Windows VM still wont display anything.....Still using the same Disk-less VM

I do have 2 cards in my system. I have tested both of them using Linux and they work brilliantly. I had 2 Linux machines running on individual cards, simultaneously. At the moment, my 560Ti is the primary card (top slot). I did have the 980Ti in my top slot earlier, but never had any success with Windows. I did leave one card in the system earlier, just to see if it would make a difference to Windows (first i removed the 560Ti, and then ONLY the 980Ti). Linux worked, but not Windows. I`ll try the Plugin you mentioned for Stubbing the DIsplay card correctly. These are my display cards under system devices : 560TI IOMMU group 1:[8086:1901] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 07) [10de:1200] 01:00.0 VGA compatible controller: NVIDIA Corporation GF114 [GeForce GTX 560 Ti] (rev a1) [10de:0e0c] 01:00.1 Audio device: NVIDIA Corporation GF114 HDMI Audio Controller (rev a1) 980Ti IOMMU group 15:[10de:17c8] 07:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX 980 Ti] (rev a1) [10de:0fb0] 07:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1) Look alright?