Hi Folks,
New to the unraid world, I'm trying to set up a box with a windows gaming VM and a linux dev VM. Threadripper 3970, Gigabyte Aorus TRX40 extreme motherboard. GTX1080 as the gaming GPU, AMD RX550 for the linux VM. I've been fighting with Hyper-V, then Xen for the last couple of weeks before stumbling across Unraid and it's so close to working but not quite!
So the windows VM is good, the 1080 gets passed through and performance seems fine.
With the Linux VM though, it fails early on in the install (tried Ubuntu 18.04 and 19.10 so far) . I get the GRUB boot menu, but as soon as I select an option and it tries to switch to a better resolution the screen either goes back or gets weird dots and lines painted at random places. The behavior is the same whether I pass through the AMD card, or stop the windows VM and pass through the nvida GPU. It works fine if I use a VNC display. I tried passing a video ROM that I found online but that didn't make any difference. I'm using the UEFI virtual BIOS, I wanted to try using legacy mode but there doesn't seem to be an option to switch in the VM config. I've googled endlessly and am running out of ideas, so any help would be appreciated; I am more than happy to pay for Unraid if I can make this work!
All the best,
Phil