GPU Passthrough - Blank Screen

[Advin]

Hello,

I purchased a 3090 Founders Edition card, however, I am having trouble getting it work via GPU Passthrough to a VM.

 

I get a blank screen with OVMF and i440fx. With i440fx and Seabios, I was able to get the Ubuntu + Pop!OS installer to boot up, but shortly after it starts the installer, I get weird artifacts and eventually the screen just turns black. I was also able to get the Windows installer to output a flashing underscore at the bottom of my screen with i440fx and Seabios too. Without the modified vbios or a vbios at all, nothing appeared. 

 

Attached is my syslinux config and vm config. I'm quite new to Unraid, but the last time I tried Unraid It was plug and play with my 2080 super. Not sure why my 3090 is giving me difficulties. Attached are also my vbios's. One of them has the headers removed (hence _Modded) and one of them doesn't.  It was dumped via GPU-Z on Windows. 

 

Here is my full hardware:

RTX 3090 FE

i9-9900K

2x16GB ram + 2x32GB ram (96GB total)

MSI Z390 Pro Carbon

 

Running in UEFI mode

 

IOMMU Groups:

IOMMU group 0: [8086:3e30] 00:00.0 Host bridge: Intel Corporation 8th Gen Core 8-core Desktop Processor Host Bridge/DRAM Registers [Coffee Lake S] (rev 0d)

IOMMU group 1: [8086:1901] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 0d)

IOMMU group 2: [8086:1911] 00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model

IOMMU group 3: [8086:a379] 00:12.0 Signal processing controller: Intel Corporation Cannon Lake PCH Thermal Controller (rev 10)

IOMMU group 4 (multiple):

[8086:a36d] 00:14.0 USB controller: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller (rev 10)

[8086:a36f] 00:14.2 RAM memory: Intel Corporation Cannon Lake PCH Shared SRAM (rev 10)

IOMMU group 5 :[8086:a360] 00:16.0 Communication controller: Intel Corporation Cannon Lake PCH HECI Controller (rev 10)

IOMMU group 6: [8086:a352] 00:17.0 SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)

IOMMU group 7: [8086:a338] 00:1c.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #1 (rev f0)

IOMMU group 8: [8086:a33e] 00:1c.6 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #7 (rev f0)

IOMMU group 9: [8086:a330] 00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #9 (rev f0)

IOMMU group 10 (multiple):

[8086:a305] 00:1f.0 ISA bridge: Intel Corporation Z390 Chipset LPC/eSPI Controller (rev 10)

[8086:a348] 00:1f.3 Audio device: Intel Corporation Cannon Lake PCH cAVS (rev 10)

[8086:a323] 00:1f.4 SMBus: Intel Corporation Cannon Lake PCH SMBus Controller (rev 10)

[8086:a324] 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake PCH SPI Controller (rev 10)

[8086:15bc] 00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (7) I219-V (rev 10)

IOMMU group 11: [10de:2204] 01:00.0 VGA compatible controller: NVIDIA Corporation Device 2204 (rev a1)

IOMMU group 12: [10de:1aef] 01:00.1 Audio device: NVIDIA Corporation Device 1aef (rev a1)

IOMMU group 13: [8086:24fd] 03:00.0 Network controller: Intel Corporation Wireless 8265 / 8275 (rev 78)

IOMMU group 14: [126f:2263] 04:00.0 Non-Volatile memory controller: Silicon Motion, Inc. Device 2263 (rev 03)

 

USB Devices:

Bus 001 Device 001:ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 001 Device 002:ID 1b1c:1b2d Corsair Corsair Gaming K95 RGB PLATINUM Keyboard

Bus 001 Device 003:ID 1462:7b17 Micro Star International MYSTIC LIGHT

Bus 001 Device 004:ID 046d:c539 Logitech, Inc. USB Receiver

Bus 001 Device 005:ID 0781:5530 SanDisk Corp. Cruzer

Bus 001 Device 006:ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 001 Device 007:ID 8087:0a2b Intel Corp.

Bus 001 Device 008:ID 1b1c:0c22 Corsair

Bus 002 Device 001:ID 1d6b:0003 Linux Foundation 3.0 root hub

 

SCSI Devices:

[0:0:0:0]disk SanDisk Cruzer 1.00 /dev/sda 30.7GB

[1:0:0:0]disk ATA TOSHIBA DT01ACA1 A8K0 /dev/sdb 1.00TB

[2:0:0:0]disk ATA ST2000DX002-2DV1 CC41 /dev/sdc 2.00TB

[4:0:0:0]disk ATA Samsung SSD 860 3B6Q /dev/sdd 1.00TB

[5:0:0:0]disk ATA Netac SSD 500GB 1A0 /dev/sde 500GB

[N:0:1:1]disk Netac NVMe SSD 500GB__1 /dev/nvme0n1 500GB

Netac NVMe is formatted as NTFS and is not being used in my Unraid setup.

 

Please let me know if you need more information or you want me to try something.

 

Thanks!

 

syslinux.txt vm.txt GA102_Modded.rom GA102.rom

[Juxsta]

I'm also trying to get my 3090 working. I was able to get the gpu to output by booting from storage rather than uefi. You can select the non UEFI USB from your boot menu and try it from there. However, after this I end up running into issues with error 43 on the gpu and I can't get the proper drivers installed.

[Advin]

20 hours ago, Juxsta said:

I'm also trying to get my 3090 working. I was able to get the gpu to output by booting from storage rather than uefi. You can select the non UEFI USB from your boot menu and try it from there. However, after this I end up running into issues with error 43 on the gpu and I can't get the proper drivers installed. Do you have a founders edition?

Install drivers via VNC first and then switch to the GPU. Could fix it. Legacy boot for some reason won't work, it says that it's not a boot media and asks me to insert one. 

Edited December 4, 2020 by Advin

[Juxsta]

After referencing some other guides it seems that its only meant to boot from UEFI so you may be doing it right. I will try again using UEFI and will let u know if I can get it working. It’d be a shame to let these shiny new cards sit for any longer

[Juxsta]

@Advin No I don’t have a founder’s edition. I made my own post regarding this topic as well. 

https://forums.unraid.net/topic/99697-rtx-3090-passthrough-with-windows-10-vm/?tab=comments#comment-919774

 

Edited December 5, 2020 by Juxsta

[Juxsta]

I've tried starting the vm with just vnc and getting the drivers in. Booted the vm back up with the 3090 and received error 43. 

 

Also tried booting with vnc and the 3090 which actually reports no errors, but there isn't any output on the 3090 this way. I installed the geforce driver's anyway but on reboot with just the graphics card I continued to recieve errors. 

 

I also tried booting with UEFI but I can't seem to get the card to output anything with this. 

 

still no luck  

[gray squirrel]

Have you dumped your own VBIOS using this guide? I noticed from your XML that your have named your vbios “***modded” so I guess you have downloaded it or dumped via GPU-Z then edited the header.

 

I could never get this to work with my GPU. You need another GPU to do this but for me it worked first time.

 

i would also try and use the GPU as the secondary and pass it without a Vbios fist to check all is good.

 

 

 

 

 

 

 

 

[Advin]

21 hours ago, gray squirrel said:

Have you dumped your own VBIOS using this guide? I noticed from your XML that your have named your vbios “***modded” so I guess you have downloaded it or dumped via GPU-Z then edited the header.

 

I could never get this to work with my GPU. You need another GPU to do this but for me it worked first time.

 

i would also try and use the GPU as the secondary and pass it without a Vbios fist to check all is good.

 

 

 

 

 

 

 

 

If you read my post, I said that I dumped it via GPU-Z and modified the headers. I will check out the guide, and yes I do have a secondary GPU which is the one built into my 9900K.

[gray squirrel]

If you have a I-GPU that you keep enabled. Do you even need to pass a VBIOS? I though you only need this if it was your primary GPU.

 

you will need to set the I-GPU as your primary GPU in the BIOS.

Edited December 6, 2020 by gray squirrel

[Juxsta]

@Advin How's this going? I'm still working on getting my card enabled and looking for some pointers in case you got the card passed through correctly