NVIDIA GPU passthrough - confusing IOMMU group


Recommended Posts

Hello, Im new to unraid. 

 

First first target is passthough my nv rtx 2070 to WIn and Ubuntu(Only one system will be run at the same time).

 

My origional IOMMU group showns as imageproxy.php?img=&key=e5eec7c5c933ca16:

IMMOU.thumb.png.c14390041db7af59cc9139bd8666f2c1.png

 

Basied on my understanding from youtube videos below, my IOMMU group 1 may not look right, so I switch to PCIe ACS override-downstream and got IOMMU group 12 which looks right to me.

IOMMU_downstream.thumb.png.5dcbf6bb56c5ebfbd4b93a97b62a9747.png

 

Then I got error:

imageproxy.php?img=&key=e5eec7c5c933ca16Error.thumb.png.e76b7e8553239496c78e08b9b58a1477.png

 

Afterwards, I update my Unraid OS to the following :

kernel /bzimage
append pcie_acs_override=downstream initrd=/bzroot vfio-pci.ids=10de:1ada,10de:1adb

The error goes away. 

I also tried set PCIe ACS override to Both without vfio-pci update:

IOMMU-Both.thumb.png.65bd93a5d82e92cde40b7d373139cdb6.png

 

But Im still having black screen.

 

 

The rom Im using right now is extract from GPU-Z

I also tried remove header by myself 

The only line I can find from rom that starting with 'u' is line 107. So I removed the line 1-106

rom.thumb.png.696e025e02d1edc4aef2284a359adcb4.png

 

 

However, NONE of my attempts works.

I would appriacate for any suggestion and help 

 

My Win 10 config:

win10.thumb.png.4dfff4516cce406bd28e17a932d261d3.png

 

 

 

Link to comment
2 hours ago, RickD00 said:

Basied on my understanding from youtube videos below, my IOMMU group 1 may not look right, so I switch to PCIe ACS override-downstream and got IOMMU group 12 which looks right to me.

IOMMU_downstream.thumb.png.5dcbf6bb56c5ebfbd4b93a97b62a9747.png

 

 

Hello, you were close when you got the Group 12 that I quoted from your post HOWEVER you were trying to only passthrough your RTX 2070s usb-c controller.

 

vfio-pci.ids=10de:1ada,10de:1adb are your USB 3.1 controller and serial bus on your 2070. You need to be passing through the VGA Controller @ 10de:1f02 and your GPUs audio @ 10de:10f9. Also you must passthrough everything in group 12 including the RTX USB-C controller you were trying to passthrough before.

 

Your vfio-pci.ids should look like this...

vfio-pci.ids=10de:1f02,10de:10f9,10de:1ada,10de:1adb

 

Once you do that make sure you select everything listed in Group 12 to passthrough in Unraid VM Win10 config PCI Devices.

 

Hope this helps.

Cheers!

Link to comment
4 minutes ago, RickD00 said:

OVMF does not work somehow.. I tried it with VNC it was on UEFI Shell window. SeaBIOS worked with VNC.

I just tried both OVMF/SeaBIOS with Q35.

Still no luck 

1087847029_win104.thumb.png.5545b4150d377278028f24a843a192c4.png

If it was on a UEFI shell window then it couldn't find a boot device. You need to set the Install ISO as boot device in boot order.

Link to comment
13 minutes ago, Carbongrip said:

If it was on a UEFI shell window then it couldn't find a boot device. You need to set the Install ISO as boot device in boot order.

That make sense! It should load ISO first.

 

But I more concerned about black screen :( 

Do you have any suggestion on this?

 

Thanks! 

Link to comment
On 4/27/2020 at 5:52 AM, RickD00 said:

I tried it with VNC it was on UEFI Shell window

Type "exit" in the UEFI shell window and "continue" in the BIOS that opens. VM reboots and now you should see the the hint to "press any button to boot from the install media". Keep in mind this hint only shows a couple seconds and without pressing any button you will end in the UEFI shell again. Starting a VM and not quickly enough connecting with VNC you will miss this part. Also your boot order might be wrong. Post the xml of the VM.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.