[Plugin] VFIO-PCI Config


Skitals

Recommended Posts

1 hour ago, aikin said:

 

I have tried swapping the positions of the two graphics cards. then rtx 1063 can't select. It's my motherboard cause ? and is my motherboard not support? 

image.thumb.png.93d3dc41d8b0ef89710147ad35d81e6e.png

The issue you have is that the 2.5Gb NIC is in the same IOMMU group and all devices in that group would need to be passed through.

 

Do you have you tired PCIe acs override settings in the VM settings, This may allow the graphics card to show in its own IOMMU Group.

Link to comment
3 hours ago, SimonF said:

‎您遇到的问题是 2.5Gb 网卡位于同一 IOMMU 组中,并且该组中的所有设备都需要通过。‎

 

‎您是否在VM设置中具有疲惫的PCIe acs覆盖设置,这可能会允许图形卡在其自己的IOMMU组中显示。‎

 

yeah, i have a try, something is going on. 
 

image.thumb.png.b228e3ce8d63111a0fc18f903f1acf2e.png
 

image.thumb.png.ee45575e64e69ef9c83868f61e048ee6.png
 

but still can not select... and i have try    vifo-pci.ids=1002:67ef,1002:aae0,10ec:8215 but i lost my network in unraid when i restart the machine.

it looks like the  2.5Gb NIC and rx560 can not separate. so sad. is this mean i can't use this motherboard to do that ? if true, Can you give me some choice of motherboard model to do this?  Thank you very much for your help! 

image.png

Edited by aikin
du
Link to comment
1 hour ago, aikin said:

 

image.thumb.png.b228e3ce8d63111a0fc18f903f1acf2e.png

Sorry cannot see this.

 

I would remove the lines from the append as you can do by ticking the boxes in system devices and this plugin is no longer needed.

 

But does sound like your motherboard may not be able to separate the NIC and card in that slot.

 

Did you try both optuins for PCIe ACS Override?

 

image.thumb.png.ebfddb90002b434229873cd022744aa0.png

Link to comment
11 hours ago, SimonF said:

Sorry cannot see this.

 

I would remove the lines from the append as you can do by ticking the boxes in system devices and this plugin is no longer needed.

 

But does sound like your motherboard may not be able to separate the NIC and card in that slot.

 

Did you try both optuins for PCIe ACS Override?

 

image.thumb.png.ebfddb90002b434229873cd022744aa0.png

 

Yeah, I had to select the both option and it will change the unraid os options to here, then  i add vfio-pci.ids options. but still not work. 

 

image.thumb.png.c00968c1b698ee68bc4036e0ba5300c7.png

Link to comment
  • 3 months later...

Good day.
on begining we have info
 

Quote

The plugin is included in 6.9 beta22+ and should not be installed in those versions


So where it is i newer versions? 
Ofc found this plugin by @SpaceInvaderOne. Trying to assign ssd's without copying text in xml what I did before and spent way too much time on it...
Plugin still working well, after reboot it dissapearing and leaving error.

Regards
L.

Link to comment
14 minutes ago, lakimakromedia said:

Good day.
on begining we have info
 


So where it is i newer versions? 
Ofc found this plugin by @SpaceInvaderOne. Trying to assign ssd's without copying text in xml what I did before and spent way too much time on it...
Plugin still working well, after reboot it dissapearing and leaving error.

Regards
L.

Tools - system devices

Link to comment
  • 1 month later...

I'm new to Linux / UnRaid.

 

I would like to pass through my motherboard's audio to VM's. However, I'm unable to select the IOMMU group that has the audio device in it. I've tried setting my PCIe ACS Override setting to all 4 options (Disabled, Downstream Multi-function Both). Rebooting after each change. None of the settings changes the IOMMU groups. I have an ASUSTeK COMPUTER INC. PRIME B560M-A motherboard with an 11th gen i5-11600K CPU. I'm also on UnRaid v6.11.1.

 

image.thumb.png.1a14854810b0da36d9e04a5dfb6d806b.png

 

Any assistance would be greatly appreciated.

  • Like 1
Link to comment
  • 3 weeks later...
On 11/5/2022 at 12:14 AM, Jeff Trusty said:

I'm new to Linux / UnRaid.

 

I would like to pass through my motherboard's audio to VM's. However, I'm unable to select the IOMMU group that has the audio device in it. I've tried setting my PCIe ACS Override setting to all 4 options (Disabled, Downstream Multi-function Both). Rebooting after each change. None of the settings changes the IOMMU groups. I have an ASUSTeK COMPUTER INC. PRIME B560M-A motherboard with an 11th gen i5-11600K CPU. I'm also on UnRaid v6.11.1.

 

image.thumb.png.1a14854810b0da36d9e04a5dfb6d806b.png

 

Any assistance would be greatly appreciated.

I had the exactly same issue and solved a few days ago.  All the devices in IOMMU group 10 should  be listed in syslinux configuration such as
 

Quote

vfio-pci.ids=8086:4387,8086:43c8,8086:43a3,8086:43a4,8086:15fa


Here is mine:
image.thumb.png.6c542493f30fa1f9d7349b8a1e6adc9d.png

Once rebooting, the check box from System Devices will be enabled and you can select
image.thumb.png.b6b2cb9630ff56e24994c3b6b9dd7cee.png

 

Though Fix Common Problems plugin reports it as a warning, I think it is OK to ignore for now.image.thumb.png.aa053606e4e036eb2744efa60ea96729.png

 

I think there must be an elegant way to do it without warning, but I cannot come up with a solution now.
 

Edited by Half Broken Robot
Link to comment
  • 2 months later...
On 1/15/2020 at 11:22 PM, Skitals said:

It now shows USB devices attached to each controller. If a USB controller is bound to vfio, the USB devices will not be visible.

screenshot.png

 

Hello, I would like to understand what this means in other words? I don't know if you can help me with my case.

I have two GPUs (TUF-GTX1660S), and in SysDevs this appears, my Motherboard is b550 Vision D

 

image.thumb.png.d14ce310e3a060dfaf40819d2ec424ce.png

 

image.png.6b0ad5ebccc626ea7169563fd9600244.png

 

image.thumb.png.95eeb610f5258356f3fc7925c074dc5f.png

 

My GPU does not have any USB c or USB 3.1 port

 

363310336_GPUGTX.jpg.c436a5bae9a0cdebda48ce7fbd2db4a7.jpg

 

My Motherboard does have a usb c port and usb 3.1 ports

 

1431715401_visiond.png.b653951b2bc44ad5014b1418aa47cbfe.png

 

The first question is because this text appears "This controller is linked to vfio, the connected USB devices are not seen", this means that if I managed to connect a usb, and if I have made a passthrough from the GPU to the VM, the usb will it connect directly to the VM and not be seen on the Unraid server?

 

The second question is, because my GPU indicates that it has a USB 3.1 and USB c controller, if it does not have any physical port, is there an adapter to convert HDMI to USB?

https://www.amazon.com/Adapter-Converter-Thunderbolt-MacBook-Microsoft/dp/B08VDT3YGK

 

https://www.amazon.com/ELUTENG-Thunderbolt-Compatible-Converter-Connector/dp/B07Z4G911X

 

 

 

 

Link to comment
5 hours ago, JhonScript said:

 

Hello, I would like to understand what this means in other words? I don't know if you can help me with my case.

I have two GPUs (TUF-GTX1660S), and in SysDevs this appears, my Motherboard is b550 Vision D

 

image.thumb.png.d14ce310e3a060dfaf40819d2ec424ce.png

 

image.png.6b0ad5ebccc626ea7169563fd9600244.png

 

image.thumb.png.95eeb610f5258356f3fc7925c074dc5f.png

 

My GPU does not have any USB c or USB 3.1 port

 

363310336_GPUGTX.jpg.c436a5bae9a0cdebda48ce7fbd2db4a7.jpg

 

My Motherboard does have a usb c port and usb 3.1 ports

 

1431715401_visiond.png.b653951b2bc44ad5014b1418aa47cbfe.png

 

The first question is because this text appears "This controller is linked to vfio, the connected USB devices are not seen", this means that if I managed to connect a usb, and if I have made a passthrough from the GPU to the VM, the usb will it connect directly to the VM and not be seen on the Unraid server?

 

The second question is, because my GPU indicates that it has a USB 3.1 and USB c controller, if it does not have any physical port, is there an adapter to convert HDMI to USB?

https://www.amazon.com/Adapter-Converter-Thunderbolt-MacBook-Microsoft/dp/B08VDT3YGK

 

https://www.amazon.com/ELUTENG-Thunderbolt-Compatible-Converter-Connector/dp/B07Z4G911X

 

 

 

 

 

Yes, your gpu has a usb controller but no port. Some gpus have usb-c for vr and other uses. There is no adapter that will give you access to it. And yes, any devices connected to the controller would only be visible/usable inside a VM if the controller is bound to vfio-pci.

 

So unfortunately no way to make use of it. Best practice is still to passthrough all sub-devices together with multifunction on (54:00.0, 54:00.1, 54:00.2, 54:00.3 on the same bus, etc). Typically they would be in the same iommu group, what do your groups look like with acs overrides disabled?

Link to comment
  • 2 weeks later...
On 2/14/2023 at 4:13 PM, Skitals said:

So unfortunately no way to make use of it. Best practice is still to passthrough all sub-devices together with multifunction on (54:00.0, 54:00.1, 54:00.2, 54:00.3 on the same bus, etc). Typically they would be in the same iommu group, what do your groups look like with acs overrides disabled?

Hi this looks like this

image.png.567763f348fe926aa5e7f36481a947e6.png

 

image.thumb.png.3db3644a8f175d25088babd8a59615c3.png

Link to comment
  • 1 month later...
  • 2 months later...

I have a firewire pcie card i that want to use to capture video material from my old minidv camera. I can see the card in unraid under tools>system devices as shown below:

PCI Devices (No IOMMU Groups Available)


[8086:a330]	00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #9 (rev f0)
[8086:a304]	00:1f.0 ISA bridge: Intel Corporation H370 Chipset LPC/eSPI Controller (rev 10)
[8086:a348]	00:1f.3 Audio device: Intel Corporation Cannon Lake PCH cAVS (rev 10)
[8086:a323]	00:1f.4 SMBus: Intel Corporation Cannon Lake PCH SMBus Controller (rev 10)
[8086:a324]	00:1f.5 Serial bus controller: Intel Corporation Cannon Lake PCH SPI Controller (rev 10)
[8086:15bc]	00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (7) I219-V (rev 10)
[1106:3403]	01:00.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6315 Series Firewire Controller (rev 01)
[10ec:8168]	03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)
[c0a9:2263]	04:00.0 Non-Volatile memory controller: Micron/Crucial Technology P1 NVMe PCIe SSD (rev 03)

 

I thought with the latest revisions to unraid (im on 6.11.5) the vfio plugin is now sort of embedded in the unraid but when i go and try to edit my Windows10 Vm settings under 'Other devices I see 'none available'. Further more before I read last post in this thread I already manually installed the vfio plugin. I was expecting the list of pci devices to show up but only get this:

Zrzut-ekranu-2023-06-18-o-15-19-12.png

Is this normal?

 

And last thing, I tried to manually add a pci device into vm xml using '/hostdev mode' but once i try to run vm, the following error appears: "Execution error unsupported configuration: host doesn't support VFIO PCI passthrough". So my thinking now is maybe something is not even properly set up in my bios?

 

Would really use some steer here so I don't mess up things;) Thanks.

 

Link to comment
1 hour ago, nivepl said:

I have a firewire pcie card i that want to use to capture video material from my old minidv camera. I can see the card in unraid under tools>system devices as shown below:

PCI Devices (No IOMMU Groups Available)


[8086:a330]	00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #9 (rev f0)
[8086:a304]	00:1f.0 ISA bridge: Intel Corporation H370 Chipset LPC/eSPI Controller (rev 10)
[8086:a348]	00:1f.3 Audio device: Intel Corporation Cannon Lake PCH cAVS (rev 10)
[8086:a323]	00:1f.4 SMBus: Intel Corporation Cannon Lake PCH SMBus Controller (rev 10)
[8086:a324]	00:1f.5 Serial bus controller: Intel Corporation Cannon Lake PCH SPI Controller (rev 10)
[8086:15bc]	00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (7) I219-V (rev 10)
[1106:3403]	01:00.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6315 Series Firewire Controller (rev 01)
[10ec:8168]	03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)
[c0a9:2263]	04:00.0 Non-Volatile memory controller: Micron/Crucial Technology P1 NVMe PCIe SSD (rev 03)

 

I thought with the latest revisions to unraid (im on 6.11.5) the vfio plugin is now sort of embedded in the unraid but when i go and try to edit my Windows10 Vm settings under 'Other devices I see 'none available'. Further more before I read last post in this thread I already manually installed the vfio plugin. I was expecting the list of pci devices to show up but only get this:

Zrzut-ekranu-2023-06-18-o-15-19-12.png

Is this normal?

 

And last thing, I tried to manually add a pci device into vm xml using '/hostdev mode' but once i try to run vm, the following error appears: "Execution error unsupported configuration: host doesn't support VFIO PCI passthrough". So my thinking now is maybe something is not even properly set up in my bios?

 

Would really use some steer here so I don't mess up things;) Thanks.

 

You need to have VTd enabled in the bios. Does system info say it is enabled? Click on little monitor on menu bar right hand side.

Link to comment

Zrzut-ekranu-2023-06-18-o-18-01-21.png

Damn, I guess it's disabled then;(

Apart from enabling above, anything else I should check/change whilst in BIOS? I'm asking as it's a headless machine so if I am to connect an external monitor I want to make sure I don't need to do this again for a very long time😀 So probably 'Intel Virtualization Technology' and 'VT-d' options should be enabled. Anything else is on the unraid side?

 

Link to comment
27 minutes ago, nivepl said:

Zrzut-ekranu-2023-06-18-o-18-01-21.png

Damn, I guess it's disabled then;(

Apart from enabling above, anything else I should check/change whilst in BIOS? I'm asking as it's a headless machine so if I am to connect an external monitor I want to make sure I don't need to do this again for a very long time😀 So probably 'Intel Virtualization Technology' and 'VT-d' options should be enabled. Anything else is on the unraid side?

 

should be nothing else I would check fast boot is disabled as can create boot issues

Link to comment

Thank you so much for all the help. After a reset it finally showed up in Win10 VM. Im capturing my old tapes as we speak;)

I will probably remove the card after the capturing process and resell it as will have no use for it.

Before I do that is

a) untick the card in Win10 VM

b) unbound the card, and

c) restart unraid

d) turn off unraid

enough to remove the hardware from the computer? I don't want tto mess things up by removing the hardware that was configured to work with unraid. So confirmation to the above would be greatly appreciated.

Link to comment
3 minutes ago, nivepl said:

Thank you so much for all the help. After a reset it finally showed up in Win10 VM. Im capturing my old tapes as we speak;)

I will probably remove the card after the capturing process and resell it as will have no use for it.

Before I do that is

a) untick the card in Win10 VM

b) unbound the card, and

c) restart unraid

d) turn off unraid

enough to remove the hardware from the computer? I don't want tto mess things up by removing the hardware that was configured to work with unraid. So confirmation to the above would be greatly appreciated.

As long as you untick and unbound before powering off you will be ok. You don't need to do the restart before turning off.

  • Thanks 1
Link to comment
  • 9 months later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.