Jump to content
Friis

Fatal1ty x399 pro graming - 6.4.1 - IOMMU grouping problem

21 posts in this topic Last Reply

Recommended Posts

Hi

 

I am new at using Unraid and got into a few problem with IOMMU groupings.
My main problem is group 13 where all my different network controllers are located, wish I could split them up.

Other thing is my USB controllers in group 15 and 27 that are with other things that by name I have no idea what is. I would like to be able to passthrough USB controllers aswell.

I have tried turning ACS on and off, but the groups are equally bad. Should I try different rc versions to see if it gets fixed? or wait for an update with fix?

(running latest version of "BIOS" for this motherboard)

ID on the Gigabit Network controllers are the same, makes it hard to passthrough just one

 

ACS Overwrite on:

 

Quote


 
IOMMU group 0: [1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 1: [1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 2: [1022:1453] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 3: [1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 4: [1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 5: [1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 6: [1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 7: [1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 8: [1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 9: [1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 10: [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
  [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
 
IOMMU group 11: [1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
  [1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
  [1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
  [1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
  [1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
  [1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
  [1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
  [1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
 
IOMMU group 12: [1022:1460] 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
  [1022:1461] 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
  [1022:1462] 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
  [1022:1463] 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
  [1022:1464] 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
  [1022:1465] 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
  [1022:1466] 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
  [1022:1467] 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
 
IOMMU group 13: [1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02)
  [1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02)
  [1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02)
  [1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
  [1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
  [1022:43b4] 02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
  [1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
  [1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
  [1d6a:d107] 03:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02)
  [8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
  [8086:24fb] 05:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3168NGW [Stone Peak] (rev 10)
  [8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
 
IOMMU group 14: [144d:a804] 08:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961
 
IOMMU group 15: [1022:145a] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
  [1022:1456] 09:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
  [1022:145c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
 
IOMMU group 16: [1022:1455] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
  [1022:7901] 0a:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
  [1022:1457] 0a:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller
 
IOMMU group 17: [1022:1452] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 18: [1022:1452] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 19: [1022:1452] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 20: [1022:1453] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 21: [1022:1452] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 22: [1022:1452] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 23: [1022:1454] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 24: [1022:1452] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 25: [1022:1454] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 26: [10de:11c0] 41:00.0 VGA compatible controller: NVIDIA Corporation GK106 [GeForce GTX 660] (rev a1)
  [10de:0e0b] 41:00.1 Audio device: NVIDIA Corporation GK106 HDMI Audio Controller (rev a1)
 
IOMMU group 27: [1022:145a] 42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
  [1022:1456] 42:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
  [1022:145c] 42:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
 
IOMMU group 28: [1022:1455] 43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
  [1022:7901] 43:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

 

Not that important, I noticed different SATA controllers group 13, 16, 28. Is it possible to see what disks are on what controller If I wanted to passthrough one without accidently passing through disks Unraid is using (My case got a top mount SATA dock)

 

 

Share this post


Link to post

@Friis -

 

unRAID does not control the IOMMU groupings. That is related to the chipset and BIOS.

 

Looks like your IOMMU grouping are good for the GPU passthrough.

 

I have had some luck with USB passthrough. It is not always easy.

 

On my new motherboard (ASROCK OC Formula), the BIOS breaks out the controllers but the devices all appear on the same bus for all but one USB controller - the USB 3.1 controller. It has one "normal" type A connector. It seems to work for my keyboard/mouse, which is my primary need. But I am still getting it set up and have not done longer term testing yet. Disappointing because the MB has 3 USB2 controllers - and that was one of the reasons I bought it - thinking I could pass through 2 of them, and keep one for unRAID.

 

On my prior motherboard (ASROCK Rack - don't have the model number handy) all of them were combined on one bus, but disabling USB3 completely in BIOS helped (sounds drastic, but for me it was far more important to pass through a USB2 device). Anyway, after disabling USB3, the USB2 devices were nicely separated and passed through. I have read that tweaking BIOS settings can help in this regard. I tried for my new motherboard but had no luck (there was no "disable USB3" option).

 

I find it helpful to install USB devices into the different USB ports, and follow the instructions in the SpaceInvader One video:

 

I have never tried to pass through a network controller so can't help there.

Share this post


Link to post

Thanks

 

Good to know that the USB controllers will work.
I will try and see if I can tweak some things in the BIOS to somehow clear the network controllers.
I have been using SpaceInvader One's Tutorial when learning about unraid. But I didn't see him get such a troublesome IOMMU Group as my Group 13 and fix it.
Anyways, off to the BIOS settings.

Share this post


Link to post
1 hour ago, Friis said:

Thanks

 

Good to know that the USB controllers will work.
I will try and see if I can tweak some things in the BIOS to somehow clear the network controllers.
I have been using SpaceInvader One's Tutorial when learning about unraid. But I didn't see him get such a troublesome IOMMU Group as my Group 13 and fix it.
Anyways, off to the BIOS settings.

 

I didn't say the USB controllers would work. :) You need to add the USB sticks and follow the tutorial to find out.

Share this post


Link to post

when I passed through my IOMMU group 15, I wondered why my UNRAID had problems, I had it on group 27. Now I realise that group 15 and 27 has same ID numbers (can this be fixed somehow?). I put the USB to group 13 and passing works, mostly :D.

I also passed through my graphic card, which makes some unwanted white pixels in a wierd pattern of 3 (mouse over icon, mouse away from icon, mouse over icon (appear) mouse away from icon (disapear), mouse over icon, mouse away from icon (apear)... and sometimes its just fixes itself and I can't repeat it (its the same set of pixels).
I will continue with more tests, next up is group 13 (afraid of the SATA controller that also is within the group)

Share this post


Link to post

Sorry - you don't pass through IOMMU groups. The IOMMU groups determine if the passthrough will work.

 

Related to your GPU pass through, I have not experienced the issue you mention with white pixels. It may be something with the video card drivers (I'd make sure running latest Nvidia drivers). Could also have to do with USB passthrough I suppose. If drivers are up to date I would ignore it for now. Once everything is passed through, and if it continues, then focus on that.

 

Sorry don't know what you mean by "group" 15 and 27 have same ID numbers. If you follow the tutorial above, post the results of the queries, including the one that shows "RESET" statuses, and I'll have a look and may be be able to understand what you are talking about. You really need USB devices to be installed for it to be useful. You also need to remove the "vfio-pci.ids=" from the syslinux.cfg file before running the commands.

Share this post


Link to post

1022:145c is the same ID for USB controller in IOMMU group 15 and 27

 

This one worked for getting the USB controller for my Win10 vm
vfio-pci.ids=1022:145a,1022:1456,1022:145c

(only passing some will give error when starting the vm, sooo... you unassign entire iommu groups but then passthrough one or more things the iommu group contain)

 

I attempted to do:

vfio-pci.ids=1022:43ba,1022:43b6,1022:43b1,1022:43b4,1d6a:d107,8086:1539,8086:24fb
For the other group, ending up loosing my SATA disks when booted up. Hoped they were on one of the other SATA controllers :(

Share this post


Link to post

Have you considered using the ACS override function?

label unRAID OS (ACS)
  kernel /bzimage
  append pcie_acs_override=downstream,multifunction initrd=/bzroot

Put this in your syslinux.cfg and boot unRAID with this option and it should break up your devices into more/individual IOMMU groups.

Share this post


Link to post
On 14/03/2018 at 9:48 PM, Friis said:

Thanks

 

The multifunction did the trick.

 

So you were able to pass WHICH USB controllers from your list through to VMs? Not devices, controllers? I'm curious to see if any worked...

Share this post


Link to post

The controllers with the ID: 1022:145c (passed through)(15 and 27)

right now I am only using one of the controllers. If I need another "gaming" vm, it can have the other one.

the last controller with ID: 1022:43ba (not passed through)(13)

has USB 3.1 and 2.0 under it (flash drive in 2.0) 3.1 free for when I need direct input control in unraid gui.

Share this post


Link to post

Thanks, that's REALLY useful info for me as I haven't found other X399 boards which have USB controllers in separate groups. You can pass through 2 separate controllers and have the Unraid stick and a KB and Mouse etc on the remaining controller... I might have to buy this board then.... ;-)

 

Everything working fine now? 

 

Could you also share what devices you have plugged into PCIE slots (looks like its ONLY a GTX660 and a M2 when I would have every single slot in use!) AND what you actually now use for your unraid boot options (the full flash config not just the bit you were given)

label unRAID OS (ACS)
  kernel /bzimage
  append pcie_acs_override=downstream,multifunction initrd=/bzroot

Share this post


Link to post

My boot option is:

label unRAID OS
  menu default
  kernel /bzimage
  append pcie_acs_override=downstream,multifunction vfio-pci.ids=8086:24fb,8086:1539,1022:145c initrd=/bzroot

It is for my Gigabit ethernet controllers (2x RJ45), my Wifi controller and USB controllers (what I can tell the 4 USB by the ethernets on the back are one controller, the 4 around the wifi antenna is another controller, the USB 3.1 next to the Type C is the controller I haven't passed through)

 

 

A slight problem for perfect control is that pfsense doesn't have drivers for the last 10GBethernet or my wifi. So I cannot set things up 100% like I hoped for.

the 2 ethernet controllers have the same ID, so when "vfio-pci.ids=8086:24fb" both of them is taken out. So you can't assign one for unraid and another for a VM.

My plan was to have 10GBethernet as WAN side of pfsense, the other ports as LAN, a wifi secured by pfsense. the 2 Gigabit ethernets run link aggregation to a switch for a bit more speed there.

 

(later I noticed I wanted to add another function, My case got a SATA dock on top, It would be nice to passthrough that SATA to VM (might be able to do that with an unassigned devices plugin), I have 3 SATA controllers, so if I could passthrough the correct port, I could have the top dock function differently. (I don't know the functional difference between unassigned devices and SATA controller passthrough)

 

 

I don't have much PCIe devices (changed the GTX660 with a GTX1080ti) - modified the rom so I don't need 2 graphic cards (no need for one dedicated for unraid)

If I needed another gaming computer, I could buy another graphic card and set in.

What do you plan to set in all those PCIe slots? (this part should function as normal passthrough if needed)

 

 

Here is an update on the IOMMU groups:

 

Quote


 
IOMMU group 0: [1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 1: [1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 2: [1022:1453] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 3: [1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 4: [1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 5: [1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 6: [1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 7: [1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 8: [1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 9: [1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 10: [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
  [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
 
IOMMU group 11: [1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
  [1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
  [1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
  [1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
  [1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
  [1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
  [1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
  [1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
 
IOMMU group 12: [1022:1460] 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
  [1022:1461] 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
  [1022:1462] 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
  [1022:1463] 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
  [1022:1464] 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
  [1022:1465] 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
  [1022:1466] 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
  [1022:1467] 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
 
IOMMU group 13: [1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02)
 
IOMMU group 14: [1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02)
 
IOMMU group 15: [1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02)
 
IOMMU group 16: [1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
 
IOMMU group 17: [1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
 
IOMMU group 18: [1022:43b4] 02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
 
IOMMU group 19: [1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
 
IOMMU group 20: [1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
 
IOMMU group 21: [1d6a:d107] 03:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02)
 
IOMMU group 22: [8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
 
IOMMU group 23: [8086:24fb] 05:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3168NGW [Stone Peak] (rev 10)
 
IOMMU group 24: [8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
 
IOMMU group 25: [144d:a804] 08:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961
 
IOMMU group 26: [1022:145a] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
 
IOMMU group 27: [1022:1456] 09:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
 
IOMMU group 28: [1022:145c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
 
IOMMU group 29: [1022:1455] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
 
IOMMU group 30: [1022:7901] 0a:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
 
IOMMU group 31: [1022:1457] 0a:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller
 
IOMMU group 32: [1022:1452] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 33: [1022:1452] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 34: [1022:1452] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 35: [1022:1453] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
 
IOMMU group 36: [1022:1452] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 37: [1022:1452] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 38: [1022:1454] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 39: [1022:1452] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
 
IOMMU group 40: [1022:1454] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
 
IOMMU group 41: [10de:1b06] 41:00.0 VGA compatible controller: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] (rev a1)
 
IOMMU group 42: [10de:10ef] 41:00.1 Audio device: NVIDIA Corporation GP102 HDMI Audio Controller (rev a1)
 
IOMMU group 43: [1022:145a] 42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
 
IOMMU group 44: [1022:1456] 42:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
 
IOMMU group 45: [1022:145c] 42:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
 
IOMMU group 46: [1022:1455] 43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
 
IOMMU group 47: [1022:7901] 43:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

 

 

 

 

 

Share this post


Link to post

IOMMU group 13: [1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02)
IOMMU group 28: [1022:145c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 45: [1022:145c] 42:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller

 

Thats interesting with ACS patch on. You need one USB controller for unRAID so you have to use the 3.1 one as if you stub the 1022.145c one you stub BOTH the controllers in groups 28 and 45....  Good to know this board then has at least 2 passable USB3 controllers. 

 

I've never seen a SATA controller split like that.. I wonder if its not a port split but a u.2 and SATA split? I am guessing there!

 

So is it STABLE now with the ACS patch and Multifunction line on?

Share this post


Link to post

Yeah the SATA split would be logical if its a u.2 - SATA split... since I have 3,  I guess the last is M.2 SATA function. (But all guesses and not planning to test and confirm as I have no u.2 or plans on running my NVME in SATA mode)

 

The only unstability I have noticed is that sometimes my 10GBethernet doesn't get registered on boot. (a few restarts and it somehow gets back - Later I plan on have unraid on 24/7, so it is not a problem for me).

Else I haven't noticed any issues.

Share this post


Link to post

Heh - So I said, had 2 problems shortly after:

1) my virtual machine with pfsense suddenly stopped working, it disappeared under unraid VMs. Had to restart unraid to get it to work again.

2) Gaming VM froze while playing Elite Dangerous. Can't tell if this is caused by unraid unstability or just buggy.

Share this post


Link to post

@Friis   Have you tried (or could you) passing the AMD USB 3.1 controller to a VM?

 

See https://lime-technology.com/forums/topic/71713-passthrough-a-usb-31-controller-on-amd-board/   -  I suspect issues!   I need to get others to see if they CAN pass a 3.1 controller.... before I revert to LT!

Share this post


Link to post

I have not tried passing the 3.1 - the controller seem to have the 2.0 in it. And I have unraid usb on a 2.0 port.

 

I can attempt passing the 3.1 when I have the time.

Share this post


Link to post
14 minutes ago, Friis said:

I have not tried passing the 3.1 - the controller seem to have the 2.0 in it. And I have unraid usb on a 2.0 port.

 

I can attempt passing the 3.1 when I have the time.

 

Please, that would be really helpful... so I can see if it is only me who cannot pass a 3.1 controller..

Share this post


Link to post

I am currently running my stuff through a USB hub which is connected to the USB 3.1.
I have no issues so far.

When I changed the passthrough ID from 1022:145c to 1022:43ba, I did run into the suspected problem, had to change the port of which the Unraid USB was connected to.

Then I went in and changed settings in my VM, selected the 3.1 for passthrough and saved the changes.( Updated the xml to include my .rom for the graphic card)
Started the VM and everything is fine.

 

label unRAID OS
  menu default
  kernel /bzimage
  append pcie_acs_override=downstream,multifunction vfio-pci.ids=1022:43ba initrd=/bzroot

what problem are you experiencing?

Share this post


Link to post
1 hour ago, Friis said:

I am currently running my stuff through a USB hub which is connected to the USB 3.1.
I have no issues so far.

When I changed the passthrough ID from 1022:145c to 1022:43ba, I did run into the suspected problem, had to change the port of which the Unraid USB was connected to.

Then I went in and changed settings in my VM, selected the 3.1 for passthrough and saved the changes.( Updated the xml to include my .rom for the graphic card)
Started the VM and everything is fine.

 


label unRAID OS
  menu default
  kernel /bzimage
  append pcie_acs_override=downstream,multifunction vfio-pci.ids=1022:43ba initrd=/bzroot

what problem are you experiencing?

 

Having regular connect/disconnects when I attach my cable that goes to my KVM (mouse,keyboard,USB port on switch). If yours works fine then it may be a specific issue to the Asus X399-A Prime that @Jcloud and I have. I am in touch with Asus support to find out which controllers relate to two other "unknown" headers on our boards so will ask them to look into this issue also....     Thanks for testing for us! ?

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.