[Solved] Problems on Ryzen 5 with ASUS Prime B350 Plus


Recommended Posts

Hey guys,

 

my hardware is:

CPU: Ryzen 5 1600x
RAM: Corsair 24GB 2400MHz
MB: ASUS Prime B350 Plus
Gaming-GPU: Evga GeForce GTX 1080
Unraid-GPU: Zotax GeForce GT610 Synergy (passiv cooled)
Bios-settings: IOMMU On, SRV-io On, ACS Override Yes
Unraid: Current Stable 6.4.1 - Kernel 4.14

Im trying to virtualize my Windows10 for gaming with the GTX1080, as long as i run a single gpu setup, it works okay, but then i cant monitor my system on the console, because the 1600x has no igpu and unraid needs to have the first gpu in place. When i go for a dual gpu setup, which is what i really want, the first gpu (here the GT610) will be in iommu group 13 on its own, but the second slot with the gtx 1080 will be in group 12, with a load of other things like usb and ethernet (screenshot). I have even installed the new beta bios of asus, because i dont have a "set your primary gpu option" and i thought there must be something in there for the new 2200 and 2400 ryzen chips, but nothing :(.

 

I have tested a lot around this and read up on this a lot, which brings me to a few questions:

Is this even possible with my hardware?

Can i do something to make this happen?

Does anyone know for sure how the iommu groups look in a Asus Prime X370 Pro?

(Do you need more infos, i will gladly give you more)

IMG-20180310-WA0003.jpg

Edited by jammsen
Link to comment

@david279 You're the second person I've seen suggest this to jammsen (#2 in a different thread), sounds like a good thing to try, but I admit I'm having issues finding it.  Scouring forums oh such fun. ;)

 

Do you happen to have a reference link/URL handy since you seem familiar with the idea/fix?

 

 

Link to comment

Hey guys,

 

i replaced yesterday the mainboard, meaning the ASUS Prime B350 Plus with a ASUS Prime X370 PRO, with bios version 3803 and all ACS off.

Thats a increase of 70 euros but the iommu groups are really good and everything works good :)

Thanks for the tip with acs, i always thought there is just one pcie override mode, via the webui.

 

But while importing data, via usb3 from an external 1tb disk to the array, the windows10 vm started to lagging even on just playing youtube videos, that was weird.

I have choosen a full parity setup, no cache drive but 2 ssds in the array, while a WD Green energyeff.. disk takes the parities.

 

Disks:


[0:0:0:0]	disk JetFlash Transcend 16GB 1100 /dev/sda 15.7GB (Flash)
[1:0:0:0]	disk ATA CT240BX200SSD1 .6 /dev/sdb 240GB (Disk1)
[2:0:0:0]	disk ATA Samsung SSD 850 2B6Q /dev/sdc 512GB (Disk2)
[4:0:0:0]	disk ATA WDC WD20EZRX-00D 0A80 /dev/sdd 2.00TB (Parity)
[5:0:0:0]	disk ATA WDC WD1002FAEX-0 1D05 /dev/sde 1.00TB (Disk3)
[6:0:0:0]	disk ATA WDC WD1002FAEX-0 1D05 /dev/sdf 1.00TB (Disk4)

IOMMU (ASUS Prime X370 PRO, with bios version 3803 and all ACS off):

IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 3:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 5:	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1b21:1343] 06:00.0 USB controller: ASMedia Technology Inc. Device 1343
[8086:1539] 07:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 14:	[10de:104a] 09:00.0 VGA compatible controller: NVIDIA Corporation GF119 [GeForce GT 610] (rev a1)
[10de:0e08] 09:00.1 Audio device: NVIDIA Corporation GF119 HDMI Audio Controller (rev a1)
IOMMU group 15:	[10de:1b80] 0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
[10de:10f0] 0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 16:	[1022:145a] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 17:	[1022:1456] 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 18:	[1022:145c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 19:	[1022:1455] 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 20:	[1022:7901] 0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 21:	[1022:1457] 0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller

Here is a look at the benchmarking setup (please excuse the random stuff on my desk :D):

WhatsApp Image 2018-03-10 at 19.52.03.jpeg

Edited by jammsen
Link to comment
  • jammsen changed the title to [Solved] Problems on Ryzen 5 with ASUS Prime B350 Plus

@jammsen

Well the groups are not that good yet. Try to enable both ACS Override in GUI, then go to the syslinux (or how is it called) and enable multifunction as well.

Sorry to hear you had to replace MB, sometimes going for the cheapest option brings more issues that to put in few more bucks ;).

 

As for the slow down, I think its really a disk issue. If you copy something over to the array, from which the VMs are running as well, it slows down like a hell.

I had actually issues on my own, like when I plugged in a USB, the VM gets a micro-freeze (like 0.1-0.2 seconds), which is also pretty annoying (not that you would plug in something all the time, but still...)

However, when I was copying, I do not remember having such hard time.

 

I was using Samsung 960 EVO as my cache drive.

 

I have encountered different issues though, so be aware of those - like passing through Vega 56 to VM is OK, however Vega has the hardware reset bug, so once you restart the VM, you cannot assign it properly again - no hacks like enabling/disabling worked for me, so I just had to revert to bad old Win 10 :/.

Link to comment

@Donach "Sorry to hear you had to replace MB, sometimes going for the cheapest option brings more issues that to put in few more bucks ;)."

To be accurate, the board wasnt really cheap, it still costed me about 90 euros, the other one about 150 euros :D

 

"I had actually issues on my own, like when I plugged in a USB, the VM gets a micro-freeze (like 0.1-0.2 seconds), which is also pretty annoying (not that you would plug in something all the time, but still...)"

Im trying to not be paranoid, but youtube playback isnt synchron, lipes move faster than sound comes out of my boxes, up until now it just feels weird and im not at the point where i say, its freaking annoying, but that could happen :/

Edited by jammsen
Link to comment

@Donach

Damn i missed the important part to reply to:

"Well the groups are not that good yet. Try to enable both ACS Override in GUI, then go to the syslinux (or how is it called) and enable multifunction as well."

I will try that when the parity is done, give me some time pls and i will post the 2 different versions, with just acs on AND acs on,multi - i will keep you posted :)

Link to comment

@jammsen

Sure thing. For the video playbacks, I usually had no issues after all set properly (this was actually one of my tests to see if YT videos play without stutter and video-audio are in sync).

 

What I usually had to do for audio is to pass it through, any emulation never worked. This means I passed the onboard audio, and for other VMs, I was using the simple USB 2-jack audio and via USB Hotplug plugin was plugging it in (or just via VM settings).

Then I had to go to audio settings and change the sample rate to at least 48 kHz, then there was no crackling in the audio on either of the cards.

Link to comment
19 hours ago, jammsen said:

IOMMU (ASUS Prime X370 PRO, with bios version 3803 and all ACS off):


IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 3:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 5:	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1b21:1343] 06:00.0 USB controller: ASMedia Technology Inc. Device 1343
[8086:1539] 07:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 14:	[10de:104a] 09:00.0 VGA compatible controller: NVIDIA Corporation GF119 [GeForce GT 610] (rev a1)
[10de:0e08] 09:00.1 Audio device: NVIDIA Corporation GF119 HDMI Audio Controller (rev a1)
IOMMU group 15:	[10de:1b80] 0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
[10de:10f0] 0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 16:	[1022:145a] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 17:	[1022:1456] 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 18:	[1022:145c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 19:	[1022:1455] 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 20:	[1022:7901] 0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 21:	[1022:1457] 0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller

 

 

IOMMU (ASUS Prime X370 PRO, with bios version 3803 and all ACS VM setting enabled):

IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 3:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 5:	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1b21:1343] 06:00.0 USB controller: ASMedia Technology Inc. Device 1343
[8086:1539] 07:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 14:	[10de:104a] 09:00.0 VGA compatible controller: NVIDIA Corporation GF119 [GeForce GT 610] (rev a1)
[10de:0e08] 09:00.1 Audio device: NVIDIA Corporation GF119 HDMI Audio Controller (rev a1)
IOMMU group 15:	[10de:1b80] 0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
[10de:10f0] 0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 16:	[1022:145a] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 17:	[1022:1456] 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 18:	[1022:145c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 19:	[1022:1455] 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 20:	[1022:7901] 0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 21:	[1022:1457] 0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller

IOMMU (ASUS Prime X370 PRO, with bios version 3803 and all ACS VM setting enabled WITH MULTIFUNCTION):

IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 3:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 5:	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
IOMMU group 14:	[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
IOMMU group 15:	[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
IOMMU group 16:	[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 17:	[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 18:	[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 19:	[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 20:	[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 21:	[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
IOMMU group 22:	[1b21:1343] 06:00.0 USB controller: ASMedia Technology Inc. Device 1343
IOMMU group 23:	[8086:1539] 07:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 24:	[10de:104a] 09:00.0 VGA compatible controller: NVIDIA Corporation GF119 [GeForce GT 610] (rev a1)
IOMMU group 25:	[10de:0e08] 09:00.1 Audio device: NVIDIA Corporation GF119 HDMI Audio Controller (rev a1)
IOMMU group 26:	[10de:1b80] 0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev a1)
IOMMU group 27:	[10de:10f0] 0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 28:	[1022:145a] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 29:	[1022:1456] 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 30:	[1022:145c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 31:	[1022:1455] 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 32:	[1022:7901] 0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 33:	[1022:1457] 0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller

Whew multifunction, sure packs a punch i would say :D, while ACS off and ACS on without multifunction are according to notepad++ compare identical.

Are you guys sure it doesnt make things more unstable?

@Donach @david279 @Jcloud

Edited by jammsen
Updated iommu tables, multiple times
Link to comment

@jammsen

What you may be forced to do, is to passthrough whole PCI group to one VM. Although this allows you to pick the groups specifically, not to use one huge group.

For example, Groups 31-33 may have to be passed to the same VM to make it working.

However, I would still try to pass just the Audio (Group 33) and see what happens, try a few restarts etc.

Link to comment
8 hours ago, Donach said:

@jammsen

What you may be forced to do, is to passthrough whole PCI group to one VM. Although this allows you to pick the groups specifically, not to use one huge group.

For example, Groups 31-33 may have to be passed to the same VM to make it working.

However, I would still try to pass just the Audio (Group 33) and see what happens, try a few restarts etc.

@Donach

I already have my audio device via the list in the edits of the vm selected, do you mean to unselect there and pci_stub this device or what?

Link to comment

Hey,

 

I have a similar setup like jammsen.

 

Asus Prime B350 Plus

AMD R7 1800X

16GB DDR4 RAM

NVIDIA Gainward GTX 1080 (Primary)

NVIDIA MSI GTX 1050TI LP (Secondary)

 

I first encounter the same Problem like jammsen, the IOMMU Group were far from optimal.

Thanks to david279 the multifunction part did the trick and i was able to assign the secondary graphics Card aswell.

 

However, after passing trough the first one I got another error in my VM log:

"qemu-system-x86_64: vfio_region_write(0000:01:00.0:region1+0x240c14, 0xffffffff,4) failed: Device or resource busy"

 

From my Point of view, this indicates, that the host is grabbing the graphic Card resources itself and therefore can't passtrough the device.

 

After some research found a solution in the redhat Mailing List:

https://www.redhat.com/archives/vfio-users/2016-March/msg00083.html

Quote

echo 0 > /sys/class/vtconsole/vtcon0/bind
echo 0 > /sys/class/vtconsole/vtcon1/bind
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind

After executing the commands above unraid was able to passtrough the first device aswell.

Downside of this solution is, that I need to  to the commands after each host restart.

 

In the comining days i will try to find a permanent solution.

Link to comment
Hey,
 
I have a similar setup like jammsen.
 
Asus Prime B350 Plus
AMD R7 1800X
16GB DDR4 RAM
NVIDIA Gainward GTX 1080 (Primary)
NVIDIA MSI GTX 1050TI LP (Secondary)
 
I first encounter the same Problem like jammsen, the IOMMU Group were far from optimal.
Thanks to david279 the multifunction part did the trick and i was able to assign the secondary graphics Card aswell.
 
However, after passing trough the first one I got another error in my VM log:
"qemu-system-x86_64: vfio_region_write(0000:01:00.0:region1+0x240c14, 0xffffffff,4) failed: Device or resource busy"
 
From my Point of view, this indicates, that the host is grabbing the graphic Card resources itself and therefore can't passtrough the device.
 
After some research found a solution in the redhat Mailing List:
https://www.redhat.com/archives/vfio-users/2016-March/msg00083.html
echo 0 > /sys/class/vtconsole/vtcon0/bind
echo 0 > /sys/class/vtconsole/vtcon1/bind
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
After executing the commands above unraid was able to passtrough the first device aswell.
Downside of this solution is, that I need to  to the commands after each host restart.
 
In the comining days i will try to find a permanent solution.
Does adding it to the go file on the flash drive not work?

As any commands on the go file would execute on the host during startup

Sent from my LG-H990 using Tapatalk

Link to comment
13 hours ago, ars92 said:

After executing the commands above unraid was able to passtrough the first device aswell.
Downside of this solution is, that I need to  to the commands after each host restart.
 
In the comining days i will try to find a permanent solution.
Does adding it to the go file on the flash drive not work?

As any commands on the go file would execute on the host during startup

Sent from my LG-H990 using Tapatalk
 

Try adding the ROM file of the gpu in manuel edit mode described here - SpaceInvader has a lot of problem solvings in his channel and performance tips too:

 

 

Link to comment

Are you running the VM off of the array? I noted you said you have no cache drive....

 

Definitely dont want to run dockers or a VM on the array. Drop those on a cache drive or unassigned devices. I bet your IO WAIT time is through the roof.

 

And try this for the audio/video desync. The MSI_UTIL program makes it easy, and it solved the issues I was having.

 

Edited by NotYetRated
Link to comment
Quote
17 hours ago, jammsen said:

Try adding the ROM file of the gpu in manuel edit mode

 

 

I did that in advance, this fixed the first issue I had and the Screen turned on.

The efifb bug was leading to a failure on my WIN10 VM. The Device Manager showed the Card correctly as GTX 1080 but stated there was an error with this device.

The Screen Resolution was limited to 800x600 during this period.

 

What I did to prevent efifb from initializing is to simply start unRaid in Legacy (non Uefi) mode.

Now everything is working as intended, it's booting straight into my VM and the Screen is turning on in full resolution.

 

Link to comment
9 hours ago, Punnie said:

The efifb bug was leading to a failure on my WIN10 VM. The Device Manager showed the Card correctly as GTX 1080 but stated there was an error with this device.

The Screen Resolution was limited to 800x600 during this period.

 

I've seen that with my system. For me booting the iron with pure EFI caused errors, booting with pure legacy mode caused different VM errors, but booting with "EFI with legacy support on" (also called CSM support on some mobo bios)  and forcing unRAID to boot legacy mode (EFI- folder) and my VMs work great. I don't know why the last option works the best; guessing it has to do with the BIOS getting EFI loaded, but not initializing any of it at OS -- leaving the EFI resources for the VM (gigantic-hazard-of-a-guess). 

Edited by Jcloud
Link to comment
9 hours ago, Jcloud said:

I've seen that with my system. For me booting the iron with pure EFI caused errors, booting with pure legacy mode caused different VM errors, but booting with "EFI with legacy support on" (also called CSM support on some mobo bios)  and forcing unRAID to boot legacy mode (EFI- folder) and my VMs work great. I don't know why the last option works the best; guessing it has to do with the BIOS getting EFI loaded, but not initializing any of it at OS -- leaving the EFI resources for the VM (gigantic-hazard-of-a-guess). 

Look at the video i posted, there is a downloadpage over of the gpu-z tool where you can find gpu-bios with uefi support, maybe that helps.

I dont mean to flash your gpu, but to serve that rom to your vm via the manual edit <rom file='/path/to/file.rom'/>

Edited by jammsen
Link to comment
13 hours ago, jammsen said:

Look at the video i posted, there is a downloadpage over of the gpu-z tool where you can find gpu-bios with uefi support, maybe that helps.

I dont mean to flash your gpu, but to serve that rom to your vm via the manual edit <rom file='/path/to/file.rom'/>

I already have dumped my vbios, and my system works just fine; so long as the motherboard has EFI with legacy support enabled, and I boot unRAID as a legacy boot object.  I've also watched that video before, and it's not my preferred method of getting a vbios -- I prefer to dump it from my own card, to ensure it's valid for my hardware.

 

But thanks anyways.

  • Upvote 1
Link to comment
On 11.3.2018 at 10:18 AM, Donach said:

@jammsen

Sure thing. For the video playbacks, I usually had no issues after all set properly (this was actually one of my tests to see if YT videos play without stutter and video-audio are in sync).

 

What I usually had to do for audio is to pass it through, any emulation never worked. This means I passed the onboard audio, and for other VMs, I was using the simple USB 2-jack audio and via USB Hotplug plugin was plugging it in (or just via VM settings).

Then I had to go to audio settings and change the sample rate to at least 48 kHz, then there was no crackling in the audio on either of the cards.

 

@Donach

Im still having sometimes giant desyncs, no crackling or so and the bitrates are all out of the box 48kHz or more.

I've read about an MSI_UTIL, is that thing really helpful?

Link to comment
  • 2 months later...

Can someone tell me, if the ASUS B350 Plus should able to passthrough one PCIE GPU, onboard audio, one or two USB ports and one PCI wifi card?

 

Of course the Asus Crosshair Hero VI would be a better board and would probably have better IOMMU groups, but I think it would be a little bit “overpowered“ for me and a low budget solution should be enough for me, at least performance-wise...

Edited by lixe
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.