Anybody planning a Ryzen build?


Recommended Posts

18 minutes ago, mikeyosm said:

 

I'm using RC15 on Asus Crosshair VI Hero, 32GB Corsair veng mem, 1700x Ryzen, Samsung 950 pro (in passthrough) and a plethora of HDDs.

I manage to stay stable for days/weeks  whilst running a W10 VM with 1050ti/audio/nvme passthrough, Windows server 2012 VM, Plex and various dockers.

Plex transcodes 4k no issues, W10 gaming is very close the bare metal. Very very pleased thus far.

 

Did you use any dirty-hack to make it working like bare-metal?
I tried to setup double Win 10 VMs before the NPT fix was found, and it was horrible - had lags even at very basic games...

Thanks for clarifying this.

Link to comment
2 minutes ago, Donach said:

 

Did you use any dirty-hack to make it working like bare-metal?
I tried to setup double Win 10 VMs before the NPT fix was found, and it was horrible - had lags even at very basic games...

Thanks for clarifying this.

No - any issues I had were related to the NPT bug and now this is resolved. I also had issues with random pops/crackle in audio even with MSI fix until I decided to pass through my nvme drive to the W10 VM, it now performs like it was bare metal. I suspected that the scsi/vfio driver was the cause but cannot be sure.

Link to comment
6 minutes ago, mikeyosm said:

No - any issues I had were related to the NPT bug and now this is resolved. I also had issues with random pops/crackle in audio even with MSI fix until I decided to pass through my nvme drive to the W10 VM, it now performs like it was bare metal. I suspected that the scsi/vfio driver was the cause but cannot be sure.

About the audio crack - I was experiencing this on any Audio device.

I was passing through USB stick with 2jacks - simple fix though:

 

In the Windows Sound configuration, changing the sound quality to higher (I think it was 48kHz - DVD) resolved the issue (as far as I can recall).

 

Thanks for the reply - so just getting newest unRaid RC is enough from what I understood... I will definitely try it sometime soon!

Edited by Donach
Link to comment
  • 3 weeks later...

Hey all,

 

curious what the general concensus on a ryzen build is right now? Over the past few days i have been migrating data from my old intel build and my ryzen build has crashed a few times

 

Running 6.4.0_rc19b

 

I was using the build a desktop before and it was running great so i know the hardware is good.

 

Ryzen 5 1600

16GB DDR4

Gigabyte AX370-Gaming K5

 

Could just be a coincidence but so far it has not crashed while doing something (it ran through the parity check, copying over all the data etc. fine.) it only seems to crash when idle, but i thought i read that bug was fixed?

Link to comment

Guys, does anybody using Ryzen build as VM with Primary GPU passthrough (u can see Win10 on monitor - without VNC) ?

 

Been trying few days with different combinations of GPU (2x 1070 and Radeon R7 250x) no success , soon as i set it as 1st card even with bios , i get just black screen and sometimes with blinking cursor :(

 

Wanted to have all in one server , but had to put all HDDs into my ITX machine again

 

Thanks

 

 

Link to comment

Over the weekend, I finally got around to upgrading my ASUS Prime X370-PRO motherboard to the latest BIOS (3402).  So far, my uptime is 3+ days with no crashes.  In general, I have not had a crashing system, primarily because I run a Windows 10 VM all the time with half the cores/threads dedicated to it from my Ryzen 1800X.  I guess that's enough to keep the crash/hang problem at bay.

 

The one thing I noticed about BIOS 3402 is the improved IOMMU groupings available.  This is what the IOMMU groups look like without the ACS override enabled:

 

IOMMU group 0
	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 1
	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
IOMMU group 2
	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 3
	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 4
	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
IOMMU group 5
	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 6
	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 7
	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
IOMMU group 8
	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 9
	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
IOMMU group 10
	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
	[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 11
	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1460
	[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1461
	[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1462
	[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1463
	[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1464
	[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1465
	[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1466
	[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1467
IOMMU group 12
	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
	[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
	[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
	[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1000:0072] 03:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
	[1b21:1343] 04:00.0 USB controller: ASMedia Technology Inc. Device 1343
	[8086:1539] 05:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 13
	[1002:677b] 07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos PRO [Radeon HD 7450]
	[1002:aa98] 07:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6450 / 7450/8450/8490 OEM / R5 230/235/235X OEM]
IOMMU group 14
	[1022:145a] 08:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 15
	[1022:1456] 08:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 1456
IOMMU group 16
	[1022:145c] 08:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 145c
IOMMU group 17
	[1022:1455] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 18
	[1022:7901] 09:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 19
	[1022:1457] 09:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Device 1457

Previously, I had to use the ACS override to break up the IOMMU groups so I could properly pass my GPU, sound card and a USB controller in to my Windows 10 VM.  With BIOS 3402, I no longer need to do that.

 

Here's a screen shot of my VM pass-through settings.

 

Win10e.png

 

Anyway, just really glad AMD/ASUS are working to address the concerns for us VM users.  I know it was mentioned during an AMD AMA (Ask Me Anything) on Reddit (and likely other places) when Ryzen was initially launched.  It might take a while, but it's nice to know they are listening, and are willing to put forth the effort to help us solve those problems.

 

PS:  In order to take the screen shot, I had to shut down my Window 10 VM.  In the ensuing 10 minutes it took me to write this post, the server DID crash (unRAID 6.3.5) ... so BIOS 3402 adds nothing to help prevent crashing.  Odd since my kid was watching a movie on the Plex that's a docker on the server.  I guess that's just not enough activity?  Oh well, hard reboot and parity check.  'Night all!

Edited by ufopinball
Link to comment
On 1/7/2018 at 2:28 AM, killeriq said:

Guys, does anybody using Ryzen build as VM with Primary GPU passthrough (u can see Win10 on monitor - without VNC) ?

 

Been trying few days with different combinations of GPU (2x 1070 and Radeon R7 250x) no success , soon as i set it as 1st card even with bios , i get just black screen and sometimes with blinking cursor :(

 

Post your build details (CPU, Mobo, RAM, etc.)  I have this currently working on my Ryzen 1800X w/ ASUS Prime X370-PRO motherboard.  My GPU is only a Radeon 6450 desktop graphics card.  Nothing fancy, but the GPU pass-through to my Windows 10 VM works nicely.

Link to comment

About your "freezing" issue try this fix (command value) into the kernel, fo me it help to prevent freezing

https://youtu.be/T_BmK9vSjPA?t=583

My issue:

 

I have the same board as you.

unRAID OS version 6.4.0-rc19b

Asus X370-Pro (bios also latest)

Ryzen 1700

G.SKILL 32GB KIT DDR4 3200MHz CL14 Trident Z (GSKILL0014) (on 3066, not running 3200Mhz on this board)

Sapphire Radeon R7 250x

ZOTAC GeForce GTX 1070 Mini - 10pcs (so i dont think its an card issue).

 

To install Win10 VM i had to switch into "SeaBios" as OVMF wasnt working...maybe this could be the problem , which setting do you have?

 

Win10 is installed i can run it with VNC as primary and GPU as 2nd card-has LCD screen out, but soon as ive set GPU as primary  (Amd or Nvidia), even with that "dump bios" it wont work...just get black screen, sometime blinking cursor or monitor goes to stand by.

 

As ive posted in other thread i get this error in VM log

 

Thanks

 

image.png.e7dfac6c25e1d4f7f8cb2f1d91f54c96.png

 

 

Link to comment
On 1/6/2018 at 9:51 AM, Blindsay said:

Hey all,

 

curious what the general concensus on a ryzen build is right now? Over the past few days i have been migrating data from my old intel build and my ryzen build has crashed a few times

 

Running 6.4.0_rc19b

 

I was using the build a desktop before and it was running great so i know the hardware is good.

 

Ryzen 5 1600

16GB DDR4

Gigabyte AX370-Gaming K5

 

Could just be a coincidence but so far it has not crashed while doing something (it ran through the parity check, copying over all the data etc. fine.) it only seems to crash when idle, but i thought i read that bug was fixed?

 

I upgraded to rc20a as well as the upgraded the BIOS to v3402 this morning.  Prior to that, with C-State disabled, my system was stable for 30 days.  

 

 

 

unraid.png

Edited by luisv
Link to comment
14 hours ago, killeriq said:

About your "freezing" issue try this fix (command value) into the kernel, fo me it help to prevent freezing


https://youtu.be/T_BmK9vSjPA?t=583

My issue:

 

I have the same board as you.

unRAID OS version 6.4.0-rc19b

Asus X370-Pro (bios also latest)

Ryzen 1700

G.SKILL 32GB KIT DDR4 3200MHz CL14 Trident Z (GSKILL0014) (on 3066, not running 3200Mhz on this board)

Sapphire Radeon R7 250x

ZOTAC GeForce GTX 1070 Mini - 10pcs (so i dont think its an card issue).

 

To install Win10 VM i had to switch into "SeaBios" as OVMF wasnt working...maybe this could be the problem , which setting do you have?

 

Win10 is installed i can run it with VNC as primary and GPU as 2nd card-has LCD screen out, but soon as ive set GPU as primary  (Amd or Nvidia), even with that "dump bios" it wont work...just get black screen, sometime blinking cursor or monitor goes to stand by.

 

As ive posted in other thread i get this error in VM log

 

[snip]

 

In general I don't have freezing issues.  So long as the Windows 10 VM is running, the server stays happy.  I've had uptimes in excess of a month, only ended because I wanted to do the BIOS upgrade.  Thanks for the tip, though ... I'll try the latest RC builds once I have a chance to experiment with all the new features on a test system.

 

Regarding your GPU pass-through, I'll attach a screen shot of my working VM with GPU passthrough, as well as a copy of the XML.  I'm presently running OVMF, because I thought SeaBios was less advanced?  This could be your problem, what happens when you run OVMF?  Otherwise, I have no experience with NVIDIA graphics cards, nor dumping BIOS.  I figure we should at least be able to get your Radeon GPU running.  I'm also not seeing the failure in the SYSLOG that you're seeing, but hopefully that goes away if we can figure this out.

 

Take a look at my attachments and let me know what you think...

 

PS:  If it matters, this Windows 10 VM is about 9-10 months old, I think?

 

Win10e-Full.png

 

Win10e.xml

Edited by ufopinball
Link to comment

Posted previously however I since moved house and it all got put on hold. 

Now that all the move is done I am about to build a new unRaid Server and planning on using the following parts:

Case: Fractal Design Define R5
Mobo: Gigabyte AX370 Gaming K3
CPU: AMD Ryzen 5 1600
RAM: Kingston HyperX Fury 16GB DDR4
PSU: SilverStone Strider Gold 550W ST55F-G

GPU: Gigabyte Radeon RX 550 D5 2GB
Cache Drive: Samsung 960 EVO NVMe M.2 250GB
Parity Drive: Seagate Ironwolf 8TB
HDD: Seagate Ironwolf 4TB
HDD: 4x WD Red 3TB (already own)

 

I am intending on using this as a HTPC as well, as such I will need a VM (Kodi, likely Libreelec) to display on the TV.

I believe this means I just need to have GPU and Keyboard/Mouse pass-through to the VM?

Will this parts list all work okay? Anything expected to give me grief?

Thank you, appreciate the help!

Link to comment

Had Gigabyte Gaming K5 - Bios is crap comparing to Asus, 2nd LAN port wasnt working in Unraid (not even light when i attach cable). And after like 2 days of usage didnt booted up...i was also confused with the Bios switches. Thought it would be great board with the 2x LAN and LED panel for error codes , but in the end i return it and got Asus X370-Pro (will might switch it to Asus Crosshair VI due to 3200Mhz RAM support). 

 

It might have been problematic piece, no clue...but Red Bios was define-telly not my cup of coffe ;)

15 hours ago, Mattyfaz said:

Posted previously however I since moved house and it all got put on hold. 

Now that all the move is done I am about to build a new unRaid Server and planning on using the following parts:

Case: Fractal Design Define R5
Mobo: Gigabyte AX370 Gaming K3
CPU: AMD Ryzen 5 1600
RAM: Kingston HyperX Fury 16GB DDR4
PSU: SilverStone Strider Gold 550W ST55F-G

GPU: Gigabyte Radeon RX 550 D5 2GB
Cache Drive: Samsung 960 EVO NVMe M.2 250GB
Parity Drive: Seagate Ironwolf 8TB
HDD: Seagate Ironwolf 4TB
HDD: 4x WD Red 3TB (already own)

 

I am intending on using this as a HTPC as well, as such I will need a VM (Kodi, likely Libreelec) to display on the TV.

I believe this means I just need to have GPU and Keyboard/Mouse pass-through to the VM?

Will this parts list all work okay? Anything expected to give me grief?

Thank you, appreciate the help!

 

Link to comment

I just updated my UnRaid server because I was having issues with it locking up every 2-3 days. Was using a 990FX mobo with an AMD 8350. Decided I would take the jump and go with a Ryzen build. Ironically, it looks like these Ryzen builds are having the same issue.

 

Mobo: Gigabyte AX370 Gaming K5 (BIOS version F10)

CPU: Ryzen 7 1700 OC'd to 3.5Ghz

CPU Cooler: OEM Spire Cooler

RAM: 2 x 4GB Kingston HyperX Fury DDR4-2400; 2 x 8GB G.Skill DDR4-3200 will be added next weekend.

PSU: EVGA SuperNova 850W P2 Titanium

Internet: Mellanox Connect X-2 10GB (For file transfers between my server and desktop)

HBA Card: LSI 9011-8i

Cache: Crucial MX300 750GB SSD

Parity: 2 x 8TB Seagate Ironwolf

HDD: 3 x 3TB WD Red

HDD: 1 x 6TB WD Red

HDD: 1 x 6TB Seagate Ironwolf

 

Booted into UnRaid on the new hardware last night. Updated to 6.4 RC21b. Started a parity check. System crashed about 5 hours in. Admittedly, I had not disabled c-states or added the rcu_nocbs=0-15 line to the syslinux config. I did, however, disable everything else and update the BIOS to F10 which was release in December. I have since disabled the c-state options and edited the syslinux file and am just going to let the system run for a while. This is purely a media server so Plex, sickrage, plexpy, and filebot are my only dockers. No VMs.

 

Just for reference, here are my IOMMU groupings incase anyone wanted to use a similar setup in the future.

PCI Devices and IOMMU Groups

IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 3:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 5:	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
	[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
	[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
	[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
	[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
	[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
	[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
	[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
	[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[1022:43b9] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
	[1022:43b5] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
	[1022:43b0] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
	[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
	[1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
	[1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
	[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
	[1b21:1343] 03:00.0 USB controller: ASMedia Technology Inc. Device 1343
	[8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
	[10de:104a] 06:00.0 VGA compatible controller: NVIDIA Corporation GF119 [GeForce GT 610] (rev a1)
	[10de:0e08] 06:00.1 Audio device: NVIDIA Corporation GF119 HDMI Audio Controller (rev a1)
IOMMU group 14:	[1000:0072] 07:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 02)
IOMMU group 15:	[15b3:6750] 08:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)
IOMMU group 16:	[1022:145a] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 17:	[1022:1456] 09:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 18:	[1022:145c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 19:	[1022:1455] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 20:	[1022:7901] 0a:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)


CPU Thread Pairings

Pair 1:	cpu 0 / cpu 1
Pair 2:	cpu 2 / cpu 3
Pair 3:	cpu 4 / cpu 5
Pair 4:	cpu 6 / cpu 7
Pair 5:	cpu 8 / cpu 9
Pair 6:	cpu 10 / cpu 11
Pair 7:	cpu 12 / cpu 13
Pair 8:	cpu 14 / cpu 15


USB Devices

Bus 001 Device 001:	ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 002:	ID 046d:c52b Logitech, Inc. Unifying Receiver
Bus 002 Device 001:	ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001:	ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001:	ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001:	ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 005 Device 002:	ID 0781:5571 SanDisk Corp. Cruzer Fit
Bus 006 Device 001:	ID 1d6b:0003 Linux Foundation 3.0 root hub

 

Edited by TechnoBabble28
Link to comment

So i had still problem to instal it via OVMF so solve it this way 

 

Even now its Win10 installed with OVMF/UEFI the card passthrough doesnt work with AMD R7 250x, so will try again with GTX 1070...start to drive me mad when i have to take all HDD from 1 tower to another... :( I ming try to dl fresh need Unraid and start from there...

 

 

Link to comment

even with GTX 1070 still no luck :(...group 19 has only 1 device so dont know why i get this error

 


2018-01-14 12:35:56.281+0000: starting up libvirt version: 3.8.0, qemu version: 2.10.2, hostname: unRAIDTower
LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name 'guest=Windows 10 - 2,debug-threads=on' -S -object 'secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-1-Windows 10 - 2/master-key.aes' -machine pc-i440fx-2.10,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host,hv_time,hv_relaxed,hv_vapic,hv_spinlocks=0x1fff,hv_vendor_id=none -drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on -drive file=/etc/libvirt/qemu/nvram/4a9a652f-26e6-4784-af39-8e7859fdb734_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 -m 12288 -realtime mlock=off -smp 8,sockets=1,cores=8,threads=1 -uuid 4a9a652f-26e6-4784-af39-8e7859fdb734 -no-user-config -nodefaults -chardev 'socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-1-Windows 10 - 2/monitor.sock,server,nowait' -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime -no-hpet -no-shutdown -boot strict=on -device nec-video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pci.0,addr=0x2 -device vfio-pci,host=0a:00.0,id=hostdev0,bus=pci.0,addr=0x6 -device vfio-pci,host=0a:00.1,id=hostdev1,bus=pci.0,addr=0x8 -device vfio-pci,host=0c:00.3,id=hostdev2,bus=pci.0,addr=0x9 -device usb-host,hostbus=5,hostaddr=5,id=hostdev3,bus=usb.0,port=1 -device usb-host,hostbus=5,hostaddr=3,id=hostdev4,bus=usb.0,port=2 -device usb-host,hostbus=5,hostaddr=4,id=hostdev5,bus=usb.0,port=3 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0xa -msg timestamp=on
2018-01-14 12:35:56.281+0000: Domain id=1 is tainted: high-privileges
2018-01-14 12:35:56.282+0000: Domain id=1 is tainted: host-cpu
2018-01-14T12:35:56.335861Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/0 (label charserial0)
2018-01-14T12:35:57.822108Z qemu-system-x86_64: -device vfio-pci,host=0a:00.0,id=hostdev0,bus=pci.0,addr=0x6: Failed to mmap 0000:0a:00.0 BAR 3. Performance may be slow
2018-01-14T12:35:57.999447Z qemu-system-x86_64: vfio: Cannot reset device 0000:0c:00.3, depends on group 19 which is not owned.
2018-01-14T12:35:59.061687Z qemu-system-x86_64: vfio: Cannot reset device 0000:0c:00.3, depends on group 19 which is not owned.

Here are groups with ACS enabled

IOMMU group 0:	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 1:	[1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 2:	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 3:	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 4:	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 5:	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
IOMMU group 6:	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 7:	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 8:	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 9:	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
IOMMU group 10:	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
IOMMU group 11:	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
IOMMU group 13:	[144d:a804] 01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961
IOMMU group 14:	[1022:43b9] 02:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
[1022:43b5] 02:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
[1022:43b0] 02:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
[1022:43b4] 03:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 03:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 03:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 03:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 03:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1022:43b4] 03:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
[1b21:1343] 07:00.0 USB controller: ASMedia Technology Inc. Device 1343
[8086:1539] 08:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
IOMMU group 15:	[10de:1b81] 0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
[10de:10f0] 0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
IOMMU group 16:	[1022:145a] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
IOMMU group 17:	[1022:1456] 0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
IOMMU group 18:	[1022:145c] 0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
IOMMU group 19:	[1022:1455] 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
IOMMU group 20:	[1022:7901] 0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 21:	[1022:1457] 0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller

 

Edited by killeriq
Link to comment

Tried to set fresh unraid on other USB...and after i added dumped rom file into XML is working as 1st GPU on first try... ...so probably is something messed in the OS i use, not sure what is it...but probably need to swich to new to get it working, strange :( 

 

EDIT:

Nvidia GPU - needs rom dump file into XML

AMD GPU - works without dump file

 

EDIT2:

The error is caused by UEFI FLASH (unraid) boot setting - soon as i enable im not able to pass the GPU, when i disable the UEFI again , it wont start.

Could someone try that? 

Main -> Boot Device -> FLASH (click on that)

image.png.d71e3701b5a81d8a455cd1d18ed5a9f2.png

 

Also the error is gone in this - im on 6.4.0 Stable now...will do more tests on those RC if i would be able to update

2018-01-14T12:35:57.822108Z qemu-system-x86_64: -device vfio-pci,host=0a:00.0,id=hostdev0,bus=pci.0,addr=0x6: Failed to mmap 0000:0a:00.0 BAR 3. Performance may be slow

new log:

2018-01-14 13:37:22.515+0000: starting up libvirt version: 3.8.0, qemu version: 2.10.2, hostname: Tower
LC_ALL=C PATH=/bin:/sbin:/usr/bin:/usr/sbin HOME=/ QEMU_AUDIO_DRV=none /usr/local/sbin/qemu -name 'guest=Windows 10 - 2,debug-threads=on' -S -object 'secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-5-Windows 10 - 2/master-key.aes' -machine pc-i440fx-2.10,accel=kvm,usb=off,dump-guest-core=off,mem-merge=off -cpu host,hv_time,hv_relaxed,hv_vapic,hv_spinlocks=0x1fff,hv_vendor_id=none -drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on -drive file=/etc/libvirt/qemu/nvram/4a9a652f-26e6-4784-af39-8e7859fdb734_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 -m 12288 -realtime mlock=off -smp 8,sockets=1,cores=8,threads=1 -uuid 4a9a652f-26e6-4784-af39-8e7859fdb734 -display none -no-user-config -nodefaults -chardev 'socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-5-Windows 10 - 2/monitor.sock,server,nowait' -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime -no-hpet -no-shutdown -boot strict=o070mini-mod.dump -device vfio-pci,host=0a:00.1,id=hostdev1,bus=pci.0,addr=0x6 -device vfio-pci,host=0c:00.3,id=hostdev2,bus=pci.0,addr=0x8 -device usb-host,hostbus=5,hostaddr=6,id=hostdev3,bus=usb.0,port=1 -device usb-host,hostbus=5,hostaddr=4,id=hostdev4,bus=usb.0,port=2 -device usb-host,hostbus=5,hostaddr=5,id=hostdev5,bus=usb.0,port=3 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x9 -msg timestamp=on
2018-01-14 13:37:22.515+0000: Domain id=5 is tainted: high-privileges
2018-01-14 13:37:22.515+0000: Domain id=5 is tainted: host-cpu
2018-01-14T13:37:22.577346Z qemu-system-x86_64: -chardev pty,id=charserial0: char device redirected to /dev/pts/0 (label charserial0)
2018-01-14T13:37:24.088519Z qemu-system-x86_64: vfio: Cannot reset device 0000:0c:00.3, depends on group 19 which is not owned.
2018-01-14T13:37:25.122666Z qemu-system-x86_64: vfio: Cannot reset device 0000:0c:00.3, depends on group 19 which is not owned.
2018-01-14T13:37:38.193091Z qemu-system-x86_64: libusb_release_interface: -4 [NO_DEVICE]
2018-01-14T13:37:38.193115Z qemu-system-x86_64: libusb_release_interface: -4 [NO_DEVICE]
libusb: error [udev_hotplug_event] ignoring udev action bind

 

Edited by killeriq
Link to comment

Upgraded to unRAID 6.4.0 last night.  Uptime at present is 12+ hours and counting.  I have not touched any C-States or added a "rcu_nocbs" setting.  In my build, I'm always running a Windows 10 VM and that seems to keep the system happy enough to not crash.

 

So far I have not tried out the newer 6.4.0 features, but the upgrade to Linux Kernel 4.14.13 fixes the NTP (Nested Page Tables) bug, so now the GPU pass-through performance into my Windows 10 VM is much, much better.

 

For reference, here's more info on the NTP bug:  https://patchwork.kernel.org/patch/10027525/

 

Haven't had too much time to exercise the server, but so far I've not run into any roadblocks or even speed bumps.  Knock on wood...

Link to comment
1 hour ago, ufopinball said:

Upgraded to unRAID 6.4.0 last night.  Uptime at present is 12+ hours and counting.  I have not touched any C-States or added a "rcu_nocbs" setting.  In my build, I'm always running a Windows 10 VM and that seems to keep the system happy enough to not crash.

 

So far I have not tried out the newer 6.4.0 features, but the upgrade to Linux Kernel 4.14.13 fixes the NTP (Nested Page Tables) bug, so now the GPU pass-through performance into my Windows 10 VM is much, much better.

 

For reference, here's more info on the NTP bug:  https://patchwork.kernel.org/patch/10027525/

 

Haven't had too much time to exercise the server, but so far I've not run into any roadblocks or even speed bumps.  Knock on wood...

 

Which GPU do you use and do you have UEFI enabled or disabled on Unraid Flash USB?

Link to comment
8 minutes ago, killeriq said:

 

Which GPU do you use and do you have UEFI enabled or disabled on Unraid Flash USB?

 

For myself I use a Nivida 670, will be switching to a 1080ti tomorrow :)

If i use the UEFI enabled unraid boot menu, it really messes up me passing through my primary GPU. I have to use the old method of booting then I can use both GPUs.

 

This was true for rc15*, need to retest now i've updated to the final release of 6.4

Link to comment
Just now, Tuftuf said:

 

For myself I use a Nivida 670, will be switching to a 1080ti tomorrow :)

If i use the UEFI enabled unraid boot menu, it really messes up me passing through my primary GPU. I have to use the old method of booting then I can use both GPUs.

 

This was true for rc15*, need to retest now i've updated to the final release of 6.4

so ur using the "rom dump file" right?

 

Yeah i have the same issue with UEFI spend couple of days on that till i find it out :(

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.