Two Identical GPU Problem

[Attackwave]

Hi,

 

I have a problem with two identical GPU's for two VM's:

Radeon RX 570 => passthrough => Windows 10

Radeon RX 570 => passthrough => Ubuntu 18.04

 

Extracted VBIOS attached. I use it for both GPU's.

 

Reproduce:

1. Fresh Server Boot

2. Starting Windows VM

3. Testing Windows VM with Parsec Gaming...it works

4. Starting Ubuntu VM (first Install with VNC/Teamviewer)

5. Ubuntu Desktop works, now shutdown

6. Shutdown hangs

7. Forced stop but GPU still bind.

8. Windows VM freezed

9. Starting Ubuntu give me "Internal error: Unknown PCI header type '127'"

 

Is there a bug in vfio when I have two identical GPU's with identical ID's?

 

I have tested the following config but it doesent work:

append isolcpus=1-5,7-11 xen-pciback.hide=(02:00.0)(02:00.1)(03:00.0)(03:00.1) initrd=/bzroot

 

Setup:

Unraid: 6.6.6
M/B: MSI - X99A GODLIKE GAMING CARBON (MS-7883)
CPU: Intel® Core™ i7-6850K CPU @ 3.60GHz
HVM: Enabled
IOMMU: Enabled
Cache: 384 kB, 1536 kB, 15360 kB
Memory: 32 GB (max. installable capacity 512 GB)
Kernel: Linux 4.18.20-unRAID x86_64
GPU: 2x SAPPHIRE NITRO+ RX 570 4GB

 

IOMMU Groups:

IOMMU group 30:	[1002:67df] 02:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480/570/570X/580/580X/590] (rev ef)
[1002:aaf0] 02:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 580]
IOMMU group 31:	[1002:67df] 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480/570/570X/580/580X/590] (rev ef)
[1002:aaf0] 03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 580]

 

sapphire_nitro+_rx570_4096.vbios

ubuntu.xml

win10.xml

[Attackwave]

I dropped the Ubuntu VM and create a new W10.....works.

But I have no Idea why any Linux VM wont work.