Digiboy Posted February 21, 2021 Share Posted February 21, 2021 (edited) Hello, I know there's several other threads about this and belive me, I have read them all (almost) and googled/seen spaceinvaders vids about this but no success.. The problem is that IOMMU is set to "disabled" in the info tab and I don't get an alternative to use my GPU with passthrough for my VMs (only have 1 and its the primary one). HVM works and is enabled. What I have done: 1. In bios set SVM = Enabled (was auto). 2. In bios set IOMMU = Enabled (was auto). 3. Edited the syslinux.cfg file with " iommu=1 iommu=pt" and tried each seperatly. 4. Flashed bios with the latest patch (it was the same before but wanted to try a fresh patch-process). 5. Tried all options with "PCIe ACS override" and "VFIO allow unsafe interrupts". Only strange thing I have seen are a lot of errors in syslog.txt with "pcieport xxxxx PCIe Bus error: severity=Corrected" and "AER: Corrected error received: 0000:00:00.0" but not sure it's important for a solution(?) I have attached diag-file. What I have found regarding the motherboard and CPU they should both support all virtz such as AMD-vi + AMD-v: AMD threadripper 2970WX and MSI x399 sli plus Thanks in advance! diagnostics-20210221-0446.zip Edited February 21, 2021 by Digiboy Quote Link to comment
Vr2Io Posted February 21, 2021 Share Posted February 21, 2021 Should be two different issue SVM and IOMMU issue : Feb 21 04:44:53 Tower kernel: AMD-Vi: Can not reserve memory region 0-80000 for mmio Feb 21 04:44:53 Tower kernel: AMD-Vi: This is a BIOS bug. Please contact your hardware vendor PCIe error report: Check which add-on card cause error on PCIe bus by "lspci -P" 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport 1 Quote Link to comment
Digiboy Posted February 21, 2021 Author Share Posted February 21, 2021 10 hours ago, Vr2Io said: Should be two different issue SVM and IOMMU issue : Feb 21 04:44:53 Tower kernel: AMD-Vi: Can not reserve memory region 0-80000 for mmio Feb 21 04:44:53 Tower kernel: AMD-Vi: This is a BIOS bug. Please contact your hardware vendor PCIe error report: Check which add-on card cause error on PCIe bus by "lspci -P" 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport Thanks for the answer! So its a bug in the BIOS? last BIOS update was about 2-3 years ago.. is it even possible asking MSI to make a new update? Regarding the PCIe error report the only card using PCIe is the GPU (Nvidia geforce gtx 580) anything else I can check regarding this? I would appreciate any instructions or info what I can do. Quote Link to comment
Vr2Io Posted February 21, 2021 Share Posted February 21, 2021 (edited) For IOMMU issue, Pls try 2 things 1. https://bytee.net/blog/amd-threadripper-kvm-windows-gpu-passthrough - amd_iommu=on - enable Windows 10 WHQL Support 2. If not work, then try disable CPU core not more then 16 ( 32 thread ) Pls also provide "lspci -P" result. Edited February 21, 2021 by Vr2Io 1 Quote Link to comment
Digiboy Posted February 21, 2021 Author Share Posted February 21, 2021 IOMMU 1. Tried with amd_iommu=on with no result (still disabled), if I try enabling windows 10 WHQL support I get an error: "There is no GOP (Graphics output protocol) support detected in this card. 'Windows 8.1/10 feature' settings in BIOS will be changed to "Disabled". I can't start Unraid with UEFI which the BIOS change default boot option to after enabling win 10 WHQL.. 2. No difference Result from lspci -P: 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 00:1a.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 00:1a.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 00:1a.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 00:1a.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 00:1a.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 00:1a.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 00:1a.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 00:1a.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 00:1b.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 00:1b.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 00:1b.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 00:1b.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 00:1b.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 00:1b.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 00:1b.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 00:1b.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 00:01.1/00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02) 00:01.1/00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02) 00:01.1/00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02) 00:01.1/00.2/00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/00.0/00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller 00:01.1/00.2/06.0/00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) 00:07.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function 00:07.1/00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor 00:07.1/00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 Host controller 00:08.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function 00:08.1/00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) 00:08.1/00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller 20:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex 20:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit 20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 20:07.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function 20:07.1/00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor 20:08.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function 40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex 40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 40:03.1/00.0 VGA compatible controller: NVIDIA Corporation GF110 [GeForce GTX 580] (rev a1) 40:03.1/00.1 Audio device: NVIDIA Corporation GF110 High Definition Audio Controller (rev a1) 40:07.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function 40:07.1/00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor 40:07.1/00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 Host controller 40:08.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function 40:08.1/00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) 60:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex 60:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit 60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge 60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B 60:07.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function 60:07.1/00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor 60:08.1/00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function Quote Link to comment
Digiboy Posted February 21, 2021 Author Share Posted February 21, 2021 (edited) I can also add that a lot of error codes spamming regarding pci-e errors in unraid: Feb 21 21:42:19 Tower kernel: pcieport 0000:00:01.1: AER: Corrected error received: 0000:00:00.0 Feb 21 21:42:19 Tower kernel: pcieport 0000:00:01.1: PCIe Bus Error: severity=Corrected, type=Data Link Layer, (Receiver ID) Feb 21 21:42:19 Tower kernel: pcieport 0000:00:01.1: device [1022:1453] error status/mask=00000040/00006000 Feb 21 21:42:19 Tower kernel: pcieport 0000:00:01.1: [ 6] BadTLP Edited February 21, 2021 by Digiboy Quote Link to comment
Vr2Io Posted February 21, 2021 Share Posted February 21, 2021 (edited) The PCIe AER error come from on-board device, (00:01.1 bridge), not come from add-on display card. I never see AER come from on-board device, pls try remove extra setting in "syslinux.cfg" and remove "PCIe ACS override", if AER still spamming, it could be motherboard or CPU problem. Any history/background can provide, does it work normal previously ? Feb 21 21:42:19 Tower kernel: pcieport 0000:00:01.1: AER: Corrected error received: 0000:00:00.0 00:01.1/00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02) 00:01.1/00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02) 00:01.1/00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02) 00:01.1/00.2/00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) 00:01.1/00.2/00.0/00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller 00:01.1/00.2/06.0/00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) I also notice your log have below message, you could try that. My TR 1920x with Gigabyte X399 Aorus pro, no below message and I no need setting syslinux.cfg nor ACS override .... to make IOMMU work. Feb 21 04:44:53 Tower kernel: pci_bus 0000:40: Some PCI device resources are unassigned, try booting with pci=realloc Below is my log with grep AMD, FYR Quote Feb 22 07:03:50 X399 kernel: AMD-Vi: [Firmware Bug]: : IOAPIC[130] not in IVRS table Feb 22 07:03:50 X399 kernel: AMD-Vi: Disabling interrupt remapping Feb 22 07:03:50 X399 kernel: Spectre V2 : Mitigation: Full AMD retpoline Feb 22 07:03:50 X399 kernel: smpboot: CPU0: AMD Ryzen Threadripper 1920X 12-Core Processor (family: 0x17, model: 0x1, stepping: 0x1) Feb 22 07:03:50 X399 kernel: Performance Events: Fam17h+ core perfctr, AMD PMU driver. Feb 22 07:03:50 X399 kernel: pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported Feb 22 07:03:50 X399 kernel: pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40 Feb 22 07:03:50 X399 kernel: pci 0000:00:00.2: AMD-Vi: Extended features (0xf77ef22294ada): Feb 22 07:03:50 X399 kernel: AMD-Vi: Lazy IO/TLB flushing enabled Feb 22 07:03:50 X399 kernel: perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank). Feb 22 07:03:50 X399 kernel: AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <[email protected]> Edited February 21, 2021 by Vr2Io Quote Link to comment
Digiboy Posted February 22, 2021 Author Share Posted February 22, 2021 (edited) @Vr2Io Thanks for the continued help! Previously everything worked good, it's only the thing with IOMMU being disabled.. If it's any relevant to the case Unraid was first installed in a INTEL build without a GPU and has been moved over to this ryzen build instead. I have cleared everything in the syslinux.cfg file and also tried adding the "pci=realloc" but nothing changes When I do a grep for AMD or FYR I get this: for AMD [ 0.000000] AMD-Vi: Can not reserve memory region 0-80000 for mmio [ 0.001000] AMD-Vi: This is a BIOS bug. Please contact your hardware vendor [ 0.019749] Spectre V2 : Mitigation: Full AMD retpoline [ 0.127581] smpboot: CPU0: AMD Ryzen Threadripper 2970WX 24-Core Processor (family: 0x17, model: 0x8, stepping: 0x2) [ 0.127748] Performance Events: Fam17h core perfctr, AMD PMU driver. [ 10.470556] amd_uncore: AMD NB counters detected [ 10.470996] amd_uncore: AMD LLC counters detected [ 10.531432] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de> [ 10.531830] AMD IOMMUv2 functionality not available on this system FOR FYR nothing.. I saw a post about trying BIOS before ASGE 1.1.0.2 which i will try now. source for this: https://www.reddit.com/r/VFIO/comments/emcl54/psa_threadripper_iommu_on_x399_gigabyte_boards/ Edited February 22, 2021 by Digiboy Quote Link to comment
Digiboy Posted February 22, 2021 Author Share Posted February 22, 2021 Noticed that my old GTX580 cannot post with the older bios... only get a black screen, reverted to the newest bios again and the problem still exists.. Any more suggestions? Quote Link to comment
Vr2Io Posted February 22, 2021 Share Posted February 22, 2021 Sorry, no more idea. Quote Link to comment
Digiboy Posted February 22, 2021 Author Share Posted February 22, 2021 Hi again, Tried to read some logs and got this: @Tower:/var/log# cat dmesg | grep IOMMU [ 0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA [ 11.636704] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de> [ 11.637886] AMD IOMMUv2 functionality not available on this system @Tower:/var/log# cat dmesg | grep domain [ 0.220863] PCI: MMCONFIG for domain 0000 [bus 00-7f] at [mem 0xf0000000-0xf7ffffff] (base 0xf0000000) [ 0.451834] PCI: MMCONFIG for domain 0000 [bus 00-7f] at [mem 0xf0000000-0xf7ffffff] (base 0xf0000000) [ 0.468580] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-1f]) [ 0.498026] ACPI: PCI Root Bridge [S0D1] (domain 0000 [bus 20-3f]) [ 0.505362] ACPI: PCI Root Bridge [S0D2] (domain 0000 [bus 40-5f]) [ 0.519793] ACPI: PCI Root Bridge [S0D3] (domain 0000 [bus 60-ff]) [ 0.521256] acpi PNP0A08:03: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-7f] only partially covers this bridge @Tower:/var/log# cat dmesg | grep driver [ 0.000000] Command line: BOOT_IMAGE=/bzimage amd_iommu=on iommu=pt pcie_acs_override=downstream vfio_iommu_type1.allow_unsafe_interrupts=1 kvm.ignore_msrs=1 rd.driver.pre=vfio-pci initrd=/bzroot [ 0.000000] Kernel command line: BOOT_IMAGE=/bzimage amd_iommu=on iommu=pt pcie_acs_override=downstream vfio_iommu_type1.allow_unsafe_interrupts=1 kvm.ignore_msrs=1 rd.driver.pre=vfio-pci initrd=/bzroot [ 0.128750] Performance Events: Fam17h core perfctr, AMD PMU driver. [ 0.535213] usbcore: registered new interface driver usbfs [ 0.535751] usbcore: registered new interface driver hub [ 0.535956] usbcore: registered new device driver usb [ 11.584722] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) [ 11.606839] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled [ 11.633667] lp: driver loaded but no devices found [ 11.636704] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de> [ 11.655876] VFIO - User Level meta-driver version: 0.3 [ 11.658520] ehci-pci: EHCI PCI platform driver [ 11.660949] ohci-pci: OHCI PCI platform driver [ 11.662189] uhci_hcd: USB Universal Host Controller Interface driver [ 11.905325] usbcore: registered new interface driver usb-storage [ 11.909253] usbcore: registered new interface driver synaptics_usb [ 11.932849] hidraw: raw HID events driver (C) Jiri Kosina [ 11.934275] usbcore: registered new interface driver usbhid [ 11.935442] usbhid: USB HID core driver [ 11.937524] ipip: IPv4 and MPLS over IPv4 tunneling driver [ 11.938525] gre: GRE over IPv4 demultiplexor driver [ 11.939765] ip_gre: GRE over IPv4 tunneling driver [ 11.941132] IPv4 over IPsec tunneling driver [ 11.945275] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver Does this perhaps mean that it only supports IOMMUv2 and that maybe aint supported on the moba? Quote Link to comment
Digiboy Posted February 25, 2021 Author Share Posted February 25, 2021 solved it myself, PM me if anyone else needs some help regarding this or similiar since I have been doing this for about 3 days I have seen a lot of different fixes Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.