k0vw

Thanks very much for the reply. So i just rebuild the drives on itself and it should be fine? I'll just keep an eye on them. I think it's time to remove the smaller drives and upgrade to some big boys

Hello, I've run into an issue with my unraid build. I was recently removing some un-needed hardware from my box and on reboot I found 2 drives disabled. I can see the drives in the bios on boot but they're only emulated once I actually get into unraid. I've changed the power and SATA cables to the drives and swapped with known working ones. Issue remains. Are my drives cooked? Thanks opti-diagnostics-20240220-1339.zip

Yeah that one... So i've found the issue. It was the FLR on 2e.00.0 which is the non essential device. I'd been told that i needed to pass that through for the usb to work and was doing that when i had my 2600 installed. Just passing through the USB works fine. Thanks so much for your help mate. Really appreciate it.

Yeah thats the USB Im trying to pass through. Very frustrating.

Done. The ones ticked in the system devices are still the same. Rebooted the system and tried to start the VM. Same issue. I did go to the logs right away and saw this Jun 16 19:05:44 Opti kernel: clocksource: Switched to clocksource hpet Jun 16 19:05:55 Opti kernel: vfio-pci 0000:2e:00.0: not ready 1023ms after FLR; waiting Jun 16 19:05:58 Opti kernel: vfio-pci 0000:2e:00.0: not ready 2047ms after FLR; waiting Jun 16 19:06:01 Opti kernel: vfio-pci 0000:2e:00.0: not ready 4095ms after FLR; waiting Jun 16 19:06:06 Opti kernel: vfio-pci 0000:2e:00.0: not ready 8191ms after FLR; waiting Had to reboot the server again opti-syslog-20210616-0907.zip

Yes i've added append pcie_no_flr=1022:1485,1022:1486,1022:149c,1022:1487 vfio-pci.ids=1022:1485,1022:1486,1022:149c,1022:1487

Yeah sorry I cant click on the VM logs. The system just begins to freeze and pins all CPU cores to 100%. I just tried to start the VM to see if i could see the logs so this system log is quite short. opti-syslog-20210616-0852.zip

Please see the attached screenshot. Sorry how would i access the log files? Once i try to start the VM im unable to click the VM icon and go to logs. The sever begins to freeze and crashes.

Yeah I'm on the latest bios for my board. Sorry im not sure if this is the easiest way to do what you asked. IOMMU group 0: [1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 1: [1022:1483] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 2: [1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 3: [1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 4: [1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 5: [1022:1483] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge IOMMU group 6: [1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 7: [1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 8: [1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 9: [1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 10: [1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge IOMMU group 11: [1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 12: [1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 13: [1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] IOMMU group 14: [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61) [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) IOMMU group 15: [1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0 [1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1 [1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2 [1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3 [1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4 [1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5 [1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6 [1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7 IOMMU group 16: [1022:43d0] 03:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43d0 (rev 01) Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 001 Device 002: ID 0781:5567 SanDisk Corp. Cruzer Blade Bus 001 Device 003: ID 046b:ff01 American Megatrends, Inc. Virtual Hub Bus 001 Device 004: ID 046b:ff20 American Megatrends, Inc. Virtual Cdrom Device Bus 001 Device 005: ID 046b:ff31 American Megatrends, Inc. Virtual HardDisk Device Bus 001 Device 006: ID 046b:ffb0 American Megatrends, Inc. Virtual Ethernet Bus 001 Device 007: ID 046b:ff40 American Megatrends, Inc. Virtual Floppy Device Bus 001 Device 008: ID 046b:ff10 American Megatrends, Inc. Virtual Keyboard and Mouse Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub [1022:43c8] 03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset SATA Controller (rev 01) [4:0:0:0] disk ATA WDC WDS100T2G0A- 40WD /dev/sdd 1.00TB [5:0:0:0] disk ATA WDC WDS240G2G0A- 0000 /dev/sde 240GB [6:0:0:0] disk ATA ST3000DM007-1WY1 0001 /dev/sdf 3.00TB [7:0:0:0] disk ATA ST3000DM007-1WY1 0001 /dev/sdg 3.00TB [10:0:0:0] disk ATA ST3000DM007-1WY1 0001 /dev/sdh 3.00TB [11:0:0:0] disk ATA ST8000DM004-2CX1 0001 /dev/sdi 8.00TB [1022:43c6] 03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Bridge (rev 01) [1022:43c7] 20:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 20:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 20:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 20:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 20:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1022:43c7] 20:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 400 Series Chipset PCIe Port (rev 01) [1a03:1150] 21:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 04) [1a03:2000] 22:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) [8086:1533] 23:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03) [8086:1533] 24:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03) [1b21:0612] 25:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller (rev 02) [13:0:0:0] disk ATA ST8000DM004-2CX1 0001 /dev/sdj 8.00TB IOMMU group 17: [10de:1c82] 2b:00.0 VGA compatible controller: NVIDIA Corporation GP107 [GeForce GTX 1050 Ti] (rev a1) [10de:0fb9] 2b:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev a1) IOMMU group 18: [10de:1cb3] 2c:00.0 VGA compatible controller: NVIDIA Corporation GP107GL [Quadro P400] (rev a1) [10de:0fb9] 2c:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev a1) IOMMU group 19: [1022:148a] 2d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function IOMMU group 20: [1022:1485] 2e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP IOMMU group 21: [1022:1486] 2e:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP IOMMU group 22: [1022:149c] 2e:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller This controller is bound to vfio, connected USB devices are not visible. IOMMU group 23: [1022:1487] 2e:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller IOMMU group 24: [1022:7901] 30:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 25: [1022:7901] 31:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) The attached image is the USB that I'm trying to passthrough (20-23). Thank you so much for your help. I really appreciate it.

Yeah it's the drivers that have changed i think? They're now the USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller that everyone has been having trouble with. The groups themselves haven't changed. I've deleted the VFIO config file from the USB and tried to rebuild it but still having the same issues no matter what. It's killing me haha

Hello, I'm having the same issues with passing through USB controllers with a Asrock Rack x470d4u and Ryzen 3900x. I'm running unraid version 6.9.2 and was able to passthrough the usb controller with my 2600 installed but after upgrading to the 3900x I'm running into the freeze issue. Would a custom kernal help with this problem do you know? Thanks

Ok thanks for that. I seem to be having a different issue then. My setup worked fine with a Ryzen 2600 on my asrock rack x470d4u. When i upgraded to a 3900x I havent been able to pass through any usb controllers. My whole unraid server will freeze up and need a reboot.

Hey mattz, I've found a few of your posts in trying to search for a result to my issue and I think it's very similar to what you were having. Is your USB controller passthrough working correctly now? I have an ASRock rack x470d4u and recently upgraded to a 3900x from a 2600. I've managed to get my VM to boot with a GPU passed through to it but cannot get the USB controller through to save myself. Any tips?