Spritzup Posted March 29, 2020 Share Posted March 29, 2020 Hey all, So what better way to spend some social isolation by building myself (and the wife) a new unRaid box. The dual 2670's were starting to get long in the tooth, especially with friends and family slamming plex to keep their sanity during this trying time. So what should have been a leisurely build has devolved into a gong show... I had got cocky with to much success with various builds between home and work, and the compute gods have decided to punish me Anyways, onto the specs first and then the issue's --> Threadripper WX2970 Gigagebyte X399 Designware 64GB PC3200 Crucial Ballistix 2x WD Black 750 m2.nvme (500GB) evga 1300 Watt PSU nvidia GTX 1060 (6gb) nvidia 1660 (6gb) Radeon 570 (4GB) The intent for the build was to break unRaid into two boxes. The new one would host parity, cache, and the 2x virtualized desktops. The 1660 would be used for Plex to do transcoding (and therefore is the unRaid video card). Then using an HBA I'd connect to my old Norco-4224 and that's where the 24-date drives would live... I have not got to the second part of this plan, which is why no HBA or data drives are listed. It should also be noted that with the previous build I had successfully built and was using a gaming PC. Anyways, onto the issue's --> 1. Creating the VM's while passing through the motherboards USB ports 2. Passing through the WD Black drives (though, what kind of performance hit would it be to just use it as a raw virtual disk) 3. Passing through the GTX1060 The symptoms are basically the same, build the VM, try and boot and the entire system hangs. I tried building a more basic system, only trying to pass through the WD, but I couldn't install Windows to it. Deleted the VM, and then the drive was gone from unRaid and the bios. Multiple reboots and resetting the bios finally got things back. Essentially at this point, if it can go wrong with building the VM's, it has gone wrong. Model: Custom M/B: Gigabyte Technology Co., Ltd. X399 DESIGNARE EX-CF Version x.x - s/n: Default string BIOS: American Megatrends Inc. Version F12. Dated: 12/11/2019 CPU: AMD Ryzen Threadripper 2970WX 24-Core @ 3000 MHz HVM: Enabled IOMMU: Enabled Cache: 2304 KiB, 12288 KiB, 65536 KiB Memory: 64 GiB DDR4 (max. installable capacity 512 GiB) Network: bond0: IEEE 802.3ad Dynamic link aggregation, mtu 1500 eth0: interface down eth1: interface down eth2: 1000 Mbps, full duplex, mtu 1500 eth3: 1000 Mbps, full duplex, mtu 1500 Kernel: Linux 4.19.107-Unraid x86_64 OpenSSL: 1.1.1d IOMMU group 0: [1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 1: [1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 2: [1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 3: [1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 4: [1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 5: [1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 6: [1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 7: [1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 8: [1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 9: [1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 10: [1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 11: [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59) [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51) IOMMU group 12: [1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 13: [1022:1460] 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 14: [1022:1460] 00:1a.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:1a.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:1a.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:1a.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:1a.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:1a.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:1a.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:1a.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 15: [1022:1460] 00:1b.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1461] 00:1b.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1462] 00:1b.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1463] 00:1b.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1464] 00:1b.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1465] 00:1b.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1466] 00:1b.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6 [1022:1467] 00:1b.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 IOMMU group 16: [1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02) [1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02) [1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02) [1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) [8086:24fd] 05:00.0 Network controller: Intel Corporation Wireless 8265 / 8275 (rev 78) [8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) [8086:105e] 07:00.0 Ethernet controller: Intel Corporation 82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications) (rev 06) [8086:105e] 07:00.1 Ethernet controller: Intel Corporation 82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications) (rev 06) IOMMU group 17: [10de:2184] 08:00.0 VGA compatible controller: NVIDIA Corporation TU116 [GeForce GTX 1660] (rev a1) [10de:1aeb] 08:00.1 Audio device: NVIDIA Corporation TU116 High Definition Audio Controller (rev a1) [10de:1aec] 08:00.2 USB controller: NVIDIA Corporation Device 1aec (rev a1) [10de:1aed] 08:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU116 [GeForce GTX 1650 SUPER] (rev a1) IOMMU group 18: [1002:67df] 09:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480/570/570X/580/580X/590] (rev ef) [1002:aaf0] 09:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590] IOMMU group 19: [1022:145a] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function IOMMU group 20: [1022:1456] 0a:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 21: [1022:145f] 0a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 Host controller IOMMU group 22: [1022:1455] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function IOMMU group 23: [1022:7901] 0b:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 24: [1022:1452] 20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 25: [1022:1452] 20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 26: [1022:1452] 20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 27: [1022:1452] 20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 28: [1022:1452] 20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 29: [1022:1454] 20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 30: [1022:1452] 20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 31: [1022:1454] 20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 32: [1022:145a] 21:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function IOMMU group 33: [1022:1456] 21:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 34: [1022:1455] 22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function IOMMU group 35: [1022:1452] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 36: [1022:1453] 40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 37: [1022:1453] 40:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 38: [1022:1452] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 39: [1022:1452] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 40: [1022:1453] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge IOMMU group 41: [1022:1452] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 42: [1022:1452] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 43: [1022:1454] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 44: [1022:1452] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 45: [1022:1454] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 46: [15b7:5002] 41:00.0 Non-Volatile memory controller: Sandisk Corp WD Black 2018/PC SN720 NVMe SSD IOMMU group 47: [15b7:5002] 42:00.0 Non-Volatile memory controller: Sandisk Corp WD Black 2018/PC SN720 NVMe SSD IOMMU group 48: [10de:1c03] 43:00.0 VGA compatible controller: NVIDIA Corporation GP106 [GeForce GTX 1060 6GB] (rev a1) [10de:10f1] 43:00.1 Audio device: NVIDIA Corporation GP106 High Definition Audio Controller (rev a1) IOMMU group 49: [1022:145a] 44:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function IOMMU group 50: [1022:1456] 44:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 51: [1022:145f] 44:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 Host controller IOMMU group 52: [1022:1455] 45:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function IOMMU group 53: [1022:7901] 45:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) IOMMU group 54: [1022:1452] 60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 55: [1022:1452] 60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 56: [1022:1452] 60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 57: [1022:1452] 60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 58: [1022:1452] 60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 59: [1022:1454] 60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 60: [1022:1452] 60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge IOMMU group 61: [1022:1454] 60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B IOMMU group 62: [1022:145a] 61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function IOMMU group 63: [1022:1456] 61:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor IOMMU group 64: [1022:1455] 62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function CPU Thread Pairings Pair 1: cpu 0 / cpu 24 Pair 2: cpu 1 / cpu 25 Pair 3: cpu 2 / cpu 26 Pair 4: cpu 3 / cpu 27 Pair 5: cpu 4 / cpu 28 Pair 6: cpu 5 / cpu 29 Pair 7: cpu 6 / cpu 30 Pair 8: cpu 7 / cpu 31 Pair 9: cpu 8 / cpu 32 Pair 10: cpu 9 / cpu 33 Pair 11: cpu 10 / cpu 34 Pair 12: cpu 11 / cpu 35 Pair 13: cpu 12 / cpu 36 Pair 14: cpu 13 / cpu 37 Pair 15: cpu 14 / cpu 38 Pair 16: cpu 15 / cpu 39 Pair 17: cpu 16 / cpu 40 Pair 18: cpu 17 / cpu 41 Pair 19: cpu 18 / cpu 42 Pair 20: cpu 19 / cpu 43 Pair 21: cpu 20 / cpu 44 Pair 22: cpu 21 / cpu 45 Pair 23: cpu 22 / cpu 46 Pair 24: cpu 23 / cpu 47 USB Devices Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 001 Device 002: ID 8087:0a2b Intel Corp. Bus 001 Device 003: ID 2109:2813 VIA Labs, Inc. USB2.0 Hub Bus 001 Device 004: ID 2109:2813 VIA Labs, Inc. Bus 001 Device 005: ID 2109:2811 VIA Labs, Inc. Hub Bus 001 Device 006: ID 0955:7214 NVIDIA Corp. Bus 001 Device 007: ID 2109:2811 VIA Labs, Inc. Hub Bus 001 Device 008: ID 1038:12ad SteelSeries ApS Bus 001 Device 009: ID 046d:c338 Logitech, Inc. Bus 001 Device 010: ID 046d:c332 Logitech, Inc. G502 Proteus Spectrum Optical Mouse Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 002 Device 002: ID 0781:5583 SanDisk Corp. Ultra Fit Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub SCSI Devices [0:0:0:0] disk SanDisk Ultra Fit 1.00 /dev/sda 15.3GB [1:0:0:0] disk ATA ST8000NC0002-1XX CN02 /dev/sdb 8.00TB [2:0:0:0] disk ATA Crucial_CT512MX1 MU01 /dev/sdc 512GB [3:0:0:0] disk ATA ST8000NC0002-1XX CN02 /dev/sdd 8.00TB Any help will be appreciated, and let me know what else I can do to help myself. The system is pretty barebones right now. Thanks! ~Spritz Quote Link to comment
testdasi Posted March 30, 2020 Share Posted March 30, 2020 11 hours ago, Spritzup said: The symptoms are basically the same, build the VM, try and boot and the entire system hangs. I tried building a more basic system, only trying to pass through the WD, but I couldn't install Windows to it. Deleted the VM, and then the drive was gone from unRaid and the bios. Multiple reboots and resetting the bios finally got things back. Essentially at this point, if it can go wrong with building the VM's, it has gone wrong. By "gone" from "the bios", you mean the motherboard BIOS? And then you have to reset the motherboard bios multiple times for it to come back? That shouldn't happen. Whatever you do in Unraid should not cause any device to disappear from the motherboard BIOS. Your system info shows F12 BIOS but with an older date than the F12 BIOS shown on the Gigabyte website so I would suggest try to update your BIOS first. Then remount all the M.2 since the heatsink can obscure any mounting issue. That is assuming nothing is wrong with them / the motherboard to begin with. Then as a last resort, I have my working F12e BIOS that I am running on (attached). Try using that instead - but MAKE SURE to backup your current BIOS first and have it ready - (see the manual for the instructions on Q-Flash Plus. It can restore your BIOS even with both chips corrupted but the usb stick, file system and file name have to be very specific). What it shows on your hardware info screen is also a little different from mine. Yours: Gigabyte Technology Co., Ltd. X399 DESIGNARE EX-CF Version x.x - s/n: Default string Mine: Gigabyte Technology Co., Ltd. X399 DESIGNARE EX-CF Version Default string - s/n: Default string Wonder if that's due to the different BIOS version or something. mb_bios_x399-designare-ex_f12e.zip Quote Link to comment
Spritzup Posted March 30, 2020 Author Share Posted March 30, 2020 (edited) Thanks for the reply @testdasi, it's very much appreciated. I wholly agree, changes within unRaid should not affect the motherboard bios, but it's what occured. Perhaps the drives overheated, but they're back now so just something to monitor. Also, good catch on the bios, however it still shows the same date... perhaps build vs release date. Model: Custom M/B: Gigabyte Technology Co., Ltd. X399 DESIGNARE EX-CF Version x.x - s/n: Default string BIOS: American Megatrends Inc. Version F12. Dated: 12/11/2019 CPU: AMD Ryzen Threadripper 2970WX 24-Core @ 3000 MHz HVM: Enabled IOMMU: Enabled Cache: 2304 KiB, 12288 KiB, 65536 KiB Memory: 64 GiB DDR4 (max. installable capacity 512 GiB) Network: bond0: IEEE 802.3ad Dynamic link aggregation, mtu 1500 eth0: interface down eth1: interface down eth2: 1000 Mbps, full duplex, mtu 1500 eth3: 1000 Mbps, full duplex, mtu 1500 Kernel: Linux 4.19.107-Unraid x86_64 Would you be willing to share your bios settings? Did you have luck passing through a USB controller? Thanks! ~Spritz Edited March 30, 2020 by Spritzup Quote Link to comment
testdasi Posted March 30, 2020 Share Posted March 30, 2020 I suspect it's BIOS then. Last time I tested a BIOS after F12e (which was F12i), the instability was unusable. In terms of BIOS settings, I don't change much. Everything is stock except: Enable SVM Enable IOMMU Adjust boot order Disable Precision Boost <-- normal boost is fine but PB has caused some instability Enable Global C State Control <-- the old advice is to disable this but I found disabling it make things even more unstable + terrible performance hit so I recommend either leave it at Auto or Enable it. That's it. Quote Link to comment
Spritzup Posted March 30, 2020 Author Share Posted March 30, 2020 Thanks again for the reply @testdasi, I'll verify my bios settings. What did you passthrough to your VM's? ~Spritz Quote Link to comment
testdasi Posted March 30, 2020 Share Posted March 30, 2020 (edited) 27 minutes ago, Spritzup said: Thanks again for the reply @testdasi, I'll verify my bios settings. What did you passthrough to your VM's? ~Spritz Things I have passed through at one point on another: Both onboard USB 3.0 controllers (there are 2 controllers and each can be individually passed through to different VM's) GPU on 1st PCIe slot (including right now when I'm running single GPU) GPU on 3rd PCIe slot (the slow PCIe 2.0 x4 slot) NVMe AIC on 2nd, 3rd, 4th, 5th PCIe slot x16 -> 4x M.2 breakout card on 4th PCIe slot (I use the Asus Hyper M.2 v2 card) All M.2 slots Onboard Audio There are 2 things that I haven't had success with (but I haven't retried since my first failed attempt originally when the server was at its infancy) USB 3.1 onboard controller. The internal USB 2.0 (which my Unraid USB stick is plugged into) + red USB + type C are all on this controller. Even without the Unraid stick on this controller, it just can't be passed through. Onboard Wifi - it can be passed through but doesn't actually work once passed through. Not sure why but since I don't need Wifi, I have never put in any effort to make it work. Things I haven't tried at all: The onboard wired LAN. Edited March 30, 2020 by testdasi Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.