I had an error on my parity disk so I changed it to another drive and have been trying to rebuild it and my server just keep freezing up (requires a hard reboot) when the parity is rebuild is running. 

I had the array started in maintenance mode too. I was also mirroring the syslog into the flash drive but don't see any errors in the syslog.

 

Here is my diagnostics from a couple days ago.

 

I have two mini sas controller cards in the machine: LSI Logic SAS9211-8I 8PORT Int 6GB Sata+SAS Pcie 2.0 & SAS9211-8I 8PORT Int 6GB Sata+SAS Pcie 2.0 and tried replacing sata cables and moving cables to different cards but still the same result.

 

Been trying since last week and very frustrated.

media-diagnostics-20230325-2255.zip

Edited March 29, 20233 yr by dandiodati

Without anything logged difficult to guess, looks more like a hardware issue, you can try updating to v6.12-rc2, if it's kernel related the newer one might help, if it's the same it's likely hardware.

So I have been running this hardware setup for over a year so a bit surprising that some hardware is incompatible. 

Could someone still take a look at my diagnostics quickly to see if there is some error or issue that I did not see ?

 

I'm running on 

Gigabyte Technology Co., Ltd. TRX40 AORUS PRO WIFI , Version x.x

American Megatrends Inc., Version FA

BIOS dated: Wed 01 Jul 2020 12:00:00 AM PDT

AMD Ryzen Threadripper 3960X 24-Core @ 3800 MHz

 

128 GB DDR4

 

If there are any hints to help be figure out what the error is that would be great, I have not had my server started due to the parity being down.

Attaching a new diagnostics just as I started the parity rebuild it case it helps.

 

I'll also try jumping up to the latest rc version to see if it helps any.

My system devices are the following:

IOMMU group 0:[1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 1:[1022:1483] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 2:[1022:1483] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 3:[1022:1483] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 4:[1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 5:[1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 6:[1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 7:[1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 8:[1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 9:[1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 10:[1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 11:[1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 12:[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)

[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)

IOMMU group 13:[1022:1490] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0

[1022:1491] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1

[1022:1492] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2

[1022:1493] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3

[1022:1494] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4

[1022:1495] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5

[1022:1496] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6

[1022:1497] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7

IOMMU group 14:[144d:a80a] 01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

[N:0:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme0n1 2.00TB

IOMMU group 15:[1987:5012] 02:00.0 Non-Volatile memory controller: Phison Electronics Corporation E12 NVMe Controller (rev 01)

[N:1:1:1] disk Corsair MP400__1 /dev/nvme1n1 8.00TB

IOMMU group 16:[1000:0072] 03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

[3:0:0:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdc 6.00TB

[3:0:1:0] disk ATA ST14000NM001G-2K SN03 /dev/sdd 14.0TB

[3:0:2:0] disk ATA ST14000NM001G-2K SN03 /dev/sde 14.0TB

[3:0:3:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdf 6.00TB

[3:0:4:0] disk ATA ST14000NM001G-2K SN03 /dev/sdg 14.0TB

[3:0:5:0] disk ATA ST14000NM001G-2K SN03 /dev/sdh 14.0TB

[3:0:6:0] disk ATA ST14000NM001G-2K SN03 /dev/sdi 14.0TB

IOMMU group 17:[1022:148a] 04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function

IOMMU group 18:[1022:1485] 05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP

IOMMU group 19:[1022:148c] 05:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller

Bus 001 Device 001 Port 1-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 002 Device 001 Port 2-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 002 Device 002 Port 2-2 ID 21c4:0cd1 Lexar USB Flash Drive

IOMMU group 20:[1022:1482] 20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 21:[1022:1482] 20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 22:[1022:1482] 20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 23:[1022:1483] 20:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 24:[1022:1482] 20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 25:[1022:1482] 20:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 26:[1022:1482] 20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 27:[1022:1484] 20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 28:[1022:1482] 20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 29:[1022:1484] 20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 30:[10de:128b] 21:00.0 VGA compatible controller: NVIDIA Corporation GK208B [GeForce GT 710] (rev a1)

[10de:0e0f] 21:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)

IOMMU group 31:[1022:148a] 22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function

IOMMU group 32:[1022:1485] 23:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP

IOMMU group 33:[1022:1486] 23:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP

IOMMU group 34:[1022:148c] 23:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller

Bus 003 Device 001 Port 3-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 004 Device 001 Port 4-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

IOMMU group 35:[1022:1487] 23:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller

IOMMU group 36:[1022:1482] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 37:[1022:1483] 40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 38:[1022:1483] 40:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 39:[1022:1482] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 40:[1022:1482] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 41:[1022:1483] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 42:[1022:1483] 40:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 43:[1022:1483] 40:03.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 44:[1022:1483] 40:03.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge

IOMMU group 45:[1022:1482] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 46:[1022:1482] 40:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 47:[1022:1482] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 48:[1022:1484] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 49:[1022:1482] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 50:[1022:1484] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 51:[1022:57ad] 41:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream

IOMMU group 52:[1022:57a3] 42:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

IOMMU group 53:[1022:57a3] 42:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

IOMMU group 54:[1022:57a3] 42:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

IOMMU group 55:[1022:57a4] 42:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

[1022:1485] 46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP

[1022:149c] 46:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller

Bus 005 Device 001 Port 5-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 005 Device 002 Port 5-4 ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 005 Device 003 Port 5-5 ID 0414:a002 Giga-Byte Technology Co., Ltd USB Audio

Bus 005 Device 004 Port 5-4.1 ID 04d9:1603 Holtek Semiconductor, Inc. Keyboard

Bus 005 Device 005 Port 5-4.2 ID 0764:0501 Cyber Power System, Inc. CP1500 AVR UPS

Bus 005 Device 006 Port 5-4.3 ID 0bda:8771 Realtek Semiconductor Corp. Bluetooth Radio

Bus 005 Device 007 Port 5-6 ID 048d:8297 Integrated Technology Express, Inc. IT8297 RGB LED Controller

Bus 006 Device 001 Port 6-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

[1022:149c] 46:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller

Bus 007 Device 001 Port 7-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 007 Device 002 Port 7-5 ID 8087:0029 Intel Corp. AX200 Bluetooth

Bus 007 Device 003 Port 7-6 ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 008 Device 001 Port 8-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

IOMMU group 56:[1022:57a4] 42:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

[1022:7901] 47:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

IOMMU group 57:[1022:57a4] 42:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge

[1022:7901] 48:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

[2:0:0:0] disk ATA Samsung SSD 870 1B6Q /dev/sdb 1.00TB

IOMMU group 58:[144d:a80a] 43:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

[N:2:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme2n1 2.00TB

IOMMU group 59:[8086:1539] 44:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)

IOMMU group 60:[8086:2723] 45:00.0 Network controller: Intel Corporation Wi-Fi 6 AX200 (rev 1a)

IOMMU group 61:[1000:0072] 49:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

[4:0:0:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdj 6.00TB

[4:0:1:0] disk ATA ST6000VN0041-2EL SC61 /dev/sdk 6.00TB

[4:0:2:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdl 6.00TB

[4:0:3:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdm 6.00TB

[4:0:4:0] disk ATA ST6000VN0041-2EL SC61 /dev/sdn 6.00TB

[4:0:5:0] disk ATA ST14000NM001G-2K SN03 /dev/sdo 14.0TB

[4:0:6:0] disk ATA ST14000NM001G-2K SN03 /dev/sdp 14.0TB

[4:0:7:0] disk ATA ST6000VN0033-2EE SC60 /dev/sdq 6.00TB

IOMMU group 62:[1987:5016] 4a:00.0 Non-Volatile memory controller: Phison Electronics Corporation E16 PCIe4 NVMe Controller (rev 01)

[N:3:1:1] disk Viper M.2 VP4100__1 /dev/nvme3n1 2.00TB

IOMMU group 63:[1987:5016] 4b:00.0 Non-Volatile memory controller: Phison Electronics Corporation E16 PCIe4 NVMe Controller (rev 01)

[N:4:1:1] disk Viper M.2 VP4100__1 /dev/nvme4n1 2.00TB

IOMMU group 64:[1987:5016] 4c:00.0 Non-Volatile memory controller: Phison Electronics Corporation E16 PCIe4 NVMe Controller (rev 01)

[N:5:1:1] disk Viper M.2 VP4100__1 /dev/nvme5n1 2.00TB

IOMMU group 65:[1987:5016] 4d:00.0 Non-Volatile memory controller: Phison Electronics Corporation E16 PCIe4 NVMe Controller (rev 01)

[N:6:1:1] disk Viper M.2 VP4100__1 /dev/nvme6n1 2.00TB

IOMMU group 66:[1022:148a] 4e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function

IOMMU group 67:[1022:1485] 4f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP

IOMMU group 68:[1022:1482] 60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 69:[1022:1482] 60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 70:[1022:1482] 60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 71:[1022:1482] 60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 72:[1022:1482] 60:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 73:[1022:1482] 60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 74:[1022:1484] 60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 75:[1022:1482] 60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge

IOMMU group 76:[1022:1484] 60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]

IOMMU group 77:[1022:148a] 61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function

IOMMU group 78:[1022:1485] 62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP





CPU Thread Pairings

Pair 1:cpu 0 / cpu 24

Pair 2:cpu 1 / cpu 25

Pair 3:cpu 2 / cpu 26

Pair 4:cpu 3 / cpu 27

Pair 5:cpu 4 / cpu 28

Pair 6:cpu 5 / cpu 29

Pair 7:cpu 6 / cpu 30

Pair 8:cpu 7 / cpu 31

Pair 9:cpu 8 / cpu 32

Pair 10:cpu 9 / cpu 33

Pair 11:cpu 10 / cpu 34

Pair 12:cpu 11 / cpu 35

Pair 13:cpu 12 / cpu 36

Pair 14:cpu 13 / cpu 37

Pair 15:cpu 14 / cpu 38

Pair 16:cpu 15 / cpu 39

Pair 17:cpu 16 / cpu 40

Pair 18:cpu 17 / cpu 41

Pair 19:cpu 18 / cpu 42

Pair 20:cpu 19 / cpu 43

Pair 21:cpu 20 / cpu 44

Pair 22:cpu 21 / cpu 45

Pair 23:cpu 22 / cpu 46

Pair 24:cpu 23 / cpu 47



USB Devices

Bus 001 Device 001 Port 1-0ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 002 Device 001 Port 2-0ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 002 Device 002 Port 2-2ID 21c4:0cd1 Lexar USB Flash Drive

Bus 003 Device 001 Port 3-0ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 004 Device 001 Port 4-0ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 005 Device 001 Port 5-0ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 005 Device 002 Port 5-4ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 005 Device 003 Port 5-5ID 0414:a002 Giga-Byte Technology Co., Ltd USB Audio

Bus 005 Device 004 Port 5-4.1ID 04d9:1603 Holtek Semiconductor, Inc. Keyboard

Bus 005 Device 005 Port 5-4.2ID 0764:0501 Cyber Power System, Inc. CP1500 AVR UPS

Bus 005 Device 006 Port 5-4.3ID 0bda:8771 Realtek Semiconductor Corp. Bluetooth Radio

Bus 005 Device 007 Port 5-6ID 048d:8297 Integrated Technology Express, Inc. IT8297 RGB LED Controller

Bus 006 Device 001 Port 6-0ID 1d6b:0003 Linux Foundation 3.0 root hub

Bus 007 Device 001 Port 7-0ID 1d6b:0002 Linux Foundation 2.0 root hub

Bus 007 Device 002 Port 7-5ID 8087:0029 Intel Corp. AX200 Bluetooth

Bus 007 Device 003 Port 7-6ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 008 Device 001 Port 8-0ID 1d6b:0003 Linux Foundation 3.0 root hub



SCSI Devices

[0:0:0:0]disk Lexar USB Flash Drive 1100 /dev/sda 61.8GB

[2:0:0:0]disk ATA Samsung SSD 870 1B6Q /dev/sdb 1.00TB

[3:0:0:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdc 6.00TB

[3:0:1:0]disk ATA ST14000NM001G-2K SN03 /dev/sdd 14.0TB

[3:0:2:0]disk ATA ST14000NM001G-2K SN03 /dev/sde 14.0TB

[3:0:3:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdf 6.00TB

[3:0:4:0]disk ATA ST14000NM001G-2K SN03 /dev/sdg 14.0TB

[3:0:5:0]disk ATA ST14000NM001G-2K SN03 /dev/sdh 14.0TB

[3:0:6:0]disk ATA ST14000NM001G-2K SN03 /dev/sdi 14.0TB

[4:0:0:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdj 6.00TB

[4:0:1:0]disk ATA ST6000VN0041-2EL SC61 /dev/sdk 6.00TB

[4:0:2:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdl 6.00TB

[4:0:3:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdm 6.00TB

[4:0:4:0]disk ATA ST6000VN0041-2EL SC61 /dev/sdn 6.00TB

[4:0:5:0]disk ATA ST14000NM001G-2K SN03 /dev/sdo 14.0TB

[4:0:6:0]disk ATA ST14000NM001G-2K SN03 /dev/sdp 14.0TB

[4:0:7:0]disk ATA ST6000VN0033-2EE SC60 /dev/sdq 6.00TB

[N:0:6:1]disk Samsung SSD 980 PRO 2TB__1 /dev/nvme0n1 2.00TB

[N:1:1:1]disk Corsair MP400__1 /dev/nvme1n1 8.00TB

[N:2:6:1]disk Samsung SSD 980 PRO 2TB__1 /dev/nvme2n1 2.00TB

[N:3:1:1]disk Viper M.2 VP4100__1 /dev/nvme3n1 2.00TB

[N:4:1:1]disk Viper M.2 VP4100__1 /dev/nvme4n1 2.00TB

[N:5:1:1]disk Viper M.2 VP4100__1 /dev/nvme5n1 2.00TB

[N:6:1:1]disk Viper M.2 VP4100__1 /dev/nvme6n1 2.00TB

 

media-diagnostics-20230329-0934.zip

11 minutes ago, dandiodati said:

Could someone still take a look at my diagnostics quickly to see if there is some error or issue that I did not see ?

Syslog in the diags starts over after every boot, if like you mentioned there's nothing logged from the crash on the persistent syslog there's not much to see in the regular diags, but I agree that if this hardware was working before with the same Unraid release then it's not a compatibility issue, it's most likely a hardware problem, start by checking fans/temps, PSU would also be a suspect.

Still struggling with getting the parity disk rebuild. I've tried to remove all the ram and only keep one stick, then tried moving drives to different to another controller card, changed all sas to sata cables, switch the PSU, and changed the icydock cage that I was using for the drives, removed all extra drives to only the 6 disks (with parity) that I have been trying to rebuild, updated to the latest bios, and Have been trying to change bios settings (turn off the global-C states, change memory speed to 3200.

 

Any other settings on my board that may be a possible problem ?

Gigabyte Technology Co., Ltd. TRX40 AORUS PRO WIFI , Version x.x

American Megatrends Inc., Version FD

AMD Ryzen Threadripper 3960X 24-Core @ 3800 MHz

 

Anyone have any other ideas that I can try ? Or know about known issues with Ryzen threadripper and gigabtye board ?

Kicked off another run and added diagnostics again

 

media-diagnostics-20230404-2236.zip

There's nothing in the log, enable the syslog server and post that to see if it catches something.

Ok I finally figured it out the hardware issue that was causing it. I changed the cpu clock speed from 38 to 37.50 and that made the parity rebuild make it through without freezing.

Strange the cpu (AMD Ryzen Threadripper 3960X 24-Core @ 3800 MHz) is rated at 3800mhz so should be able to run at 38 setting which as set to auto before and was not overclocking it, but it seems to cause issues on this gigabtye motherboard. 

 

Dropping it down a bit seem to fix the issue. Plan to try 37.75 too.

 

 

Edited April 6, 20233 yr by dandiodati

Ok so had issues again an it turns out had to disable the C-states and the DF states in the bios to get rid of the freezing issues with the amd threadripper.

 

I upped the speed back up to 3800mhz and increased memory speed to 3000 and seems to be stable still. So seems to have been issues with the DF states also not being off.