Server crash during Parity-Check 6.x

MrNobodie · May 4, 2023

Hello,

I have a recurring problem with my one of my Unraid server.

every time it does a Parity-Check, at the end or almost the server seems to crash.

No web UI, now answer to a ping and does not appear on my router.

I tought it was comming from my version and that I was using a old disk as parity. But upgrade and changing the parity disk after it failed didnn't change much.

The only time the Parity-Check work is after a update. or when I changed the parity disk.

Spec :

Unraid OS Plus

I5 10400T

16GB DDR4 2400MHZ

MAG B460 TORPEDO

Parity : Seagate BarraCuda 8 TB

Seagate BarraCuda 6 TB

Seagate BarraCuda 4 TB

I have logs but can't find what's wrong ...

It seems to have a problem with my drive connections but I ve check them physicaly and nothings wrong.

The problem have impact on the nic, I have logs with the "normal" IP and the configuration IP 169.254.47.25 after fiew hours. I'll past the logs :

syslog when ending the parity check (ip 192.168.1.30)

May  2 23:30:01 STORAGE kernel: mdcmd (41): check NOCORRECT
May  2 23:30:01 STORAGE kernel: 
May  2 23:30:01 STORAGE kernel: md: recovery thread: check P ...
May  3 02:30:54 STORAGE kernel: ata7.00: failed to read SCR 1 (Emask=0x40)
May  3 02:30:54 STORAGE kernel: ata7.01: failed to read SCR 1 (Emask=0x40)
May  3 02:30:54 STORAGE kernel: ata7.02: failed to read SCR 1 (Emask=0x40)
May  3 02:30:54 STORAGE kernel: ata7.01: exception Emask 0x100 SAct 0x1f80000 SErr 0x0 action 0x6 frozen
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/40:98:d0:05:f8/05:00:55:00:00/40 tag 19 ncq dma 688128 in
May  3 02:30:54 STORAGE kernel:         res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/40:a0:10:0b:f8/05:00:55:00:00/40 tag 20 ncq dma 688128 in
May  3 02:30:54 STORAGE kernel:         res 40/00:ff:81:00:00/00:00:00:00:00/40 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/40:a8:50:10:f8/05:00:55:00:00/40 tag 21 ncq dma 688128 in
May  3 02:30:54 STORAGE kernel:         res 40/00:ff:81:00:00/00:00:00:00:00/40 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/40:b0:90:15:f8/05:00:55:00:00/40 tag 22 ncq dma 688128 in
May  3 02:30:54 STORAGE kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/40:b8:d0:1a:f8/05:00:55:00:00/40 tag 23 ncq dma 688128 in
May  3 02:30:54 STORAGE kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:54 STORAGE kernel: ata7.01: failed command: READ FPDMA QUEUED
May  3 02:30:54 STORAGE kernel: ata7.01: cmd 60/c0:c0:10:20:f8/04:00:55:00:00/40 tag 24 ncq dma 622592 in
May  3 02:30:54 STORAGE kernel:         res 40/00:ff:81:00:00/00:00:00:00:00/40 Emask 0x4 (timeout)
May  3 02:30:54 STORAGE kernel: ata7.01: status: { DRDY }
May  3 02:30:56 STORAGE kernel: ata7.15: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
May  3 02:30:56 STORAGE kernel: ata7.00: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 02:30:56 STORAGE kernel: ata7.01: hard resetting link
May  3 02:30:56 STORAGE kernel: ata7.01: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 02:30:57 STORAGE kernel: ata7.02: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 02:30:58 STORAGE kernel: ata7.00: configured for UDMA/133
May  3 02:30:58 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 02:30:58 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 02:30:58 STORAGE kernel: ata7.01: configured for UDMA/133
May  3 02:30:58 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 02:30:58 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 02:30:58 STORAGE kernel: ata7.02: configured for UDMA/133
May  3 02:30:58 STORAGE kernel: ata7: EH complete
May  3 06:53:02 STORAGE kernel: ata7.00: failed to read SCR 1 (Emask=0x40)
May  3 06:53:02 STORAGE kernel: ata7.01: failed to read SCR 1 (Emask=0x40)
May  3 06:53:02 STORAGE kernel: ata7.02: failed to read SCR 1 (Emask=0x40)
May  3 06:53:02 STORAGE kernel: ata7.00: exception Emask 0x100 SAct 0x83c SErr 0x0 action 0x6 frozen
May  3 06:53:02 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 06:53:02 STORAGE kernel: ata7.00: cmd 60/40:10:88:f8:79/05:00:d3:00:00/40 tag 2 ncq dma 688128 in
May  3 06:53:02 STORAGE kernel:         res 40/00:20:08:03:7a/00:00:d3:00:00/40 Emask 0x100 (unknown error)
May  3 06:53:02 STORAGE kernel: ata7.00: status: { DRDY }
May  3 06:53:02 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 06:53:02 STORAGE kernel: ata7.00: cmd 60/40:18:c8:fd:79/05:00:d3:00:00/40 tag 3 ncq dma 688128 in
May  3 06:53:02 STORAGE kernel:         res 40/00:20:08:03:7a/00:00:d3:00:00/40 Emask 0x100 (unknown error)
May  3 06:53:02 STORAGE kernel: ata7.00: status: { DRDY }
May  3 06:53:02 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 06:53:02 STORAGE kernel: ata7.00: cmd 60/40:20:08:03:7a/05:00:d3:00:00/40 tag 4 ncq dma 688128 in
May  3 06:53:02 STORAGE kernel:         res 40/00:20:08:03:7a/00:00:d3:00:00/40 Emask 0x100 (unknown error)
May  3 06:53:02 STORAGE kernel: ata7.00: status: { DRDY }
May  3 06:53:02 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 06:53:02 STORAGE kernel: ata7.00: cmd 60/40:28:48:08:7a/05:00:d3:00:00/40 tag 5 ncq dma 688128 in
May  3 06:53:02 STORAGE kernel:         res 40/00:20:08:03:7a/00:00:d3:00:00/40 Emask 0x100 (unknown error)
May  3 06:53:02 STORAGE kernel: ata7.00: status: { DRDY }
May  3 06:53:02 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 06:53:02 STORAGE kernel: ata7.00: cmd 60/80:58:88:0d:7a/00:00:d3:00:00/40 tag 11 ncq dma 65536 in
May  3 06:53:02 STORAGE kernel:         res 40/00:20:08:03:7a/00:00:d3:00:00/40 Emask 0x100 (unknown error)
May  3 06:53:02 STORAGE kernel: ata7.00: status: { DRDY }
May  3 06:53:04 STORAGE kernel: ata7.15: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
May  3 06:53:04 STORAGE kernel: ata7.00: hard resetting link
May  3 06:53:04 STORAGE kernel: ata7.00: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 06:53:05 STORAGE kernel: ata7.01: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 06:53:05 STORAGE kernel: ata7.02: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 06:53:05 STORAGE kernel: ata7.00: configured for UDMA/133
May  3 06:53:05 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 06:53:05 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 06:53:05 STORAGE kernel: ata7.01: configured for UDMA/133
May  3 06:53:05 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 06:53:05 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 06:53:05 STORAGE kernel: ata7.02: configured for UDMA/133
May  3 06:53:05 STORAGE kernel: ata7: EH complete
May  3 08:40:32 STORAGE kernel: ata7.00: failed to read SCR 1 (Emask=0x40)
May  3 08:40:32 STORAGE kernel: ata7.01: failed to read SCR 1 (Emask=0x40)
May  3 08:40:32 STORAGE kernel: ata7.02: failed to read SCR 1 (Emask=0x40)
May  3 08:40:32 STORAGE kernel: ata7.00: exception Emask 0x100 SAct 0x10000000 SErr 0x0 action 0x6 frozen
May  3 08:40:32 STORAGE kernel: ata7.00: failed command: READ FPDMA QUEUED
May  3 08:40:32 STORAGE kernel: ata7.00: cmd 60/40:e0:00:ca:0f/05:00:0b:01:00/40 tag 28 ncq dma 688128 in
May  3 08:40:32 STORAGE kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
May  3 08:40:32 STORAGE kernel: ata7.00: status: { DRDY }
May  3 08:40:34 STORAGE kernel: ata7.15: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
May  3 08:40:34 STORAGE kernel: ata7.00: hard resetting link
May  3 08:40:35 STORAGE kernel: ata7.00: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 08:40:35 STORAGE kernel: ata7.01: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 08:40:36 STORAGE kernel: ata7.02: SATA link up 6.0 Gbps (SStatus 133 SControl 330)
May  3 08:40:37 STORAGE kernel: ata7.00: configured for UDMA/133
May  3 08:40:37 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 08:40:37 STORAGE kernel: ata7.01: supports DRM functions and may not be fully accessible
May  3 08:40:37 STORAGE kernel: ata7.01: configured for UDMA/133
May  3 08:40:37 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 08:40:37 STORAGE kernel: ata7.02: supports DRM functions and may not be fully accessible
May  3 08:40:37 STORAGE kernel: ata7.02: configured for UDMA/133
May  3 08:40:37 STORAGE kernel: ata7: EH complete
May  3 11:57:47 STORAGE kernel: ata8.00: exception Emask 0x52 SAct 0x1800000 SErr 0xffffffff action 0xe frozen
May  3 11:57:47 STORAGE kernel: ata8: SError: { RecovData RecovComm UnrecovData Persist Proto HostInt PHYRdyChg PHYInt CommWake 10B8B Dispar BadCRC Handshk LinkSeq TrStaTrns UnrecFIS DevExch }
May  3 11:57:47 STORAGE kernel: ata8.00: failed command: READ FPDMA QUEUED
May  3 11:57:47 STORAGE kernel: ata8.00: cmd 60/40:b8:68:e9:bd/05:00:6f:01:00/40 tag 23 ncq dma 688128 in
May  3 11:57:47 STORAGE kernel:         res 40/00:ff:ff:00:00/00:00:00:00:00/40 Emask 0x56 (ATA bus error)
May  3 11:57:47 STORAGE kernel: ata8.00: status: { DRDY }
May  3 11:57:47 STORAGE kernel: ata8.00: failed command: READ FPDMA QUEUED
May  3 11:57:47 STORAGE kernel: ata8.00: cmd 60/80:c0:a8:ee:bd/00:00:6f:01:00/40 tag 24 ncq dma 65536 in
May  3 11:57:47 STORAGE kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x56 (ATA bus error)
May  3 11:57:47 STORAGE kernel: ata8.00: status: { DRDY }
May  3 11:57:47 STORAGE kernel: ata8: hard resetting link
May  3 11:57:47 STORAGE kernel: ahci 0000:04:00.0: AHCI controller unavailable!

log after alsmost 24h sundently switch to this on the 169.254.47.25 conf ip

Mar  4 12:29:16 STORAGE root: 
Mar  4 12:29:16 STORAGE  rsyslogd: action 'action-2-builtin:omfwd' resumed (module 'builtin:omfwd') [v8.2102.0 try https://www.rsyslog.com/e/2359 ]
Mar  4 12:29:16 STORAGE root: plugin: running: anonymous
Mar  4 12:29:16 STORAGE root: plugin: checking: /boot/config/plugins/community.applications/community.applications-2022.09.30-x86_64-1.txz - MD5
Mar  4 12:29:16 STORAGE root: plugin: skipping: /boot/config/plugins/community.applications/community.applications-2022.09.30-x86_64-1.txz already exists
Mar  4 12:29:16 STORAGE root: plugin: running: /boot/config/plugins/community.applications/community.applications-2022.09.30-x86_64-1.txz
Mar  4 12:29:16 STORAGE root: 
Mar  4 12:29:16 STORAGE root: +==============================================================================
Mar  4 12:29:16 STORAGE root: | Installing new package /boot/config/plugins/community.applications/community.applications-2022.09.30-x86_64-1.txz
Mar  4 12:29:16 STORAGE root: +==============================================================================
Mar  4 12:29:16 STORAGE root: 
Mar  4 12:29:16 STORAGE root: Verifying package community.applications-2022.09.30-x86_64-1.txz.
Mar  4 12:29:16 STORAGE root: 
Mar  4 12:29:16 STORAGE root: Package file disklocation.2022.06.10.zip extracted.
Mar  4 12:29:16 STORAGE root: 
Mar  4 12:29:16 STORAGE root: Adding disks into database, please wait... this might take a while...
Mar  4 12:29:16 STORAGE root: [122916] system.php:92 @ functions: Debug function active.
Mar  4 12:29:16 STORAGE root: [122916] system.php:1140 @ array: LSSCSI:11
Mar  4 12:29:16 STORAGE root: [122916] system.php:1157 @ loop: Scanning: 0:0:0:0 Node: /dev/sg0
Mar  4 12:29:16 STORAGE root: [122916] system.php:1157 @ loop: Scanning: 1:0:0:0 Node: /dev/sg1
Mar  4 12:29:16 STORAGE root: [122916] system.php:1167 @ SMART: #:1|DEV:1:0:0:0=array
Mar  4 12:29:16 STORAGE root: [122916] system.php:1197 @ SMART: #:1|DEV:1:0:0:0|PROTOCOL=ATA
Mar  4 12:29:16 STORAGE root: [122916] system.php:1209 @ HASH: #:1:bb63063b9501e6718fe812ee8d3458f273ccaa3b8748824fb02325c280b2276b
Mar  4 12:29:16 STORAGE root: [122916] system.php:1157 @ loop: Scanning: 2:0:0:0 Node: /dev/sg2
Mar  4 12:29:16 STORAGE root: [122916] system.php:1167 @ SMART: #:2|DEV:2:0:0:0=array
Mar  4 12:29:16 STORAGE root: [122916] system.php:1197 @ SMART: #:2|DEV:2:0:0:0|PROTOCOL=ATA
Mar  4 12:29:16 STORAGE root: [122916] system.php:1209 @ HASH: #:2:ac8031b0c7df1185c461c8e5d41ba62a576b0fb04247650a1dc56adc35c03c99
Mar  4 12:29:16 STORAGE root: [122916] system.php:1157 @ loop: Scanning: 3:0:0:0 Node: /dev/sg3
Mar  4 12:29:16 STORAGE root: [122916] system.php:1167 @ SMART: #:3|DEV:3:0:0:0=array
Mar  4 12:29:16 STORAGE root: [122916] system.php:1197 @ SMART: #:3|DEV:3:0:0:0|PROTOCOL=ATA
Mar  4 12:29:16 STORAGE root: [122916] system.php:1209 @ HASH: #:3:366f0b2b59f7e914a0e15a34a6f10c9551cb74b0dca0ee07473a9cfb2e8b88ac
Mar  4 12:29:17 STORAGE root: [122917] system.php:1157 @ loop: Scanning: 4:0:0:0 Node: /dev/sg4
Mar  4 12:29:17 STORAGE root: [122917] system.php:1167 @ SMART: #:4|DEV:4:0:0:0=array
Mar  4 12:29:17 STORAGE root: [122917] system.php:1197 @ SMART: #:4|DEV:4:0:0:0|PROTOCOL=ATA
Mar  4 12:29:17 STORAGE root: [122917] system.php:1209 @ HASH: #:4:8338f22f418618810076d427b791fc37eba176e022d899dd36a83d57f907396e
Mar  4 12:29:18 STORAGE root: [122918] system.php:1167 @ SMART: #:6|DEV:7:0:0:0=array
Mar  4 12:29:18 STORAGE root: [122918] system.php:1197 @ SMART: #:6|DEV:7:0:0:0|PROTOCOL=ATA
Mar  4 12:29:18 STORAGE root: [122918] system.php:1209 @ HASH: #:6:3648fe90defbb9c99e06966dbe706c7ad9e62396200c1da71b4a0a6826ec1774
Mar  4 12:29:18 STORAGE root: [122918] system.php:1157 @ loop: Scanning: 7:1:0:0 Node: /dev/sg7
Mar  4 12:29:18 STORAGE root: [122918] system.php:1167 @ SMART: #:7|DEV:7:1:0:0=array
Mar  4 12:29:18 STORAGE root: [122918] system.php:1197 @ SMART: #:7|DEV:7:1:0:0|PROTOCOL=ATA
Mar  4 12:29:18 STORAGE root: [122918] system.php:1209 @ HASH: #:7:ccb096dfa96e661eac30292733ca89f5da184e52e1d0b4ede7d897c36e98b783
Mar  4 12:29:18 STORAGE root: [122918] system.php:1157 @ loop: Scanning: 7:2:0:0 Node: /dev/sg8
Mar  4 12:29:18 STORAGE  dhcpcd[1226]: br0: leased 192.168.1.30 for 86400 seconds

If I've froget something to help with the debug pls tell me and I'll upload it.

Thx for your help!

JorgeB · May 5, 2023

Please post the diagnostics but looks like you are using a controller with SATA port multipliers, those are not recommended.

MrNobodie · May 5, 2023

Hi thx for the quick answer. I have a PCI card for sata extention indeed. Any recommendation about that ? I'lve maxed out the mother board sata port.

I've forget about this tool, there is the diag.

storage-diagnostics-20230505-1118.zip

JorgeB · May 5, 2023

You can use ad-don controllers, but avoid models with a SATA port multiplier like the one you have, see here for some recommendations:

Server crash during Parity-Check 6.x

Recommended Posts

MrNobodie

Link to comment

JorgeB

Link to comment

MrNobodie

Link to comment

JorgeB

Link to comment

Join the conversation