Kernel panic once per week after upgrade to Unraid 6.9.2

Benoitvinc

By Benoitvinc
in General Support

Recommended Posts

Benoitvinc Noob

Benoitvinc

Posted
Posted

I'm running Unraid 6.9.2 on a Dell R320 using 4 2TB SAS HDD and 1 SSD cache drive. The boot usb is a sandisk Ultra_Fit .

Ever since I've been upgrading to Unraid 6.9.2 from 6.8 I've been getting kernel panic once per week at random time. 

I have attached the diagnostic log in case someone could help me figure this one out.

I have made sure it is not related to CPU or memory usage and a parity check has been run with success on my array,

unraid-diagnostics-20210428-1315.zip

Link to comment
codefaux Apprentice

codefaux

Posted
Posted
On 4/28/2021 at 10:18 AM, Benoitvinc said:

upgrading to Unraid 6.9.2 from 6.8

Scanning your syslog I don't see the crash/reboot occur, but there's a known issue with Docker macvlan and 6.9 series causing kernel panics. If you're using Docker and macvlan (unique IP addresses on containers, for example) this may be your cause. I suggest you revert to 6.8.3 (I had to as well) and wait out a fix, or revert to test.

 

Caveats: If you're using a cache disk, you will need to reconstruct your pool configuration on reboot to include the Cache disk, due to a migration in how Cache pools are handled and set up. For myself, that was as easy as re-selecting the sole extra drive in the Cache disk dropdown. Ask for more support and detail if you aren't confident, BEFORE doing this.

 

Also, unrelated but significant -- one of your drives is reporting errors. Investigate SMART if you don't know what caused this. 

Apr 28 12:51:37 Unraid kernel: ata5.00: exception Emask 0x0 SAct 0xfffc01ff SErr 0x0 action 0x6 frozen
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/60:00:70:cc:22/00:00:00:00:00/40 tag 0 ncq dma 49152 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:08:c0:ca:21/00:00:00:00:00/40 tag 1 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:10:40:d8:21/00:00:00:00:00/40 tag 2 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/40:18:a8:9d:21/00:00:00:00:00/40 tag 3 ncq dma 32768 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:20:00:26:ba/00:00:00:00:00/40 tag 4 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/08:28:e8:b7:31/00:00:00:00:00/40 tag 5 ncq dma 4096 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:30:00:a2:01/00:00:08:00:00/40 tag 6 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:38:60:e9:46/00:00:05:00:00/40 tag 7 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:40:c0:60:a6/00:00:00:00:00/40 tag 8 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:90:d0:dd:21/00:00:00:00:00/40 tag 18 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/60:98:e0:37:22/00:00:00:00:00/40 tag 19 ncq dma 49152 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/c0:a0:10:87:22/00:00:00:00:00/40 tag 20 ncq dma 98304 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/60:a8:38:91:22/00:00:00:00:00/40 tag 21 ncq dma 49152 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:01:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/c0:b0:d0:94:22/00:00:00:00:00/40 tag 22 ncq dma 98304 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:01:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/c0:b8:30:98:22/00:00:00:00:00/40 tag 23 ncq dma 98304 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:01:00:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/80:c0:58:3a:71/04:00:05:00:00/40 tag 24 ncq dma 589824 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:01:01:4f:c2/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:c8:b0:ec:bb/00:00:05:00:00/40 tag 25 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/38:d0:e0:3e:71/02:00:05:00:00/40 tag 26 ncq dma 290816 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/08:d8:18:0e:7a/00:00:05:00:00/40 tag 27 ncq dma 4096 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:e0:20:68:30/00:00:05:00:00/40 tag 28 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/20:e8:60:03:f3/00:00:04:00:00/40 tag 29 ncq dma 16384 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: WRITE FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 61/08:f0:28:ab:01/00:00:08:00:00/40 tag 30 ncq dma 4096 out
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5.00: failed command: READ FPDMA QUEUED
Apr 28 12:51:37 Unraid kernel: ata5.00: cmd 60/e0:f8:98:a5:22/00:00:00:00:00/40 tag 31 ncq dma 114688 in
Apr 28 12:51:37 Unraid kernel:         res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Apr 28 12:51:37 Unraid kernel: ata5.00: status: { DRDY }
Apr 28 12:51:37 Unraid kernel: ata5: hard resetting link
Apr 28 12:51:38 Unraid kernel: ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
Apr 28 12:51:38 Unraid kernel: ata5.00: configured for UDMA/133
Apr 28 12:51:38 Unraid kernel: ata5.00: device reported invalid CHS sector 0
### [PREVIOUS LINE REPEATED 16 TIMES] ###
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#0 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#0 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#0 CDB: opcode=0x28 28 00 00 22 cc 70 00 00 60 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2280560 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#1 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#1 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#1 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#1 CDB: opcode=0x28 28 00 00 21 ca c0 00 00 20 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2214592 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#2 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#2 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#2 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#2 CDB: opcode=0x28 28 00 00 21 d8 40 00 00 20 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2218048 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#3 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#3 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#3 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#3 CDB: opcode=0x28 28 00 00 21 9d a8 00 00 40 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2203048 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#5 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#5 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#5 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#5 CDB: opcode=0x28 28 00 00 31 b7 e8 00 00 08 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 3258344 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#18 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#18 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#18 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#18 CDB: opcode=0x28 28 00 00 21 dd d0 00 00 20 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2219472 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#19 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#19 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#19 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#19 CDB: opcode=0x28 28 00 00 22 37 e0 00 00 60 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2242528 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#20 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#20 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#20 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#20 CDB: opcode=0x28 28 00 00 22 87 10 00 00 c0 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2262800 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#21 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#21 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#21 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#21 CDB: opcode=0x28 28 00 00 22 91 38 00 00 60 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2265400 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#22 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=53s
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#22 Sense Key : 0x5 [current] 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#22 ASC=0x21 ASCQ=0x4 
Apr 28 12:51:38 Unraid kernel: sd 6:0:0:0: [sdb] tag#22 CDB: opcode=0x28 28 00 00 22 94 d0 00 00 c0 00
Apr 28 12:51:38 Unraid kernel: blk_update_request: I/O error, dev sdb, sector 2266320 op 0x0:(READ) flags 0x80700 phys_seg 2 prio class 0

 

Link to comment
codefaux Apprentice

codefaux

Posted
Posted (edited)
3 hours ago, Benoitvinc said:

move it out of Unraid

Another option is to revert to 6.8.3 if you don't need the things 6.9.3 introduced, BUT you'll have to re-assign your cache drive as they made some breaking changes with configuration there.

 

If it's easier to move it out, that would be the way. On my side, reversion was the route because I needed the container where it is.

 

Good luck, and let us know if you have any other problems! Also bear in mind that this SHOULD be the fix, but isn't guaranteed to be. Let us know.

Edited by codefaux
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing