Very Slow Parity Sync

[mike2246]

Normally Parity sync takes 10-15Hrs, I needed to remove a drive from array (not replace) I performed a new config there was no data on drive so I didn't need to migrate anything. and now it's running a Parity Sync at 3/mbps and has 30days remaining. 

[JorgeB]

Please post diagnostics.

 

[mike2246]

tower-diagnostics-20210909-1140.zip

[JorgeB]

Check/replace cables(including power)/slot on disk4, there are multiple timeout/reset errors, then try again.

[mike2246]

What part of the log shows that so I can look if it happens again?

[mike2246]

I reseated connections and swapped power with another drive. everything is going at normal speed now (160-170)

 

Thanks,

 

Mike

[JorgeB]

29 minutes ago, mike2246 said:

What part of the log shows that so I can look if it happens again?

 

These repeating errors:

 

Sep  9 11:39:15 Tower kernel: sd 11:0:2:0: device_unblock and setting to running, handle(0x000b)
Sep  9 11:39:15 Tower kernel: sd 11:0:2:0: Power-on or device reset occurred
Sep  9 11:39:15 Tower rc.diskinfo[11959]: SIGHUP received, forcing refresh of disks info.
Sep  9 11:39:33 Tower kernel: sd 11:0:2:0: device_block, handle(0x000b)
Sep  9 11:39:33 Tower kernel: mpt3sas_cm0: log_info(0x31120100): originator(PL), code(0x12), sub_code(0x0100)

 

[mike2246]

getting same error again. this time it's handle (0x000c), how do I figure out which disk that relates to?

tower-diagnostics-20210924-2128.zip

[JorgeB]

You can see which disk it is by looking at lsscsi on the diags:

 

[11:0:3:0]   disk    SEAGATE  ST6000NM0285     EF04  /dev/sdm   /dev/sg12
  state=running queue_depth=254 scsi_level=7 type=0 device_blocked=2 timeout=30
  dir: /sys/bus/scsi/devices/11:0:3:0  [/sys/devices/pci0000:00/0000:00:03.2/0000:0c:00.0/host11/port-11:3/end_device-11:3/target11:0:3/11:0:3:0]

 

sdm is currently Disk4

[mgadbois]

I have (had) 2 parity drives and 6 data drives. All 14 TB drives. Parity Disk 1 had a lot of errors and it got disabled. I did a parity check with the 1 remaining drive and all came out well. Tried to add the parity drive 1 (bad one) back into array and it said it would take 54 days to sync. All drives are about a month old. This is a 24 bay supermicor server. I moved the bad parity drive to a different drive bay just in case. No effect.

 

Thoughts

astro-server-diagnostics-20211230-1244.zip

[JorgeB]

Dec 29 11:58:06 Astro-Server kernel: sd 7:0:0:0: Power-on or device reset occurred
Dec 29 11:58:06 Astro-Server kernel: sd 7:0:2:0: Power-on or device reset occurred
Dec 29 11:58:06 Astro-Server kernel: sd 7:0:7:0: Power-on or device reset occurred

 

This error repeating for multiple devices, this is most often a connection/power problem, you should also update the LSI firmware since it's quite old.

[mgadbois]

Newbie here....  The controller I got from the Server Store was Flashed to IT Mode. is that what you are refereeing to or is this different?

 

[mgadbois]

I was able to Flash this Version 20 from version 14 and that fixed the issue.

 

Thanks