12TB reconstruct, 1.5 months

[tucansam]

Current operation started on Fri 14 Oct 2022 04:59:38 PM MST (today)

Total size:12 TB

Elapsed time:3 minutes

Current position:618 MB (0.0 %)

Estimated speed:2.8 MB/sec

Estimated finish:49 days, 7 hours, 47 minutes

 

--

   
Current operation started on Fri 14 Oct 2022 04:59:38 PM MST (today)
Total size:    12 TB    
Elapsed time:    14 minutes    
Current position:    10.2 GB (0.1 %)    
Estimated speed:    7.0 MB/sec    
Estimated finish:    19 days, 22 hours, 45 minutes    

 

 

 

Just replaced my two 8TB reds with two 12TBs, and all went swimmingly.  Now replaced a 6TB blue member disk with an identical 12TB, and reconstruct is jumping between 2.8MB/s, jumping to 25MB/s, and sometimes 44MB/s, but never exceeding it, ever.  Mostly it settles back down to 2-7MB/s.

 

I was hoping after a few minutes, whatever was maybe happening after a reboot to swap in the new disk would finish, and things would pick up.  I'll monitor it again in a few hours, but right now its settled at an amazingly slow speed.

 

Diags.

 

 

ffs2-diagnostics-20221014-1710.zip

[tucansam]

No change.

 

Current operation started on Fri 14 Oct 2022 04:59:38 PM MST (today)
Total size:    12 TB    
Elapsed time:    1 hour, 53 minutes    
Current position:    68.7 GB (0.6 %)    
Estimated speed:    12.5 MB/sec    
Estimated finish:    11 days, 36 minutes    

 

 

[trurl]

Lots of this in syslog

Oct 14 17:10:42 ffs2 kernel: mpt2sas_cm1: log_info(0x31110d00): originator(PL), code(0x11), sub_code(0x0d00)
### [PREVIOUS LINE REPEATED 4 TIMES] ###
Oct 14 17:10:52 ffs2 kernel: sd 10:0:3:0: Power-on or device reset occurred
### [PREVIOUS LINE REPEATED 1 TIMES] ###
Oct 14 17:10:59 ffs2 kernel: mpt2sas_cm1: log_info(0x31110d00): originator(PL), code(0x11), sub_code(0x0d00)

disk20

[10:0:3:0]   disk    ATA      ST8000AS0002-1NA AR15  /dev/sdv   /dev/sg21
  state=running queue_depth=32 scsi_level=6 type=0 device_blocked=3 timeout=30
  dir: /sys/bus/scsi/devices/10:0:3:0  [/sys/devices/pci0000:00/0000:00:1c.0/0000:02:00.0/host10/port-10:3/end_device-10:3/target10:0:3/10:0:3:0]

            [name] => disk20
            [device] => sdv

 

[tucansam]

Not even sure what that means. 

 

But Disk20 is not being reconstructed, if it matters.

 

[trurl]

8 minutes ago, tucansam said:

Disk20 is not being reconstructed, if it matters.

 

Of course all disks are read to get the data to reconstruct whatever disk is being reconstructed.

[tucansam]

Disk 20 is 11 months old and I see no SMART errors that are of concern, correct me if I'm wrong.

 

I stopped, powered down, re-seated stuff, and started the reconstruction again.  Same speeds are happening.

 

[tucansam]

Current operation started on Fri 14 Oct 2022 07:31:34 PM MST (today)

Total size:12 TB

Elapsed time:5 minutes

Current position:2.35 GB (0.0 %)

Estimated speed:410.1 KB/sec

Estimated finish:338 days, 3 hours, 53 minutes

 

 

LOL!!!!!!!!!!!

 

I'm going to swap cables completely and see what gives.

 

 

[tucansam]

New cables for a bunch of drives.  syslog is free of errors after a few minutes, speeds are slowly starting to climb.