Swapping Parity and Adding More Data Drives

[bitphire]

Hello!

 

I purchased 3 drives that are larger than my parity. I want to make current parity a data disk and one of the new disks parity then add the other 2 new disks as data disks as well. I tried Stopping Array and swapping the parity with one of the larger disks thinking it would then rebuild but it does not.

 

Under "Unassigned Devices" I show all 3 new drives and they say "Format" but that fails every time on all drives. Log:

Apr  4 18:24:52 Cuddles unassigned.devices: Format device '/dev/sdg'.
Apr  4 18:24:52 Cuddles unassigned.devices: Device '/dev/sdg' block size: 11721045168.
Apr  4 18:24:52 Cuddles unassigned.devices: Clearing partition table of disk '/dev/sdg'.
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#910 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#910 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#910 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#910 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 00 00 00 00 04 00 00 00
Apr  4 18:24:52 Cuddles kernel: critical target error, dev sdg, sector 0 op 0x1:(WRITE) flags 0x4800 phys_seg 128 prio class 0
Apr  4 18:24:52 Cuddles kernel: buffer_io_error: 523 callbacks suppressed
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 0, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 1, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 2, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 3, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 4, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 5, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 6, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 7, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 8, lost async page write
Apr  4 18:24:52 Cuddles kernel: Buffer I/O error on dev sdg, logical block 9, lost async page write
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#911 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#911 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#911 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#911 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 04 00 00 00 04 00 00 00
Apr  4 18:24:52 Cuddles kernel: critical target error, dev sdg, sector 1024 op 0x1:(WRITE) flags 0x4800 phys_seg 128 prio class 0
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#912 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#912 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#912 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#912 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 08 00 00 00 04 00 00 00
Apr  4 18:24:52 Cuddles kernel: critical target error, dev sdg, sector 2048 op 0x1:(WRITE) flags 0x4800 phys_seg 128 prio class 0
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#913 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#913 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#913 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:52 Cuddles kernel: sd 3:0:3:0: [sdg] tag#913 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 0c 00 00 00 04 00 00 00
Apr  4 18:24:52 Cuddles kernel: critical target error, dev sdg, sector 3072 op 0x1:(WRITE) flags 0x800 phys_seg 128 prio class 0
Apr  4 18:24:52 Cuddles unassigned.devices: Clear partition result: 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.332216 s, 6.3 MB/s
Apr  4 18:24:54 Cuddles unassigned.devices: Reloading disk '/dev/sdg' partition table.
Apr  4 18:24:54 Cuddles unassigned.devices: Reload partition table result: /dev/sdg:  re-reading partition table
Apr  4 18:24:54 Cuddles unassigned.devices: Creating Unraid compatible gpt partition on disk '/dev/sdg'.
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2401 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2401 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2401 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2401 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 00 00 00 00 00 28 00 00
Apr  4 18:24:54 Cuddles kernel: critical target error, dev sdg, sector 0 op 0x1:(WRITE) flags 0x0 phys_seg 5 prio class 0
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2400 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2400 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2400 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:54 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2400 CDB: opcode=0x8a 8a 00 00 00 00 02 ba a0 f4 88 00 00 00 28 00 00
Apr  4 18:24:54 Cuddles kernel: critical target error, dev sdg, sector 11721045128 op 0x1:(WRITE) flags 0x0 phys_seg 5 prio class 0
Apr  4 18:24:55 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2008 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:55 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2008 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:55 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2008 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:55 Cuddles kernel: sd 3:0:3:0: [sdg] tag#2008 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 00 00 00 00 00 08 00 00
Apr  4 18:24:55 Cuddles kernel: critical target error, dev sdg, sector 0 op 0x1:(WRITE) flags 0x800 phys_seg 1 prio class 0
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#540 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#540 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#540 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#540 CDB: opcode=0x8a 8a 00 00 00 00 00 00 00 00 00 00 00 00 28 00 00
Apr  4 18:24:56 Cuddles kernel: critical target error, dev sdg, sector 0 op 0x1:(WRITE) flags 0x0 phys_seg 5 prio class 0
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#539 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#539 Sense Key : 0x4 [current] [descriptor] 
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#539 <<vendor>>ASC=0x81 ASCQ=0x0 
Apr  4 18:24:56 Cuddles kernel: sd 3:0:3:0: [sdg] tag#539 CDB: opcode=0x8a 8a 00 00 00 00 02 ba a0 f4 88 00 00 00 28 00 00
Apr  4 18:24:56 Cuddles kernel: critical target error, dev sdg, sector 11721045128 op 0x1:(WRITE) flags 0x0 phys_seg 5 prio class 0
Apr  4 18:24:57 Cuddles unassigned.devices: Create gpt partition table result: Creating new GPT entries in memory. The operation has completed successfully. 
Apr  4 18:24:59 Cuddles unassigned.devices: Reloading disk '/dev/sdg' partition table.
Apr  4 18:24:59 Cuddles unassigned.devices: Reload partition table result: /dev/sdg:  re-reading partition table
Apr  4 18:24:59 Cuddles unassigned.devices: Formatting disk '/dev/sdg' with 'xfs' filesystem.
Apr  4 18:24:59 Cuddles unassigned.devices: Format drive command: /sbin/mkfs.xfs -f '/dev/sdg1' 2>&1
Apr  4 18:25:00 Cuddles unassigned.devices: Format disk '/dev/sdg' with 'zfs' filesystem failed: Error accessing specified device /dev/sdg1: No such file or directory Usage: mkfs.xfs /* blocksize */#011#011[-b size=num] /* config file */#011[-c options=xxx] /* metadata */#011#011[-m crc=0|1,finobt=0|1,uuid=xxx,rmapbt=0|1,reflink=0|1, #011#011#011    inobtcount=0|1,bigtime=0|1] /* data subvol */#011[-d agcount=n,agsize=n,file,name=xxx,size=num, #011#011#011    (sunit=value,swidth=value|su=num,sw=num|noalign), #011#011#011    sectsize=num /* force overwrite */#011[-f] /* inode size */#011[-i perblock=n|size=num,maxpct=n,attr=0|1|2, #011#011#011    projid32bit=0|1,sparse=0|1] /* no discard */#011[-K] /* log subvol */#011[-l agnum=n,internal,size=num,logdev=xxx,version=n #011#011#011    sunit=value|su=num,sectsize=num,lazy-count=0|1] /* label */#011#011[-L label (maximum 12 characters)] /* naming */#011#011[-n size=num,version=2|ci,ftype=0|1] /* no-op info only */#011[-N] /* prototype file */#011[-p fname] /* quiet */#011#011[-q] /* realtime subvol */#011[-r extsize=num,size=num,rtdev=xxx] /* sectorsize */#011[-s size=num] /* version */#011#011[-V] #011#011#011devicename <d

 

[JorgeB]

Please post the diagnostics.

[bitphire]

Here you go! Thank you

cuddles-diagnostics-20230405-0820.zip

[JorgeB]

Looks like the devices are write protected, this is fairly common with SAS devices, could be format protection or SED protection, see if these help:

 

https://forums.unraid.net/topic/93432-parity-disk-read-errors/?do=findComment&comment=864078

https://forums.unraid.net/topic/110835-help-with-a-sas-drive/

 

[bitphire]

I ran sg_format --format --fmtpinfo=0 /dev/sdX on all 3 new drives and still had same issues. They are seagate drives and I read about SED drives but have no way of mounting sas on my Windows machine at the momment to use SeaTools and see if they are protected that way. I cannot find where you see they are write protected either, just wanted to know where so if I order future drives from this location I know what to look for.

 

However, I did move the drives physically to another bay and got 2 out of 3 to format. Got one to mount and is now parity and seems to be fine. The 2nd drive I added to the array and it shows 1025 errors and never cleared. The 3rd drive no change.

 

attached another diagnostics from this morning. Drives: sde (New Parity and seems to be working fine), sdf (new disk in array but not working and shows 1025 errors on MAIN page), sdg (Has a button to format but fails every time).

cuddles-diagnostics-20230408-0925.zip

Edited April 8, 2023 by bitphire