November 8, 201510 yr Disk 9 was blue (disabled) and when I saw errors listed for disk 5, which went missing when I stopped the array. Rebooted the server, disk5 reappeared, so I started rebuilding disk9 on a new drive. I don't think it's going anywhere... see syslog extract below.... Any ideas on what I should do? Nov 8 16:17:13 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:13 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:14 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:14 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:14 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:14 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:14 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:16 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:16 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:16 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:16 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:19 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:19 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:19 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:19 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:19 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:19 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:19 Tower kernel: ata15.00: cmd 25/00:00:47:c4:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:19 Tower kernel: res 50/00:00:46:c4:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:19 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:22 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:22 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:22 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:22 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:22 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:22 Tower kernel: ata15.00: cmd 25/00:00:47:dc:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:22 Tower kernel: res 50/00:00:46:dc:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:22 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:26 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:26 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:26 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:26 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:26 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:26 Tower kernel: ata15.00: cmd 25/00:00:47:fc:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:26 Tower kernel: res 50/00:00:46:fc:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:26 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:29 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:29 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:29 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:30 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [dccdf500]: (System) Nov 8 16:17:30 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:30 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:30 Tower kernel: sd 1:0:1:0: [sdj] command dccdf100 timed out (Drive related) Nov 8 16:17:30 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:30 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:30 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:30 Tower kernel: ata18.00: cmd 25/00:00:47:28:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:30 Tower kernel: res 01/04:00:46:28:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:30 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:30 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:30 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:30 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:31 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:31 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:31 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:31 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:32 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:33 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:36 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:36 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:36 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:36 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:37 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [d889c700]: (System) Nov 8 16:17:37 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: sd 1:0:1:0: [sdj] command dcc4dc00 timed out (Drive related) Nov 8 16:17:37 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:37 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:37 Tower kernel: ata18.00: cmd 25/00:00:47:38:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:37 Tower kernel: res 01/04:00:46:38:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:37 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:37 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:38 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:39 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:42 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:42 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:42 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:42 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:43 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:43 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:43 Tower kernel: ata15.00: cmd 25/00:00:47:68:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:43 Tower kernel: res 50/00:00:46:68:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:43 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:46 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:46 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:46 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:46 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:46 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:46 Tower kernel: ata15.00: cmd 25/00:00:47:88:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:46 Tower kernel: res 50/00:00:46:88:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:46 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:49 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:50 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:50 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:50 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x990000 action 0xe frozen (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: irq_stat 0x00400000, PHY RDY changed (Drive related) Nov 8 16:17:50 Tower kernel: ata15: SError: { PHYRdyChg 10B8B Dispar LinkSeq } (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:50 Tower kernel: ata15.00: cmd 25/00:00:47:a8:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:50 Tower kernel: res 50/00:00:46:a8:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:50 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:51 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [d8bddf00]: (System) Nov 8 16:17:51 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: sd 1:0:1:0: [sdj] command d8bdd100 timed out (Drive related) Nov 8 16:17:51 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:51 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:51 Tower kernel: ata18.00: cmd 25/00:00:47:bc:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:51 Tower kernel: res 01/04:00:46:bc:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:51 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:51 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:52 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:53 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:53 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:53 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:53 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:56 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:56 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:56 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:56 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:56 Tower kernel: ata15: exception Emask 0x10 SAct 0x0 SErr 0x990000 action 0xe frozen (Errors) Nov 8 16:17:56 Tower kernel: ata15: irq_stat 0x00400000, PHY RDY changed (Drive related) Nov 8 16:17:56 Tower kernel: ata15: SError: { PHYRdyChg 10B8B Dispar LinkSeq } (Errors) Nov 8 16:17:56 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:57 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [1] tag[1], task [dcf96c00]: (System) Nov 8 16:17:57 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000002, slot [1]. (System) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:57 Tower kernel: sd 1:0:1:0: [sdj] command d8bdd100 timed out (Drive related) Nov 8 16:17:57 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:57 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:57 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:57 Tower kernel: ata18.00: cmd 25/00:00:47:bc:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:57 Tower kernel: res 01/04:00:2f:60:38/00:00:3a:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:57 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:57 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:57 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:57 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors)
November 8, 201510 yr Disk 9 was blue (disabled) and when I saw errors listed for disk 5, which went missing when I stopped the array. Rebooted the server, disk5 reappeared, so I started rebuilding disk9 on a new drive. I don't think it's going anywhere... see syslog extract below.... Any ideas on what I should do? Nov 8 16:17:13 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:13 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:13 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:14 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:14 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:14 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:14 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:14 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:16 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:16 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:16 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:16 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:19 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:19 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:19 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:19 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:19 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:19 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:19 Tower kernel: ata15.00: cmd 25/00:00:47:c4:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:19 Tower kernel: res 50/00:00:46:c4:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:19 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:19 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:22 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:22 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:22 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:22 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:22 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:22 Tower kernel: ata15.00: cmd 25/00:00:47:dc:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:22 Tower kernel: res 50/00:00:46:dc:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:22 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:22 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:26 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:26 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:26 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:26 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:26 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:26 Tower kernel: ata15.00: cmd 25/00:00:47:fc:8c/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:26 Tower kernel: res 50/00:00:46:fc:8c/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:26 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:26 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:29 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:29 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:29 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:30 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [dccdf500]: (System) Nov 8 16:17:30 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:30 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:30 Tower kernel: sd 1:0:1:0: [sdj] command dccdf100 timed out (Drive related) Nov 8 16:17:30 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:30 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:30 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:30 Tower kernel: ata18.00: cmd 25/00:00:47:28:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:30 Tower kernel: res 01/04:00:46:28:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:30 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:30 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:30 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:30 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:30 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:31 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:31 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:31 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:31 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:32 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:33 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:36 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:36 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:36 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:36 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:37 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [d889c700]: (System) Nov 8 16:17:37 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: sd 1:0:1:0: [sdj] command dcc4dc00 timed out (Drive related) Nov 8 16:17:37 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:37 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:37 Tower kernel: ata18.00: cmd 25/00:00:47:38:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:37 Tower kernel: res 01/04:00:46:38:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:37 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:37 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:37 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:37 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:38 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:39 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:42 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:42 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:42 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:42 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:43 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:43 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:43 Tower kernel: ata15.00: cmd 25/00:00:47:68:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:43 Tower kernel: res 50/00:00:46:68:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:43 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:43 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:46 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:46 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:46 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:46 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x1990100 action 0xe frozen (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: irq_stat 0x08400000, PHY RDY changed (Drive related) Nov 8 16:17:46 Tower kernel: ata15: SError: { UnrecovData PHYRdyChg 10B8B Dispar LinkSeq TrStaTrns } (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:46 Tower kernel: ata15.00: cmd 25/00:00:47:88:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:46 Tower kernel: res 50/00:00:46:88:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:46 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:46 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:49 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:50 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:50 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:50 Tower kernel: ata15.00: exception Emask 0x10 SAct 0x0 SErr 0x990000 action 0xe frozen (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: irq_stat 0x00400000, PHY RDY changed (Drive related) Nov 8 16:17:50 Tower kernel: ata15: SError: { PHYRdyChg 10B8B Dispar LinkSeq } (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:50 Tower kernel: ata15.00: cmd 25/00:00:47:a8:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:50 Tower kernel: res 50/00:00:46:a8:8d/00:00:07:00:00/e0 Emask 0x10 (ATA bus error) (Errors) Nov 8 16:17:50 Tower kernel: ata15.00: status: { DRDY } (Drive related) Nov 8 16:17:50 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:51 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [0] tag[0], task [d8bddf00]: (System) Nov 8 16:17:51 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000001, slot [0]. (System) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: sd 1:0:1:0: [sdj] command d8bdd100 timed out (Drive related) Nov 8 16:17:51 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:51 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:51 Tower kernel: ata18.00: cmd 25/00:00:47:bc:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:51 Tower kernel: res 01/04:00:46:bc:8d/00:00:07:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:51 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:51 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:51 Tower kernel: ata18.00: both IDENTIFYs aborted, assuming NODEV (Drive related) Nov 8 16:17:51 Tower kernel: ata18.00: revalidation failed (errno=-2) (Minor Issues) Nov 8 16:17:52 Tower kernel: mvsas 0000:01:00.0: Phy1 : No sig fis (Drive related) Nov 8 16:17:53 Tower kernel: sas: sas_form_port: phy1 belongs to port1 already(1)! (Drive related) Nov 8 16:17:53 Tower kernel: ata15: SATA link up 1.5 Gbps (SStatus 113 SControl 310) (Drive related) Nov 8 16:17:53 Tower kernel: ata15.00: configured for UDMA/33 (Drive related) Nov 8 16:17:53 Tower kernel: ata15: EH complete (Drive related) Nov 8 16:17:56 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:56 Tower kernel: ata18.00: configured for UDMA/33 (Drive related) Nov 8 16:17:56 Tower kernel: ata18: EH complete (Drive related) Nov 8 16:17:56 Tower kernel: sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 (Drive related) Nov 8 16:17:56 Tower kernel: ata15: exception Emask 0x10 SAct 0x0 SErr 0x990000 action 0xe frozen (Errors) Nov 8 16:17:56 Tower kernel: ata15: irq_stat 0x00400000, PHY RDY changed (Drive related) Nov 8 16:17:56 Tower kernel: ata15: SError: { PHYRdyChg 10B8B Dispar LinkSeq } (Errors) Nov 8 16:17:56 Tower kernel: ata15: hard resetting link (Minor Issues) Nov 8 16:17:57 Tower kernel: drivers/scsi/mvsas/mv_sas.c 1957:Release slot [1] tag[1], task [dcf96c00]: (System) Nov 8 16:17:57 Tower kernel: drivers/scsi/mvsas/mv_94xx.c 625:command active 00000002, slot [1]. (System) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:57 Tower kernel: sd 1:0:1:0: [sdj] command d8bdd100 timed out (Drive related) Nov 8 16:17:57 Tower kernel: sas: Enter sas_scsi_recover_host busy: 1 failed: 1 (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata18: end_device-1:1: cmd error handler (Errors) Nov 8 16:17:57 Tower kernel: sas: ata17: end_device-1:0: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata18: end_device-1:1: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: ata18.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 (Errors) Nov 8 16:17:57 Tower kernel: ata18.00: failed command: READ DMA EXT (Minor Issues) Nov 8 16:17:57 Tower kernel: ata18.00: cmd 25/00:00:47:bc:8d/00:04:07:00:00/e0 tag 0 dma 524288 in (Drive related) Nov 8 16:17:57 Tower kernel: res 01/04:00:2f:60:38/00:00:3a:00:00/e0 Emask 0x12 (ATA bus error) (Errors) Nov 8 16:17:57 Tower kernel: ata18.00: status: { ERR } (Drive related) Nov 8 16:17:57 Tower kernel: ata18.00: error: { ABRT } (Errors) Nov 8 16:17:57 Tower kernel: ata18: hard resetting link (Minor Issues) Nov 8 16:17:57 Tower kernel: sas: ata19: end_device-1:2: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata20: end_device-1:3: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata21: end_device-1:4: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata22: end_device-1:5: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata23: end_device-1:6: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: ata24: end_device-1:7: dev error handler (Drive related) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Nov 8 16:17:57 Tower kernel: sas: sas_ata_task_done: SAS error 8a (Errors) Try reseating all the cabling going to the drives and the HBA card
November 8, 201510 yr Author Thanks Squid, so that would mean I have to stop drive rebuilding, reseat cables and then restart and continue (or restart) drive rebuilding?
November 8, 201510 yr Author After I cancelled rebuilding, and stopped the array, it showed that disk5 was missing (again). I will reseat all the cables and reboot... let's see what happens.
November 8, 201510 yr Author Reseated all the cables, it looks much faster already Data-Rebuild in progress. Total size: 2 TB Current position: 1.59 GB (0%) Estimated speed: 49.69 MB/sec Estimated finish: 670 minutes Thanks for the advice! I have a feeling that maybe the disabled drive too did have nothing wrong with it...
November 8, 201510 yr Since on your previous try, disk8 wasn't reporting any errors, but now it is, and you've since reseated everything, I would hazard a guess that you disturbed the cable to disk 8 when you were playing with the other cables. I'd try it again. With read errors being reported, the odds of a successful rebuild are going to diminish. That, and you might want to post up your syslog.
November 9, 201510 yr Author I have lost access to the GUI now, and I cannot even telnet tower, although if I ping tower I get replies. Is hard reboot the only way to get tower back (I don't have monitor or keyboard connected to tower)
November 9, 201510 yr Author Went for a hard reboot, and the rebuild has worked! All drives are green, will monitor from now out. I am also thinking of consolidating three drives over to the one I upgraded (reducing complexity). Is there a way to move the files over AND keep the file date (I want the movies I ripped to keep the date of the rip as file date).
November 9, 201510 yr Author Well, I am using EMBY to scan the movie folders and syslog is starting to report some errors, I guess in conjunction with the EMBY server reads (installed on a different PC in the house) I have attached my syslog. syslog.zip
November 9, 201510 yr Unraid is detecting file system corruption on disk 9, see here how to proceed. You may want to also check the other disks just in case.
November 9, 201510 yr Could have happened because of this: Went for a hard reboot, and the rebuild has worked! All drives are green, will monitor from now out. FS corruption was probably present before the last rebuild completed, Unraid can’t fix it during a rebuild, I any case you now need to run reiserfsck on disk9.
November 10, 201510 yr Author I typed in the console after I put the system in maintenance mode. This is what the console displayed later. reiserfsck --check /dev/md9 reiserfsck 3.6.24 Will read-only check consistency of the filesystem on /dev/md9 Will put log info to 'stdout' Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Tue Nov 10 20:37:48 2015 ########### Replaying journal: Trans replayed: mountid 295, transid 61996, desc 6179, len 1, commit 6181, next trans offset 6164 Trans replayed: mountid 295, transid 61997, desc 6182, len 1, commit 6184, next trans offset 6167 Replaying journal: Done. Reiserfs journal '/dev/md9' in blocks [18..8211]: 2 transactions replayed Killed root@Tower:~# Did something go wrong, was I supposed to get some sort of error message?
November 10, 201510 yr Author Also to report that my movies folder shares now show no movies at all, although I can still see the folders filled with movies on the individual drives. I have movie folders on all 14 drives, and some shared stopped working. I setup the root folder as a shared folder (unraid) and within it I have divx, dvds, blurays and tv series. The only one working is tv series.
November 11, 201510 yr I suspect that the reiserfsck ran out of RAM (you do not seem to have much on your system) and was killed as a result. There are parameter options to reduce its RAM usage although I do not have them to hand.
November 13, 201510 yr Author Disaster strikes. To install the memory I laid the server on its side, the usb key got caught and bent. Now the key is not recognized by any of the house PC, so I think it's toast. Used another key and installed a fresh version of unraid and now the server will not recognize it and boot unraid. Interestingly I tried all the four usb ports, and in three of the four cases, it lists the IRQs and stops there, CTRL/ALT/Del does not restart the machine, I have to hard reboot it. On one of the four USB slots, when it gets to the end of the IRQ devices display, it reboots (I wonder if it is not only the key that is bent, but also that particular USB slot is damaged, and trying to read the USB key causes it to reboot. I am sinking deeper and deeper here....
November 13, 201510 yr Author Found a smaller 2GB USB key, formatted it with FAT, and followed the instructions, same behaviour than with the larger USB key. I experience reboot on the one (damaged?) USB port, and no booting (freeze as C/A/D does not work?). This is a nightmare. I will try to connect the external USB connectors on the Stacker case with the motherboard, and see if it boots that way.
November 13, 201510 yr Author I connected the onboard UBS outputs with the coolermaster stacker usb slots and I experience the same reboot issue as soon as (I guess) the motherboard tries to boot from the key. I will now try to put back the old memory and see if it behaves any different.
November 13, 201510 yr Author Memory does not make a difference, reboots still happen occasionaly, or the booting process doesn't start (flashing cursor under the PCI devices listing table (IRQs on the side). I fear this means I need a new motherboard.
November 13, 201510 yr Actually, before you do that, I would go with a Power Supply. That fits most if not all of your symptoms Looking at your sig, you've got a dual rail 430W supply. The rail which is dedicated to your motherboard can handle 17A The rail which is for all of your drives can do 17A You've got 15 hard drives. Rough figures for each drive is max 2A per = 30A which is way over what 12v2 can handle (and even if the supply was single rail is awfully close to the total amps the supply can pump out) At that point, the effects of 12v1 (mobo) is going to be unknown depending upon how the supply is designed. Assuming that the server has been pretty much running 24/7 up until you started having problems, the shutting down of it would have been the final nail in its coffin (cold starts are the hardest on any electronic device). Your motherboard may still be damaged from the USB, but either way you require a new supply if your sig is correct.
November 16, 201510 yr Author I have disconnected all the hard disks, and the system still refuses to boot. I don't think it's the power supply. I am going to check the power rating, as I might already have upgraded it, and not tracked it in my signature. I have ordered a new USB key supported officially by Unraid, and try booting the system with that. If all fails, I will also purchase a new motherboard, does anyone know if this board is supported by unraid? Asrock 775I65G i865G http://www.pcupgrade.co.uk/productdetails.asp?productid=2412&categoryid=260
Archived
This topic is now archived and is closed to further replies.