November 30, 201213 yr Your disk temps are wayyy too high....49C? Thats a lot! Are there fans in front of hdds? If the drives are packed together, each of them should have wind blowing into it. For example I have 24 - 25C on average.
November 30, 201213 yr Author Your disk temps are wayyy too high....49C? Thats a lot! Are there fans in front of hdds? If the drives are packed together, each of them should have wind blowing into it. For example I have 24 - 25C on average. Those temps are during data rebuild though. Usually the drives (when in the drive cages - each with an 80mm fan) range from 35 - 40 degrees C during normal use. The WD20EARS has always run a little hotter (usually 2 degrees above then next hottest disk). Having said that, the temps you are referring to were with the drives removed from the drive cages, drives were sitting in the drive trays elevated on some wood (to allow air underneath) there was no mechanical cooling other than my ceiling fan, and it was the middle of the day so ambient temp was high.
November 30, 201213 yr Smart test on disk 3 would not complete (stayed at 90% for 10 minutes - and I aborted). Simple features displayed smart data for the drive so I grabbed the report anyway Disk 4 completed no problems Reports attached ................................................................ The report on disk 3 shows 44 pending sectors, so it looks like the disk has major problems right?? If that is the case then am I right in thinking I'll have to unassign and remove disk 3 completely. This will mean I'll be unable to reconstruct disk 4 so that data will be gone too? So once backing up is complete (I should get all of disk 4 and 80% of disk 3 - the other 20% can be replaced easily), should I remove disk 3 and 4 completely, recontruct parity with just disk 1 and 2 present, then re-add disk 4 and copy the backed up data on to it, then purchase another disk to replace disk 3 and copy backed up data to it? 44 pending sectors does not have to be dramatically.. Offline uncorrectable is a bit worse, but the real trigger is when those numbers increase, THAT is a real indicator that the drive is failing. From my point of view it still looks like an external factor and not the drive beiing the issue here.. But I would invite others to comment also, with the stepsallready taken I cannot think of what would be the wise move next..
November 30, 201213 yr Author 44 pending sectors does not have to be dramatically.. Offline uncorrectable is a bit worse, but the real trigger is when those numbers increase, THAT is a real indicator that the drive is failing. From my point of view it still looks like an external factor and not the drive beiing the issue here.. But I would invite others to comment also, with the stepsallready taken I cannot think of what would be the wise move next.. I'm not sure what else it could be if it's not the drive itself. The sata data cable has been replaced, the drive is most likely plugged into a different power cable than before (i didn't take note of which power cable was plugged into which drive I just unplugged them) perhaps the sata port on the motherboard has the problem?? Right now I'm about half way through backing up all data off drive 3 and drive 4. Data seems to be coming off disk 3 fine, and disk 4 data is also available (so the array is emulating disc 4 fine). Do you think it is wise to unassign disk 3 and 4 (once i've backed them up) and just get the array stable and parity protected with just disk 1 and 2. Then worry about disk 3 and 4 later.?
November 30, 201213 yr A drive with pending sectors must be rebuilt. Pending sectors represent unreadable sectors. No array disk may have pending sectors. Pending sectors need to be resolved ASAP. Pending sectors on a single disk will prevent or seriously complicate the rebuilding of another disk. Often rebuilding in place will resolve the pending sectors. A safer option is to use a spare pre-cleared disk to replace the one with pending sectors and then run pre-clear while the disk rebuilds on the spare. After the pending sector count goes to zero the disk can be used.
November 30, 201213 yr You could try a big fan trying to keep the drives cooler. However, at this point it looks like you're on the right track backing up what you can and starting over with 2 disks as you have indicated. I would be questioning why 2 out of 4 disks started failing at the same time though. Heat? Power supply? Something else? A drive with pending sectors must be rebuilt. Pending sectors represent unreadable sectors. No array disk may have pending sectors. Pending sectors need to be resolved ASAP. Pending sectors on a single disk will prevent or seriously complicate the rebuilding of another disk. Often rebuilding in place will resolve the pending sectors. A safer option is to use a spare pre-cleared disk to replace the one with pending sectors and then run pre-clear while the disk rebuilds on the spare. After the pending sector count goes to zero the disk can be used. Like the exact problem the OP is having which excludes him from being able to follow any of the advice following the highlighted portion?
November 30, 201213 yr Cool those drives! Those temps are at least 10c higher than I see rebuild or not...
November 30, 201213 yr 44 pending sectors does not have to be dramatically.. Offline uncorrectable is a bit worse, but the real trigger is when those numbers increase, THAT is a real indicator that the drive is failing. From my point of view it still looks like an external factor and not the drive beiing the issue here.. But I would invite others to comment also, with the stepsallready taken I cannot think of what would be the wise move next.. I'm not sure what else it could be if it's not the drive itself. The sata data cable has been replaced, the drive is most likely plugged into a different power cable than before (i didn't take note of which power cable was plugged into which drive I just unplugged them) perhaps the sata port on the motherboard has the problem?? Right now I'm about half way through backing up all data off drive 3 and drive 4. Data seems to be coming off disk 3 fine, and disk 4 data is also available (so the array is emulating disc 4 fine). Do you think it is wise to unassign disk 3 and 4 (once i've backed them up) and just get the array stable and parity protected with just disk 1 and 2. Then worry about disk 3 and 4 later.? This looks like the best option. Save as much as you can from the 2 disks. Then unassign both drives, reset the array config, and rebuild parity. Meanwhile run pre-clear on the 2 disks. Make sure that the pending count goes to zero. It may take more than one pre-clear cycle. Once pending RAW_VALUE goes to zero and all normalized VALUEs are above THRESH then add the drives to the array.
December 1, 201213 yr Author Alright, so right now disk 3 and 4 are preclearing. The array has been reset and just disk 1 and 2 added, parity is being calculated now. The preclearing process does extended SMART tests after the preclearing stage doesn't it?? Am I able to grab a copy of that report once preclearing is done?? Is it done the same as normal (smartctl -a -d ata /dev/sdX >/boot/smart.txt)??
December 1, 201213 yr If you are using preclear_disk.sh 1.13 it puts copies of the reports in the directory preclear_reports on the flash drive with 3 files for each drive. Something like this: preclear_finish_ Z2AYS6FP_2012-11-29 preclear_rpt_ Z2AYS6FP_2012-11-29 preclear_start_ Z2AYS6FP_2012-11-29 Finish is the final preclear report. Start is the begining preclear report. RPT is the summary report showing the changes between the two reports and ending results on the most important parameters. It also shows elapsed times. RPT for above: ========================================================================1.13 == invoked as: ./preclear_disk.sh /dev/sda == VB0250EAVER Z2AYS6FP == Disk /dev/sda has been successfully precleared == with a starting sector of 64 == Ran 1 cycle == == Using :Read block size = 8225280 Bytes == Last Cycle's Pre Read Time : 0:48:01 (86 MB/s) == Last Cycle's Zeroing time : 0:51:38 (80 MB/s) == Last Cycle's Post Read Time : 1:53:18 (36 MB/s) == Last Cycle's Total Time : 3:33:58 == == Total Elapsed Time 3:33:58 == == Disk Start Temperature: 31C == == Current Disk Temperature: 32C, == ============================================================================ ** Changed attributes in files: /tmp/smart_start_sda /tmp/smart_finish_sda ATTRIBUTE NEW_VAL OLD_VAL FAILURE_THRESHOLD STATUS RAW_VALUE Raw_Read_Error_Rate = 119 118 6 ok 220893203 Spin_Retry_Count = 100 100 97 near_thresh 0 End-to-End_Error = 100 100 97 near_thresh 0 Airflow_Temperature_Cel = 68 69 45 near_thresh 32 Temperature_Celsius = 32 31 0 ok 32 Hardware_ECC_Recovered = 57 61 0 ok 220893203 No SMART attributes are FAILING_NOW 0 sectors were pending re-allocation before the start of the preclear. 0 sectors were pending re-allocation after pre-read in cycle 1 of 1. 0 sectors were pending re-allocation after zero of disk in cycle 1 of 1. 0 sectors are pending re-allocation at the end of the preclear, the number of sectors pending re-allocation did not change. 0 sectors had been re-allocated before the start of the preclear. 0 sectors are re-allocated at the end of the preclear, the number of sectors re-allocated did not change. ============================================================================
December 2, 201213 yr Author So I've got the array up and running with just disk 1 and 2 - its been running fine for a number of hours. Disk 3 and 4 have just finished preclearing, smart reports attached. Are these disks good to go or do they need to be RMA'd? What happened to the 44 pending sectors, it says none were re-allocated? ................................................. The syslog I posted earlier (post #21) shows lots of errors related to ata 4, I assume this is referring sata port 4? Could the actual port on the motherboard be causing the problems? I might mount a spare drive outside the array on port 4 and write a bunch of junk to it to see if the errors crop up again. SMART.zip
Archived
This topic is now archived and is closed to further replies.