wyodoc1 Posted January 16, 2021 Share Posted January 16, 2021 I have an 8 drive array, and had a drive showing an increasing number of UDMA CRC error count, I decided it was a a good time to change it. A parity check was performed, single parity drive. Drive #4 a 5Tb was removed, but I still have it. I replaced Drive #4 with an 8Gb and let the parity rebuild begin. When almost complete drive #8 which had no indications of previous errors and no pre-failure concerns. I do and did look at all drives health before beginning. Now the array wont start because of too many wrong drives. I have the original 5Tb and it is still a functional disk. If I try to add it back it to the array I assume it will just want to be reformatted as if it is a new disk. So I am coming to the knowers-of-all things, am I F'd? Quote Link to comment
itimpi Posted January 16, 2021 Share Posted January 16, 2021 I am not sure what happened to drive #8 from your description You are likely to get better informed feedback if you attach your systems diagnostics zip file (obtained via Tools->Diagnostics) to your NEXT post. Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 Thanks, yes been around long enough I should have done it. storage-diagnostics-20210115-2306.zip Quote Link to comment
itimpi Posted January 16, 2021 Share Posted January 16, 2021 Looking at your diagnostics it seems disk8 has completely disappeared - is this correct? Have you tired power cycling the server to see if it comes back? Since you still have the original disk #4 intact you should be able to get back to a working state with your data intact even if disk #8 is completely dead. However I would recommend waiting for @JorgeB as the best person to provide instructions on the necessary steps. Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 Correct, it is terminal and will not register in BIOS, I have tried several systems to eliminate the motherbaord and an USB drive enclosure. Quote Link to comment
itimpi Posted January 16, 2021 Share Posted January 16, 2021 3 minutes ago, wyodoc1 said: Correct, it is terminal and will not register in BIOS, I have tried several systems to eliminate the motherbaord and an USB drive enclosure. OK. @JorgeB should be able to guide you through the steps using the combination of the New Config tool and the invalidslot command to get you into a state where the array is using the old disk #4 and emulating the missing disk #8. Do you have the disk available for rebuilding the missing disk #8 (perhaps the one you were trying to use for replacing disk #4)? Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 I do have the original drive #5 I removed and can use the intended replacement for it to replace dead #8. This gives me some hope, thank you. I will do some reading on the New Config tool, and the invalidshot command, but wait any offered guidance before I try anything. Quote Link to comment
JorgeB Posted January 16, 2021 Share Posted January 16, 2021 Diags are with the array stopped, what filesystem are you suing for the array? Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 They are formatted XFS. Quote Link to comment
JorgeB Posted January 16, 2021 Share Posted January 16, 2021 This will only work if parity is still valid: -Tools -> New Config -> Retain current configuration: All -> Apply -Check all assignments and assign any missing disk(s) if needed, including old disk5 and new disk8, replacement disk8 should be same size or larger than the old one -IMPORTANT - Check both "parity is already valid" and "maintenance mode" and start the array (note that the GUI will still show that data on parity disk(s) will be overwritten, this is normal as it doesn't account for the checkbox, but it won't be as long as it's checked) -Stop array -Unassign disk8 -Start array (in normal mode now), ideally the emulated disk8 will now mount and contents look correct, it might not since the array was started without old disk5 so parity won't be 100% valid with it back in, if it doesn't mount hopefully a filesystem check on the emulated disk will fix it -If the emulated disk mounts and contents look correct stop the array -Re-assign disk8 and start array to begin rebuilding. Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 Thank, makes sense. While my confidence is pretty high on the valid parity, would it be safest to begin rebuilding with new drives, mounting the current drives and copying the data manually? Quote Link to comment
JorgeB Posted January 16, 2021 Share Posted January 16, 2021 Disk8 will already be new, that procedure won't change data on any of the other data devices. Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 Thanks, I will give it shot, very little of the data isnt backed up elsewhere should it go badly. Quote Link to comment
wyodoc1 Posted January 16, 2021 Author Share Posted January 16, 2021 Jorge thank you, it seems to have worked. A quick check of the data looked good, drives are not doing a data rebuild, thanks to itimpi for monitoring the forums, and JorgeB for the extensive knowledge and both of you for giving of your time and knowledge. 1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.