Parity & Disk Errors

[JorgeB]

22 minutes ago, JorgeB said:

post new diags

 

[jazzy192]

Im not sure what it's doing, it keeps stopping and pausing. I have attached logs.

tower-diagnostics-20230322-2201.zip

[JorgeB]

Still looks like power/connection problems, did you replace the cables like suggested?

[jazzy192]

On 3/23/2023 at 9:10 AM, JorgeB said:

Still looks like power/connection problems, did you replace the cables like suggested?

 

Sorry for the late reply, I have not been well for quite some time. I wasn't being rude.

Could you job my memory and replace which ones? Also was there not a problem with one of the cashe drive? I have two 500gb cache at the moment but I have found a new Samsung Eco 970 1TB, thinks its 970. Also I may be wrong but I bought a 500gb I thinks its Phizon or something and came with a huge heatsink. I think it has to be a certain spec to the PS5, would it be worth popping in the server or would I add to up upgrade the mb/cpu etc fist? Sorry I am still not 100% but could really do with getting this running as and may may to resort to getting some physical help going it or is that unwise?

[JorgeB]

5 hours ago, jazzy192 said:

replace which ones?

Disk 5.

[jazzy192]

Well it’s all gone a little strange.

 

I changes then moles and sata power cables 

I then change SAS card to backplane cables (have used the before and they work fine).

 

First it would start at all then noticed the the sata and moles power cables used were not the  Silverstone ones (I thought they were universal all my life, oops!) so swapped them and it fired up fine. 

 

Fired it up and one of the parity discs was missing. I shutdown and reseated all the array drives in there hot swap bays, checked for damage on the party one but looked fine.

 

Started up again and now none of them are showing. Cables look fine.

 

Any ideas?

[JorgeB]

See if they are being detected in the board or HBA BIOS.

[jazzy192]

53 minutes ago, JorgeB said:

See if they are being detected in the board or HBA BIOS.

I didn’t noticed them before but will check again.

[jazzy192]

Hi guys,

 

Well, I reseated the drives and swapped the SAS card which BIOS picks up both. The only thing I can think of is that I when all this happened I swapped the backplane power cables to the PSU (Silverstone 750w). The reason was that it would not boot with the cables that used to work and were plugged in. If I disconnected them if fired up so I swapped to different Power cables and it boots fine. I was just thinking though, maybe the ones I swapped too don't actually work hence the booting up and not showing the drives in Unraid? I don't understand why the power cables stopped working but I will switch them back to the original which I used for 2-3 years and have a play with them. So it could be a PSU issue maybe? Im not sure what the warranty is on the Silverstone but under UK law if anything breaks upto 3 years you can challenged them even if its out of warranty, not many people know this but I have waived my rights to this multiple times with this, examples being: a Smeg toaster worth £160 (2 year old, 1 year warranty), Miele Washing Machine (2+ years, insure of warranty length). So I don't even look at the warranty length as I know I'm covered for three years (it is technically 5 I think but after 3 they can claim to wear and tear and its harder but anything under 3 years I just mentioned the 'Sales Of Goods Act 19XX' (forgotten the date) and 90% of the time im passed onto a manager to sort a replacement or it's done via the person im speaking too so I will check the age of the Silverstone PSU as that could be the fault.

 

Just remember though, for any product under 5 years you can quote the 'Sales Of Goods Act' for a replacement, under 3 years and it's pretty much done there and then. If its something expensive like a TV (I have done this with a 65" £1,700 LG TV that was just over 3 years old and I got an instant replacement, they picked up the old one and was given a new one that was at least the same spec (top of the line but newer) so don't worry about warranties in the UK unless they are something stop like 7 years.

 

Sorry for all that, just thought it might be useful for other forum members, that's all. So If I change the power cables back (the lights on the hot swap bays do light up mind you). I try some different power outputs from the PSU. This is probably a silly question but you can use any PSU cable, right? It doesn't have to be by the same manufacturer?  Just wondering as the one's im using are not Silverstone but the 4 x SSDs are showing up in BIOS and Unraid so im not sure it's a power issue, I could try with just 4 drivers connected instead of 8 and see if it boots with the old cable (it should work with the ones I swapped to though as the SSD's word fine. 

Remember I have tried 2 different SAS cards and 4 different sets of SAS to backplane cables. Whats the next step if it's still not seeing the disks with the other power cable? Change case with new backplanes? I do have 16 hot swap bays so I can move them all up to different rows to see if that makes a difference bt like I said, the power lights on the bays are coming on and I can hear the disks spin up. Tried 2 different SAS cards which are both in IT mode (or whatever they needed to be to work in Unraid). One is a Dell PERC something and the other which was always used I cannot remember. I do also have a SAS expander for when I ran 10 drives (2 for CCTV) but then I bought the extra SAS card. In hindsight, I should have just bought a 4 port SAS card. 

Lastly, as I'm kinda starting fresh, Im I ok to swap the Cache SSD drives to bigger ones? Or would I need to clone the data? Just my understanding is that as it would need a rebuild etc there wouldn't be anything on the SSDsw as the Docker Image etc and App data are on M.2 cards. Talking of which, how do I go about swapping M.2 with Docker Image and Appdata? I know it's off-topic but I might as well do all this while it's not working. Is it just a case of booting up Unraid, moving the Docker and things off the M.2 onto an SSD installed then swap the M.2 to a larger one? I only had diddy 2 x 256GB M.2s at the moment but I have a 1TB Samsung Evo 970 and a 500GB PCIE 4.0 which was in my PS5 before I upped that to 2TB. I know my 8th gen Motherboard cannot use PCIE 4.0 so I would have to upgrade to at least a 10th Gen I think which is something I was planning on anyhow.

[JonathanM]

7 hours ago, jazzy192 said:

This is probably a silly question but you can use any PSU cable, right?

No. There is no standard pinout for the PSU end of modular cables, and it's fairly common for the wrong cables to fry any drives or equipment connected. Putting +12V on the 5V pins of equipment generally ends badly.

[jazzy192]

1 hour ago, JonathanM said:

No. There is no standard pinout for the PSU end of modular cables, and it's fairly common for the wrong cables to fry any drives or equipment connected. Putting +12V on the 5V pins of equipment generally ends badly.

Ahh I see, well I will just pop the original back on. If there is such a possibility to fry them wouldn't they make the ends only work with their own cables so only the correct ones fit/goes in, if you follow? Just sounds bloody dumb if off you can put the wrong cable in when there is zero writing on the cables etc to identify its for the PSU.

Edited May 26, 2023 by jazzy192

[jazzy192]

Just going to go back to original now and hope it works. Regarding the M.2s I want to use the bigger capacity ones so should I just to that later then I hopefully get this going? 

Also, it it fails again, do you think it might be a PSU problem? It's strange as the Sata Drives are all show in Unraid. I have tried all 4 rows of backplanes (well 2 at a time) so I guess it could be them I suppose. 

 

My case os foobared anyhow as all the ball bearing fell out so need to order a new one. I know this isnt property at the the moment but I have 3 decent M.2 cards but only 2 slots, is it worth picking up one of the PCIe m.2 adapters? One of the M.2's is PCI-E 4 but wont work with my CPU/motherboard. 

Lastly, my cache are a miserable matching 500gb SSD, dont suppose you know of any links to some 1TB SSD's? It almost cheaper to just run one M.2 for cache but I need one for Docker/appdata really, one for windows pf and I guess I have a spare if I pick up one of them m.2 adapters...

 

Thing is though, the motherboard id quite old, GFX card if taking up the 16 slot, SAS the 8 and the M.2 would use up the 4, well they wouldn't run at full speed anyhow. I always want more PCIe lanes for as I have a 10gbe switch etc. If I was to go Ryzen again and use an Intel Arc 380 for Plex and Nvidia 4080 for Windows, do you know of any motherboards that can fit that much? Also will want to use 10gbe card if it doesnt have onboard and also 4 port SAS instead os using 2 x 2 port or 1 x 2 port and expander.

 

Im starting to think that this server has had a good innings but I really dont want to lose the data ideally. So im focusing on that and then onto CPU (Ryzen if Arc works) Motherboard, GFX card

[jazzy192]

Right, just a little update guys,

I have no idea why or what's going on but I 100% didn't touch see or even know about was binding a SAS card to the VFIO at boot. What a random thing to want but ok and no I certainly didn't turn that on. The only software settings I changed were about the above and told it not to bind to VFIO at boot

 

Still don't know what's going on at all as the only way I can get it going with all the drives was by adding a second LSI SAS card (YesI had tried this instead of the one used before updated the brand before anything self before this bo, but I the same specs (supports 8 drives etc) and using 4 connected to Port 0/A and 4 connected to posts 2/B with the same power cable which only has 3 outputs so just 3 of the backplanes work and it lets me pick and choose which 4 are connected into each backplane. 

If I plug 1 more into one of the other cards it does boot. Like 5 drives into the LSI and the other 3 drives into the other LSI, it doesn't boot. I tried several different combinations and switched PCI-E Slots and cables but it's always the same cards have to be any 4 into 1 and the other 4 into other. I might have missed one or two combinations but I think I have tried them. I cannot be bothered to check more so just want to check it won't be running slower due to using two diff LSI cards? Will it cause problems if I just look for a 4 port (16 cards) and use this for now?

Edited May 28, 2023 by jazzy192

[JorgeB]

Are the HBAs connected directly to the drives or are you using a backplane? If the latter which model?

[jazzy192]

4 minutes ago, JorgeB said:

Are the HBAs connected directly to the drives or are you using a backplane? If the latter which model?

 

It's the backplane bit have tried a few of them as there are 4 _ 2 + ld one to choose from. It's just going through sync now but will back soon. I did specifically run one drive through them also but I think was was duty my  testing part so don't remember which one it but it fired but fine.

[jazzy192]

Not been able to sort the use with the 2 SAS cards yet so still using two but a did the parity check after syncing the drives and it completed with no errors but as mentioned before Disk 4: Unmountable: unsupported of no file system

 

Near the bottom it says:

 

Unmountable disk present:
Disk 4 • WDC_WD80EZAZ-11TDBA0_7SK7KX7W (sdi)

 

and give me the option of: 

 

Format will create a file system in all Unmountable disks. 

 

with tick box of: Yes, I want to do this

 

Shall I go ahead and do this or does disc 4 need replacing?

Edited May 30, 2023 by jazzy192

[trurl]

If you format the disk you can't recover any of its data even by rebuilding

 

In the screenshots you posted here

https://forums.unraid.net/topic/136672-parity-disk-errors/?do=findComment&comment=1242968

It looks like you swapped parity and disk4. If that is what you did, then that might explain why the disk isn't mountable since parity has no mountable filesystem.

[JorgeB]

You still didn't mention the backplane model.

[jazzy192]

7 hours ago, trurl said:

If you format the disk you can't recover any of its data even by rebuilding

 

In the screenshots,q you posted here

https://forums.unraid.net/topic/136672-parity-disk-errors/?do=findComment&comment=1242968

It looks like you swapped parity and disk4. If that is what you did, then that might explain why the disk isn't mountable since parity has no mountable filesystem.

If you look a tad further up you will so me ask one of the guys had one of th discs moved place? I even pup a screenshot up showing had moved was told it wouldn't have on its own but does matter now. So I thought everything was fine now I could boot into Unraid etc.

So I have lost everything on disk 4 then? I thought the point of having the parity pics was so here was minimal loss?!

[jazzy192]

1 hour ago, JorgeB said:

You still didn't mention the backplane model.

I will check shortly but 4 are the same and possibly two different ones. I also have a SAS expander if that helps at all but I doubt it. Not sure why I have two SAS cards anyhow. 

[jazzy192]

Please could tell someone to let me know what I should do? Chuck the drive and replace it? Have I lost all on Disk 4?

[JorgeB]

Post new diags.

[jazzy192]

tower-diagnostics-20230530-1622.zip

 

Sure thing. 

[JorgeB]

Log is completely spammed with disk2 fs issues, check filesystem on disk2, reboot and post new diags after array start.

[jazzy192]

27 minutes ago, JorgeB said:

Log is completely spammed with disk2 fs issues, check filesystem on disk2, reboot and post new diags after array start.

 

There we go

tower-diagnostics-20230530-1712.zip