Been getting too many errors and having too many issues with my server. I am worried something is seriously wrong with some of the drives or the USB device or other hardware of the system.

 

Attaching the syslog.

 

Issues noted:

[*]All drives showed up as unassigned - I had to reassign and rebuild parity based on a screenshot from earlier. NO idea why this happened - it was in the middle of the tower running too. No data was lost but no idea why this happened.

[*]Not able to stop array from the WebGUI - unmounting disks runs into a neverending loop. Hard reset powers down the system.

[*]Clients loose connection to server often - SAMBA shares become unaccessible. WebGUI is still running and can be refreshed, connection via putty also works, but shares are inaccessible over any Windows machine.

[*]unMenu shows all drives are unassigned still - while the WebGUI shows everything is reassigned and working fine. Screenshots attached.

[*]Lots of other errors in logs - many rsync errors.

 

I recently replaced a drive (sdd - Disk 2) - not sure if that had anything to do with all this. 4 other drives are all showing 'End-to-End Error: Failing now' and another is showing 'Command Time-Out error'. Please help - all help is greatly appreciated.

 

Thanks.

 

UNMENU

 

WEBGUI

tower-syslog-20151218-1523.zip

syslog-20151217-212020.zip

First off, you've got a ton of errors which looks like you may have some slightly loose cabling to various drives in the system.  Reseat everything.

 

Secondly, it appears that you're running overbyrn's beets plugin.  This plugin is NOT listed as being compatible with v6.1.  You may also have some other plugins that aren't compatible.

 

Thirdly, it doesn't appear that you've added the symbolic link in the go file to make unMenu compatible with v6.1

 

This is what I'd do:

 

Remove ALL the plugins including unMenu

Reseat all of the cabling.

Start the system back up and see how it goes.

 

After that, then I would start adding in the plugins again, but making sure that they are v6.1 compatible.

 

If there's still problems after that, then support will be a little easier because at least the system will be compliant.

 

And then instead of syslogs, post up the diagnostics instead

 

 

 

 

Thanks a ton Squid. Will do over the weekend and report.

Okay sorry it took me longer than expected to do perform some updates.

 

I transfered everything to my new Norco 4224 and upgraded all the hardware (unrelated to this - but was planning on doing this for quite some time) -M/B: Supermicro - X10SAE

CPU: Intel® Xeon® CPU E3-1231 v3 @ 3.40GHz with some 8GB(2 x 4GB) Unbuffered ECC DIMMs. Works much better now - however there are still some errors happening.

Pasting the errors filtered from unMenu syslog below - not sure what is the reason.

 

Also 5 of my drives are showing some kind of errors - most of them are 'End-to-End Errors: Failing Now' and one is 'command time-out' - are these critical?

 

 

Could someone please take a look and help me understand these errors please, if you need more info then please do let me know.

 

Thanks.

 

Dec 24 20:37:21 Tower kernel: serial 0000:00:16.3: Couldn't register serial port f080, irq 17, type 0, error -28 (Errors)
Dec 24 20:37:21 Tower kernel: ata2.00: failed to IDENTIFY (I/O error, err_mask=0x100) (Errors)
Dec 24 20:37:21 Tower kernel: ata14.00: failed to get NCQ Send/Recv Log Emask 0x1 (Errors)
Dec 24 20:37:21 Tower kernel: ata14.00: failed to get NCQ Send/Recv Log Emask 0x1 (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: exception Emask 0x50 SAct 0x800000 SErr 0x280900 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata1: SError: { UnrecovData HostInt 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:b8:00:00:00/00:00:00:00:00/40 Emask 0x50 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: exception Emask 0x50 SAct 0x20 SErr 0x280900 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata1: SError: { UnrecovData HostInt 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:28:08:00:00/00:00:00:00:00/40 Emask 0x50 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: exception Emask 0x50 SAct 0x40 SErr 0x280900 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata1: SError: { UnrecovData HostInt 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:30:08:00:00/00:00:00:00:00/40 Emask 0x50 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: exception Emask 0x10 SAct 0x200 SErr 0x280100 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata1.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata1: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:48:18:00:00/00:00:00:00:00/40 Emask 0x10 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata2.00: failed to enable AA (error_mask=0x100) (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: exception Emask 0x10 SAct 0x100 SErr 0x280100 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata5: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:40:40:01:00/00:00:00:00:00/40 Emask 0x10 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: exception Emask 0x10 SAct 0x800000 SErr 0x280100 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata5: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:b8:58:01:00/00:00:00:00:00/40 Emask 0x10 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: exception Emask 0x10 SAct 0x400 SErr 0x280100 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata5: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:50:88:01:00/00:00:00:00:00/40 Emask 0x10 (ATA bus error) (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: exception Emask 0x10 SAct 0x4 SErr 0x280100 action 0x6 frozen (Errors)
Dec 24 20:37:21 Tower kernel: ata5.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 24 20:37:21 Tower kernel: ata5: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 24 20:37:21 Tower kernel:         res 40/00:10:e0:01:00/00:00:00:00:00/40 Emask 0x10 (ATA bus error) (Errors)
Dec 25 03:40:38 Tower kernel: ata6.00: exception Emask 0x10 SAct 0x0 SErr 0x280100 action 0x6 frozen (Errors)
Dec 25 03:40:38 Tower kernel: ata6.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 25 03:40:38 Tower kernel: ata6: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 25 03:40:38 Tower kernel:         res 50/00:00:9f:59:bf/00:00:17:01:00/e0 Emask 0x10 (ATA bus error) (Errors)
Dec 25 03:40:55 Tower kernel: ata6.00: exception Emask 0x10 SAct 0x0 SErr 0x280100 action 0x6 frozen (Errors)
Dec 25 03:40:55 Tower kernel: ata6.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 25 03:40:55 Tower kernel: ata6: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 25 03:40:55 Tower kernel:         res 50/00:00:17:05:4b/00:00:04:01:00/e0 Emask 0x10 (ATA bus error) (Errors)
Dec 25 03:41:05 Tower kernel: ata6.00: exception Emask 0x10 SAct 0x0 SErr 0x280100 action 0x6 frozen (Errors)
Dec 25 03:41:05 Tower kernel: ata6.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 25 03:41:05 Tower kernel: ata6: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 25 03:41:05 Tower kernel:         res 50/00:00:07:65:54/00:00:04:01:00/e0 Emask 0x10 (ATA bus error) (Errors)
Dec 25 03:41:06 Tower kernel: ata6.00: exception Emask 0x10 SAct 0x0 SErr 0x280100 action 0x6 frozen (Errors)
Dec 25 03:41:06 Tower kernel: ata6.00: irq_stat 0x08000000, interface fatal error (Errors)
Dec 25 03:41:06 Tower kernel: ata6: SError: { UnrecovData 10B8B BadCRC } (Errors)
Dec 25 03:41:06 Tower kernel:         res 50/00:00:e7:75:54/00:00:04:01:00/e0 Emask 0x10 (ATA bus error) (Errors)

Those errors in the syslog snippet all look to be cable / power related.  Cabling not making a good connection either at the backplane (8087 or power) or at your HBA

 

Your really should post your complete diagnostics.  But, I will say this about the End-To-End Errors.

 

Hard Drives are set up so that a single failure of this attribute is enough to have the drive fail the smart attributes (FAILING_NOW)  This attribute indicates a failure of the CRC's between the cache internal to the drive and the drive's actual controller.  Hence, it is indicative of a very serious problem with the electronics of the drive. 

 

That being said, I also have a drive that has an end-to-end error on it, but I also know the exact circumstance of when it appeared (quick power blip), and there has never been a reoccurrance, so I am keeping it in service (plus its out of warranty), and it hasn't changed for 3 years (And I watch it like a hawk)

 

With 4 drives showing the same failing attribute (and once again it only takes a single failure to throw the drive into failing now status), there is a chance that the errors occurred due to an outside influence, but for safety sake you really should replace them asap.

 

Command Time Out on Seagate Drives is a false positive because the number that unRaid is currently monitoring is the RAW value (a value which changes constantly, and only has any meaning to Seagate themselves) instead of the Value and the Threshold values.  Net result is that its safe to ignore this (and to avoid future warning, disable monitoring of that attribute (188) for Seagate Drives.

 

Thanks again Squid.

 

When you say post complete diagnostics - what all do you need and how do I go about getting that?

Thanks again Squid.

 

When you say post complete diagnostics - what all do you need and how do I go about getting that?

Tools - Diagnostics. Post complete zip.

Please read the stickies