Jump to content

[SOLVED] Disk7 keeps failing - even new HDD, sata, different port.


Recommended Posts

Hello,

 

I just recently added a new hard drive to my array and it's causing me some issues.

 

I now have 7 disks, 1 parity and 1 cache.

 

The issue:

 

Disk 7 gets disabled after a couple of days with errors on wite.

Reboot no longer recognizes the device.

Unplug, replug the cable and it's back online.

Short SMART woud pass

Long SMART would not finish because it would lose the device and not able to communicate with it

 

What I tested:

 

I swapped our the SATA cable = Same issue

I changed port the SATA cable is in = Same issue

RMA'ed hard drive and got a brand spanking new one: Same issue

Prior to adding the disk to the array I had used Preclear and no errors were found.

 

This only happens one disk 7, even with 2 new drives, sata cable, sata port... it still causes the issue.

 

MY setup:

 

Unraid 4.6-rc2 (My moto, if ain't broke, don't fix it. I had a lot of issues with the previous versions but this one has been very stable - 8 months with no crash). I want to avoid having to upgrade it but if something is confirmed as a bug with this version, then i'll update.

 

Supermicro AOC-SAT2-MV8 8 Port SATA Card Pcix 64BIT 133MHZ RAID

Intel BOXD945GCLF2 MINI-ITX DDR2 945GC Dual Core Atom 1PCI Motherboard Retail

 

Syslog snippet:

 

Aug 13 04:43:09 kenny kernel: REISERFS error (device md6): vs-13070 reiserfs_read_locked_inode: i/o failure occurred trying to find stat data of [4 1558 0x0 SD]
Aug 13 04:43:09 kenny kernel: REISERFS error (device md6): vs-13070 reiserfs_read_locked_inode: i/o failure occurred trying to find stat data of [4 1554 0x0 SD]
Aug 13 04:43:09 kenny kernel: REISERFS error (device md6): vs-13070 reiserfs_read_locked_inode: i/o failure occurred trying to find stat data of [4 494 0x0 SD]
Aug 13 04:43:09 kenny kernel: REISERFS error (device md6): vs-13070 reiserfs_read_locked_inode: i/o failure occurred trying to find stat data of [4 1561 0x0 SD]
Aug 13 04:43:09 kenny kernel: REISERFS error (device md6): vs-13070 reiserfs_read_locked_inode: i/o failure occurred trying to find stat data of [4 773 0x0 SD]

 

Aug 13 08:05:41 kenny kernel: end_request: I/O error, dev sdj, sector 72
Aug 13 08:05:41 kenny kernel: sd 11:0:0:0: [sdj] Unhandled error code
Aug 13 08:05:41 kenny kernel: sd 11:0:0:0: [sdj] Result: hostbyte=0x04 driverbyte=0x00
Aug 13 08:05:41 kenny kernel: sd 11:0:0:0: [sdj] CDB: cdb[0]=0x28: 28 00 00 00 00 48 00 00 08 00

Link to comment

it's on the same sata card, all other drives work fine, i even switched row of the sata port in case they have some commonalities.

 

The power cable came from a seperate wire as well.

 

I'm currently rebuilding the array with a brand new hard drive I bought (So now I have 2 new drives).

 

This new drive is on a completely new port, new power cable. *Note*: If it makes a difference, it's an older power supply so the 4 pin molex's are converted to SATA.

 

I am fairly certain my power supply can handle the load. Most drives are WD Greens, but even if they were Black's they would consume 8.4 watts. With 10 in there, even at full load they would only consume 80 watts and the motherboard I have consumes about 40. I think my PS is a 200 watt so I don't see it being an issue.

 

While the array is rebuilding, every couple of hours i see this error;

 

Aug 14 13:31:49 kenny kernel: ata9.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
Aug 14 13:31:49 kenny kernel: ata9.00: failed command: READ DMA
Aug 14 13:31:49 kenny kernel: ata9.00: cmd c8/00:90:cf:c6:bd/00:00:00:00:00/ec tag 0 dma 73728 in
Aug 14 13:31:49 kenny kernel: res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Aug 14 13:31:49 kenny kernel: ata9.00: status: { DRDY }
Aug 14 13:31:54 kenny kernel: ata9: link is slow to respond, please be patient (ready=0)
Aug 14 13:31:59 kenny kernel: ata9: device not ready (errno=-16), forcing hardreset
Aug 14 13:31:59 kenny kernel: ata9: soft resetting link
Aug 14 13:31:59 kenny kernel: ata9.00: configured for UDMA/133
Aug 14 13:31:59 kenny kernel: ata9.00: device reported invalid CHS sector 0
Aug 14 13:31:59 kenny kernel: ata9: EH complete

Link to comment

it's on the same sata card, all other drives work fine, i even switched row of the sata port in case they have some commonalities.

 

The power cable came from a seperate wire as well.

 

I'm currently rebuilding the array with a brand new hard drive I bought (So now I have 2 new drives).

 

This new drive is on a completely new port, new power cable. *Note*: If it makes a difference, it's an older power supply so the 4 pin molex's are converted to SATA.

 

I am fairly certain my power supply can handle the load. Most drives are WD Greens, but even if they were Black's they would consume 8.4 watts. With 10 in there, even at full load they would only consume 80 watts and the motherboard I have consumes about 40. I think my PS is a 200 watt so I don't see it being an issue.

 

While the array is rebuilding, every couple of hours i see this error;

 

Aug 14 13:31:49 kenny kernel: ata9.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
Aug 14 13:31:49 kenny kernel: ata9.00: failed command: READ DMA
Aug 14 13:31:49 kenny kernel: ata9.00: cmd c8/00:90:cf:c6:bd/00:00:00:00:00/ec tag 0 dma 73728 in
Aug 14 13:31:49 kenny kernel: res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Aug 14 13:31:49 kenny kernel: ata9.00: status: { DRDY }
Aug 14 13:31:54 kenny kernel: ata9: link is slow to respond, please be patient (ready=0)
Aug 14 13:31:59 kenny kernel: ata9: device not ready (errno=-16), forcing hardreset
Aug 14 13:31:59 kenny kernel: ata9: soft resetting link
Aug 14 13:31:59 kenny kernel: ata9.00: configured for UDMA/133
Aug 14 13:31:59 kenny kernel: ata9.00: device reported invalid CHS sector 0
Aug 14 13:31:59 kenny kernel: ata9: EH complete

10 drives on a 200 watt supply.  Stop wasting my time.

 

Even if all the drives were low power green drives they would need a 12 volt rail capable of at least 25 to 30 amps.  20 amps for the drives, and 5 more for fans, the CPU, motherboard, etc.

 

I don't know how you do your math, but 12 volts X 30 amps = at least 360 watts on the 12 volt rail alone. A 200 watt supply is completely inadequate.

 

Joe L.

 

Link to comment

it's on the same sata card, all other drives work fine, i even switched row of the sata port in case they have some commonalities.

 

The power cable came from a seperate wire as well.

 

I'm currently rebuilding the array with a brand new hard drive I bought (So now I have 2 new drives).

 

This new drive is on a completely new port, new power cable. *Note*: If it makes a difference, it's an older power supply so the 4 pin molex's are converted to SATA.

 

I am fairly certain my power supply can handle the load. Most drives are WD Greens, but even if they were Black's they would consume 8.4 watts. With 10 in there, even at full load they would only consume 80 watts and the motherboard I have consumes about 40. I think my PS is a 200 watt so I don't see it being an issue.

 

While the array is rebuilding, every couple of hours i see this error;

 

Aug 14 13:31:49 kenny kernel: ata9.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
Aug 14 13:31:49 kenny kernel: ata9.00: failed command: READ DMA
Aug 14 13:31:49 kenny kernel: ata9.00: cmd c8/00:90:cf:c6:bd/00:00:00:00:00/ec tag 0 dma 73728 in
Aug 14 13:31:49 kenny kernel: res 40/00:ff:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Aug 14 13:31:49 kenny kernel: ata9.00: status: { DRDY }
Aug 14 13:31:54 kenny kernel: ata9: link is slow to respond, please be patient (ready=0)
Aug 14 13:31:59 kenny kernel: ata9: device not ready (errno=-16), forcing hardreset
Aug 14 13:31:59 kenny kernel: ata9: soft resetting link
Aug 14 13:31:59 kenny kernel: ata9.00: configured for UDMA/133
Aug 14 13:31:59 kenny kernel: ata9.00: device reported invalid CHS sector 0
Aug 14 13:31:59 kenny kernel: ata9: EH complete

10 drives on a 200 watt supply.   Stop wasting my time.

 

Even if all the drives were low power green drives they would need a 12 volt rail capable of at least 25 to 30 amps.  20 amps for the drives, and 5 more for fans, the CPU, motherboard, etc.

 

I don't know how you do your math, but 12 volts X 30 amps = at least 360 watts on the 12 volt rail alone. A 200 watt supply is completely inadequate.

 

Joe L.

 

 

So this may be the problem then? Wouldn't the power supply reboot the machine if there wasnt' enough power?

Link to comment

I've ran into this same problem before.  What I saw was 1 or 2 hard drives either not showing up on boot, or some time after running, becoming disabled through unraid.  Usually it was always the same drive, but when I changed up the controller, the problem would jump to a new drive.

 

Getting a larger power supply solved that problem.

Link to comment

That is not a single single rail power supply. There are 3 12V rails at 25 peak amps each. You'll need to carefully balance the loading if its possible. Please see the power supply thread for more info.

Actually,... on most supplies, there is NO way to "balance" the load. 

 

On most, one rail is reserved for the CPU, one for the PCIe cards, and the remaining the motherboard and the disk connectors. 

 

Do NOT fool yourself.  You may have only 15 or 16 amps available for disks on that multi-rail supply on the 12 volt rail for your disks.  You'll need to research the way the 12volt rails are connected.  Perhaps your manual will help.  You might get lucky if it is a modular supply and be able to use the three rails... but don't bet on it.

Link to comment

I'm still trying to grasp what i've ready over to the Power Supply thread.

 

Based on what Joe and the rest of you are telling me, if a HDD is 3 amps X 12 Volts = 36 Watts per drive.

 

So I need to find a Power supply that can accommodate 360 Watts on a single rail.

 

So my understanding is that even a 650 Watt power supply may not actually be rated at 650 true watts because it's segmented into the different rails (1 rail is true 650 watts, while 3 rails is split into those 3).

 

So my best bet is to read the manual and see if I can get at least 360 Watts off one rail.

Link to comment

I'm still trying to grasp what i've ready over to the Power Supply thread.

 

Based on what Joe and the rest of you are telling me, if a HDD is 3 amps X 12 Volts = 36 Watts per drive.

 

So I need to find a Power supply that can accommodate 360 Watts on a single rail.

 

So my understanding is that even a 650 Watt power supply may not actually be rated at 650 true watts because it's segmented into the different rails (1 rail is true 650 watts, while 3 rails is split into those 3).

 

So my best bet is to read the manual and see if I can get at least 360 Watts off one rail.

You almost have it, but even a single rail power supply rated at 650 watts will not be able to deliver 650 watts to the 12 volt rail.  Those watts also include the 5 volt and 3.3 volt supplies.  

 

As an example, the CORSAIR CMPSU 650TX has these specs:

+3.3V@24A, +5V@30A, +12V@52A, [email protected], [email protected]

 

3.3 volts * 24 Amps = 79.2 Watts

5.0 volts * 30 Amps = 150 Watts

12 volts * 52 Amps = 624 Watts

-12 Volts * .8 Amps = 9.6 Watts

5 Volts * 3 Amps =  15 Watts

 

These add up to more than 650 Watts.   If you read the manual for that supply, it states that you cannot exceed 650 watts total from all the supply rails.

 

It also shows that the 3.3 volt supply and 5 volt supply have a max combined wattage of 170 watts.  It the load on the 5Volt and 3.3 Volt supplies is low, you might be able to use most of the 624 watts potentially available on the 12 volt rail.  

 

Most single rail supplies have this same limitation.   Even though the 12 volt rail might have the capacity, the total wattage available must be shared by the load on the 5 volt and 3.3 volt rails.   Most disk drives will draw about an amp on the 5 volt supply.  For your 10 drives, that is 50 watts of the total capacity of the power supply not available for 12 volt rail.  You can probably add another 50 or more watts used by the motherboard.  All of a sudden 100 watts of your 650 watt total is in use.  Now, you can possibly draw 550 watts from the 12 volt rail.  That would be 45 Amps.  (sized for roughly 15 to 18 drives, maybe 20 if they were all "green" drives... remember, you still need to power case fans)  Now you can see how the "marketing department" makes the supply seem higher capacity that it might actually be able to handle.

 

You can see that in the attached table from another PSU marketed as a single rail 650 watt supply.

 

Joe L.

http://www.corsair.com/tx650w.html

650_watt_power_supply_example.JPG.01fdebfb62ff132c7f61160cd54e82d2.JPG

Link to comment

Ah, ok thanks.

 

I did more research, I actually have the 385W Enermax Pro82+. it has 2 rails rated at up to 20A each, but combined to 30A... So i guess 30A is my limit.

 

I imagine I will be able to identify each rail based on the wires coming out of the PS.

ENERMAX_-_Product.png.e4014216e521d76a33a47056c71c6760.png

Link to comment

Ah, ok thanks.

 

I did more research, I actually have the 385W Enermax Pro82+. it has 2 rails rated at up to 20A each, but combined to 30A... So i guess 30A is my limit.

 

I imagine I will be able to identify each rail based on the wires coming out of the PS.

If I'm reading the manual for that supply correctly, it appears as if :

12V1 powers the 24P motherboard connector and the 4+4P CPU connectors.

12V2 powers the 1x 6P PCI-E, all 5x SATA, all 4x 4P Molex connectors, and the 1x FDD connector.

 

Your total capacity for disks and case fans is therefore at best 20 Amps (peak)   Your limit is 20 Amps... not 30. (assuming the motherboard and CPU do not use more than 10 Amps)  Even though the 12V1 supply may have  additional unused capacity, you cannot access it as it is only used the the motherboard and CPU connectors.

Link to comment

Ah, ok thanks.

 

I did more research, I actually have the 385W Enermax Pro82+. it has 2 rails rated at up to 20A each, but combined to 30A... So i guess 30A is my limit.

 

I imagine I will be able to identify each rail based on the wires coming out of the PS.

If I'm reading the manual for that supply correctly, it appears as if :

12V1 powers the 24P motherboard connector and the 4+4P CPU connectors.

12V2 powers the 1x 6P PCI-E, all 5x SATA, all 4x 4P Molex connectors, and the 1x FDD connector.

 

Your total capacity for disks and case fans is therefore at best 20 Amps (peak)   Your limit is 20 Amps... not 30. (assuming the motherboard and CPU do not use more than 10 Amps)

 

it took me a while to find it but I see now. Thanks for pointing it out.

 

It seems to be getting confusing with multi rail power supplies.

 

I found a cheap single rail power supply that got some good reviews. It's the XFX Pro550W Core edition. It's rated at 44A for the 12Vrail.

 

If i'm getting this right, 5A for the Motherboard, worst case scenario 3A per drive = 30A so i'll have another 9A to spare for fans and PCI cards. Considering most of my drives are Green and only take up 2 Amps, i should be in business.

Link to comment

Personally, I would stick with one of the big names. Power supply is the last thing you want to bargain shop for. Corsair or Seasonic (who makes the Corsair PSUs I believe) would be my choice.

 

That said, there seems to be a fantastic deal on right now (Thanks for the link Raj!). You can get a 600w Corsair PS for $55 and and an additional $20 mail-in rebate!

 

http://www.newegg.com/Product/Product.aspx?Item=N82E16817139028

 

$35 for a 600w Corsair PSU?? Can't beat that!!!

Link to comment

It seems to be getting confusing with multi rail power supplies.

I think that is on purpose with many power supply manufacturers and their marketing and sales departments.

 

It is often very difficult to determine how the rails are wired.  Some manufacturers do not supply the information at all.

 

They want you to focus on the total wattage number, the bigger the better, even if not useful for your application.

Link to comment

It seems to be getting confusing with multi rail power supplies.

I think that is on purpose with many power supply manufacturers and their marketing and sales departments.

 

It is often very difficult to determine how the rails are wired.  Some manufacturers do not supply the information at all.

 

They want you to focus on the total wattage number, the bigger the better, even if not useful for your application.

 

But the manual that you linked previously for Enermax 82+ states it supports 11 hard drives for the 385W version and a quad core and a single video card (which the OP does not have) as he is limited to max 10 hard drives anyway with his current hardware (mini ITX MB with two onboard SATA ports and a PCI controller for 8 drives)

 

Link to comment

It seems to be getting confusing with multi rail power supplies.

I think that is on purpose with many power supply manufacturers and their marketing and sales departments.

 

It is often very difficult to determine how the rails are wired.  Some manufacturers do not supply the information at all.

 

They want you to focus on the total wattage number, the bigger the better, even if not useful for your application.

 

But the manual that you linked previously for Enermax 82+ states it supports 11 hard drives for the 385W version and a quad core and a single video card (which the OP does not have) as he is limited to max 10 hard drives anyway with his current hardware (mini ITX MB with two onboard SATA ports and a PCI controller for 8 drives)

 

And that same manual also says:

* Actual maximum support might vary by power consumption of connected components and is limited to DC output specifications.

Link to comment

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...