Anyone know what's causing this? it keeps popping up in my syslog.

[DevXen]

I woke up to 2 drives with read errors, one had 9, one had 32, this after having 2 drives with write errors a few days ago and replacing them. but scanning them in chkdsk for bad sectors in windows didn't find anything wrong with the previous 2 drives.

 

So i'm rebuilding parity on one of the drives with read errors., but this keeps pulling up, and the server seems to hang for a bit when it does. also the parity rebuild goes from 1day to fluxuates between 10-70 days) can only guess this is the issue...

 

Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,16,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,16,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,16,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,6,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,6,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,6,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,6,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,6,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,12,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,4,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,4,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,4,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,3,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,3,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,9,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,9,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,9,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,5,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,5,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,5,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,11,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,13,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,13,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,14,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,14,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,14,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,21,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,10,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,10,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,10,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,10,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,15,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,15,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,7,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,7,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host adapter abort request.
Dec  5 16:36:21 MediaXen kernel: aacraid: Outstanding commands on (4,1,7,0):
Dec  5 16:36:21 MediaXen kernel: aacraid: Host bus reset request. SCSI hang ?
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: outstanding cmd: midlevel-0
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: outstanding cmd: lowlevel-0
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: outstanding cmd: error handler-0
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: outstanding cmd: firmware-42
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: outstanding cmd: kernel-0
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: Controller reset type is 3
Dec  5 16:36:21 MediaXen kernel: aacraid 0000:82:00.0: Issuing IOP reset

 

[MAM59]

according to some internet sources (no personal experience with this) this is a timeout problem with your adaptec raid controller.

Google could be your friend too 🙂

I found https://www.thomas-krenn.com/de/wiki/Adaptec_Controller_Timeout_Fehler which describes excactly your problem.

 

Linux waits up to 30s for a command to complete, the controller waits up to 35.

So it happens that linux already cancels an ongoing job although the controller still would wait.

This can end up into an endless loop and finally lock up the computer.

 

The suggested "solution" is to "echo '45' > /sys/block/sda/device/timeout" for every attaced device (sda, sdb,.... you name it).

Also you should try to use a different slot, disable unneeded onboard devices and check for interrupt collisions (fix in bios).

There was also a special driver for this situation, but it seems to have been deleted for this outdated card.

 

see http://niyaas.blogspot.com/2009/01/aacraid-based-controllers-timing-out.html

 

[SpicySkidmark]

I am having the same issue. Have you figured out what your issue was? I have been running my asr-72405 for years with no problems, I attempted to upgrade the firmware to the latest I could find but it did not help. I found that it started when I upgraded my OS to 6.12.6 so I reverted to 6.12.4 and the problem went away. I couldn't find anything in the changelog that would explain this, but if you figure out the root cause please post.

[JorgeB]

There is a regression in the driver in the latest kernels affecting the Adaptec 7 series controllers that use the aacraid driver, e.g., asr-72405, 71605, 71685, possibly others, for now you should remain on v6.12.4, see below for more info:

 

https://bugzilla.kernel.org/show_bug.cgi?id=217599

[OngoingDetonator]

On 12/14/2023 at 7:40 PM, JorgeB said:

There is a regression in the driver in the latest kernels affecting the Adaptec 7 series controllers that use the aacraid driver, e.g., asr-72405, 71605, 71685, possibly others, for now you should remain on v6.12.4, see below for more info:

 

https://bugzilla.kernel.org/show_bug.cgi?id=217599

 

is there a guide somewhere to downgrade from 6.12.6?

Edited December 17, 2023 by sataris

[DevXen]

1 hour ago, sataris said:

 

is there a guide somewhere to downgrade from 6.12.6?

Yeah I need to downgrade too. I was on 6.11.5 and upgraded to the latest I think 6.12.6. so I can't revert to 6.12.4 not sure how I would go About that.

[DevXen]

1 hour ago, sataris said:

 

is there a guide somewhere to downgrade from 6.12.6?

Here I just found this....

 

https://docs.unraid.net/unraid-os/manual/troubleshooting/#manually-upgrading-or-downgrading-an-unraid-release

[DevXen]

On 12/14/2023 at 1:40 AM, JorgeB said:

There is a regression in the driver in the latest kernels affecting the Adaptec 7 series controllers that use the aacraid driver, e.g., asr-72405, 71605, 71685, possibly others, for now you should remain on v6.12.4, see below for more info:

 

https://bugzilla.kernel.org/show_bug.cgi?id=217599

 

This absolutely fixed my issue. was able to rebuild both drives that had been disabled. and all is good.

 

any idea on how i can follow that to know when the driver in the kernel will be updated to fix this? so i know when i can upgrade my unraid again?

[JorgeB]

You can keep an eye on that bug report, also keep an eye on the Unraid release notes, it should be mentioned there when it's fixed.

[OngoingDetonator]

@JorgeB I'm not sure if this is related, but I've also receiving "end kernel panic fatal exception in interrupt" and at that point the only solution is to reboot unraid.

 

Are these related in any way?

[JorgeB]

39 minutes ago, sataris said:

Are these related in any way?

Difficult to say with just that, enable the syslog server and post that after a crash.

 

[DoeBoye]

Just noticed the same errors in my log (And I'm running an Adaptec 7 series controller) and the same issue with random read errors. I will be downgrading to 6.12.4 asap!

 

Thanks!

Edited January 4 by DoeBoye

[SpicySkidmark]

Anyone know if this has been resolved in any newer versions yet?

[JorgeB]

12 hours ago, SpicySkidmark said:

Anyone know if this has been resolved in any newer versions yet?

Yes, since at least 6.12.8, possibly sooner.