no1warr1or

The first error to pop up is d3hot to d0 which is why I think/thought it was ASPM related. After that error pops up the card spits out the rest of those errors and more. I have IT firmware .12 that was released in the truenas forums that was supposed to help with the card going through resets. Which it did. But I still get these weird errors shortly after restarting the system. It can go many months without an error, but the minute I restart the systems it's almost a guarantee it'll pop up. Seems like these 3 series cards are filled with problems, I see a lot of posts related to them. Looking at system drivers there are already tweaks that unraid made to it to fix an issue with other 3 series cards. Ultimately I moved my array back to an old case and board with a 2 something series lsi sas card and rebuilt my array. Waiting for a unifi unas to come in along with a handful of 26TB drives to copy my data. Ill decide the fate of this server later.

75% into the parity rebuild and it crashed with the same error. I still cant believe the OS decided to disable 2 of my disks and theres no option to enable without rebuild. So here we go again starting with ANOTHER rebuild. I reseated the card again, disabled ALL cstates, hooked up aux power to the LSI card and now I wait to see if it can manage a rebuild before a crash or before unraid decides to disable another drive for no reason and I lose 60TB of data

Not yet, currently in the middle of parity sync to restore parity 1 and disk 1. Once that's completed im gonna dig further.

I've reseated the card a couple times over the last year or so with this issue. It has a 90mm noctua fan on top of the heatsink on full speed. The card can get hit hard transfer speed wise when doing rebuilds without issues and stay running for months is what gets me, but as soon as I do an update/reboot its a gamble if this pops back up.. I've considered maybe the aux 6pin power might need to be hooked up but I dont have a fully populated card ( only 3 sas connectors in use ). Ive also considered manual link speed for PCIe, but I hadnt thought of changing slots. Right now I'm worried about changing anything, With the OS deciding to disable Parity 1 and Disk 1 I need to get the array back in order. Currently running Extended SMART tests to be safe per the guide for restoring disabled drives.. But I know its just because of this issue and I honestly cant believe I have to rebuild the drives to re-enable them.

Ive posted a couple times related to issues with my LSI card entering a low power state and not coming back (d3hot to cold or something along those lines, once i get back to my laptop ill pull the logs) But its gotten to a point where I need to spend the time to ensure it gets solved, because its plaguing my main storage server. The issue mainly seems to pop up after updating unraid (version doesnt seem to matter), after an update it can pop up after a few minutes to a day later, its random, and after so many times in a row doing it eventually it just doesnt do it anymore and stays on. This time after updating from rc2 to release it had the same behavior but this time there were so many array errors it disabled 2 of my disks. I have disabled all PCIe power management in the bios, disabled everything power management except for basic c states even disabling c6 due to reports of errors. Updated the bios, updated to the latest IT firmware on the LSI card they dropped in the TrueNAS forums. I have added in comments to boot "pci=noaer pcie_aspm=off" I dont understand why its still dropping into a low power state. System Specs: asrock Z690 Pro RS w/ Intel i5-12400 LSI 9300-16i The first couple errors before the system starts spitting out disk errors: Bottom to Top - Blockbuster kern kernel mpt3sas_cm1: basefault_reset_work: Running mpt3sas_dead_ioc thread success !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm0: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm0: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm0: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm0: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm0: SAS host is non-operational !!!! Blockbuster kern kernel mpt3sas_cm1: SAS host is non-operational !!!! Blockbuster kern kernel pcieport 0000:02:08.0: Unable to change power state from D3hot to D0, device inaccessible

Same issue here...

And it just locked up again.. sigh

I think this may be the issue im having as well with both an integrated NIC and a PCIe NIC. Both went offline and stopped showing anything 2 days ago in unifi until I hard rebooted the system tonight. Before this I was having issues with the PCIe switch in the mobo going to sleep and not waking up breaking the PCIe link to my LSI SAS card. Aspm and all that is disabled in the bios. Unfortunately I have no syslogs from the previous boot.

For some reason 2 days ago the server went completely offline and I just noticed today.. unfortunately im not able to access the last log file as it seems the stable doesnt include that functionality and only provides the log file of the current boot. I got no notifications via discord which I have setup so not a clue what happened. Machine was still physically on so I had to hold the power button to shut it down...

Update, so far it's been stable since I updated the bios and changed those settings. For anyone looking this is an asrock z690 Pro RS board, was on 18.00 on 20.01 now. Then the above mentioned bios changes.

Thanks. Interestingly ASPM shows disabled when I run the LSPCI -vv command. But power management shows enabled with all the different D states

Update- I updated the bios. All the settings I mentioned were disabled already, I enabled pcie native control. I also disabled above 4g decoding and C.A.M which is asrocks version of resizable bar. I also switched the PCIe link speed from auto to gen3 (it's a Gen 5 slot) not sure if any of this matters but will monitor.

I run unraid 7 currently. During 7.0.0 RC2 I received notifications regarding array errors. Checking the logs before these errors I saw "Unable to change power state from D3cold to D0" and similar with D3hot. The device this error referred to is the PCIe switch itself on the mobo (PEX 8724) that my LSI card is plugged into. After it happened on RC2 I rebooted and it never popped back up. Now that I'm on 7 release it keeps occurring, to the point where my drives aren't able to unmount when restarting. Anyways the plan is to update my bios, and then disable the following in the bios. -PCIe native control -PCIe aspm support -PCH PCIe aspm support -DMI aspm support -PCH DMI aspm support I'm curious if there's a way inside unraid to prevent this from happening before I'm able to sit with the machine. Also any other advice would be appreciated.

Wanted to update everyone.. I believe the issue is resolved. Changes since my last post.. Updated to 6.12.3, set my IP as static in the network settings and manually set my DNS to cloudflare.

Any updates on this? I posted in another thread (community apps) about this, but ive been having these issues for a bit now. It works for a few days then poof doesnt want to ping anything. dockers and VMs still work fine. running 6.12.2, but saw this on 6.12.1 and 6.11.5

Just weird to me that it only happens when it sits running for a week or so, fresh reboot is fine. I would assume if it was being blocked it would be blocked all the time. I initially thought that it had something to do with an improper config with the network interfaces being setup for a failover so I switched it to just eth0 since that was the only active interface. I guess I will have to turn off adblocking all together and see what happens. The packetloss is on the WAN side, My provider just upgraded to highsplit service and theyre battling crazy interference right now.

ive been having the issue recently with the "appfeed failed" as well. It works perfectly for a few days after a fresh restart or if i refresh the network settings, it will pull updates and I can browse the app store but if it sits for to long it gives me this error. I also run into an issue where I cant check for unraid updates as well when the appstore stops working. It seems to me like anytime theres any kind of packet loss or down time on the wan is when I see this. I cant 100% confirm this is what causes it. I am using the built in adblocker in unifi, but if it was outright blocking the connection i shouldnt be able to connect at all to the app store/do updates/pull new containers correct?

I want to clarify that they did not disappear but that the tab takes some time to load. Click on the docker or vm tab and let it sit for a minute and see if they show up

I got my home assistant VM back running. had to fix a couple system files no big deal. I did notice that the CPU dropped back to normal range. Im suspecting Deluge-VPN is the culprit for that issue as it was having these issues around the time downloads and moves were happening. Odd though considering the CPU only showed 7% and ram was only a couple GB. Anyways im going to continue with a large SMB transfer and see what happens.

The last couple days i noticed some performance issues with SMB on windows 11. I never looked into it.. Well today (starting on 6.12.1) i went to move some large media in the server and noticed it was also dragging. So i popped up the WebUI.. for starters docker and VM would not load, everything was still functional but wasnt loading on the webui. No problem I figured a simple restart will take care of it. When restarting i noticed on the console output it couldnt shut down gracefully so it had to force shutdown. Everything came back no issues. EXCEPT my VM for home assistant is corrupt.. i will focus on this later. My current situation is this. Updated to 6.12.2 came back online. my CPU across most of my 12/24 cores is pegged at 100%. Docker/VM tab is intermittent. but it shows only about 10-15% CPU usage on docker and nothing CPU intensive is running on any VMs and cores not assigned to VMs are pegged at 100% as well. So im certain thats not it. I have a dual xeon x5675 with 96GiB ram so its not apart of that intel issue (that im aware of). Any help would be appreciated. This issue is crippling my server. And im afraid to do anything with over 50TB of data here.

Wanted to throw in that the plugin would not stay signed in after it updated and when I went to the plugin config the page kept refreshing when trying to pull the flash backup status. I used the above mentioned command unraid-api restart and it fixed the issue.

I would just like to note that your screenshot shows that it is attempting direct play on the iPhone.. as such no transcoding would happen. The audio stream to my knowledge is only transcoded on the CPU so you should never see that HW transcode..