November 9, 20241 yr Thanks for the suggestion! I came across the "7 watts idle" article on Matt Gadient's blog (mattgadient.com) and took some of the advice. I ended up removing both NVMe drives—one connected to the CPU and the other to the chipset. I also disconnected the monitor and closed the GUI, then waited for about 5 minutes. No change, still C8. SATA drives were still connected. It's actually a good sign 🤪, as this means I don't need to replace the motherboard, which is a relief. The motherboard only has one x16 (CPU) and two x1 (chipset) slots. I'm planning to pass through an ASM1166 port expander to TrueNAS, as it's quite handy when the VM shuts down, the hard drives enter spindown mode. The only downside is that the ASM card is x4 and now occupies the x16 slot, causing it to go into C2/C3 state. Looks like I'll need to pick up a new x1 card to resolve this.
October 30, 2025Oct 30 Resurrecting this topic in case someone can help. I have a lot of PCIE devices with disabled ASPM despite existing capability. ASPM is on in BIOS and forced on boot:root@Tower:~# dmesg | grep -i aspm [ 0.000000] Command line: BOOT_IMAGE=/bzimage initrd=/bzroot pcie_aspm=force [ 0.041209] Kernel command line: BOOT_IMAGE=/bzimage initrd=/bzroot pcie_aspm=force [ 0.041237] PCIe ASPM is forcibly enabled [ 0.404889] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]But despite all that Unraid is not enabling ASPM on capable devices:root@Tower:~# lspci -vv | awk '/ASPM/{print $0}' RS= | grep --color -P '(^[a-z0-9:.]+|ASPM )' 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge GPP Bridge (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 32GT/s, Width x16, ASPM L1, Exit Latency L1 <64us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+ 00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge GPP Bridge (prog-if 00 [Normal decode]) LnkCap: Port #1, Speed 32GT/s, Width x4, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+ 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Internal GPP Bridge to Bus [C:A] (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Internal GPP Bridge to Bus [C:A] (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 01:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3416 Fusion-MPT Tri-Mode I/O Controller Chip (IOC) (rev 01) LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L0s L1, Exit Latency L0s unlimited, L1 <64us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+ 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Upstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 16GT/s, Width x4, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; LnkDisable- CommClk+ 03:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 16GT/s, Width x4, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; LnkDisable- CommClk- 03:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #0, Speed 16GT/s, Width x1, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; LnkDisable- CommClk- 03:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #1, Speed 16GT/s, Width x1, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; LnkDisable- CommClk- 03:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #2, Speed 16GT/s, Width x1, ASPM L1, Exit Latency L1 <32us LnkCtl: ASPM Disabled; LnkDisable- CommClk+ 03:0c.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) pcilib: LnkCap: Port #12, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us sysfs_read_vpd: read failed: No such device LnkCtl: ASPM L0s L1 Enabled; LnkDisable- CommClk+ 03:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01) (prog-if 00 [Normal decode]) LnkCap: Port #13, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM Disabled; LnkDisable- CommClk+ 07:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 0c) LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s unlimited, L1 <64us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+ 08:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset USB 3.2 Controller (rev 01) (prog-if 30 [XHCI]) LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 09:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset SATA Controller (rev 01) (prog-if 01 [AHCI 1.0]) LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us LnkCtl: ASPM L0s Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0a:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raphael (rev cb) (prog-if 00 [VGA controller]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0a:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Radeon High Definition Audio Controller [Rembrandt/Strix] LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0a:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge USB 3.1 xHCI (prog-if 30 [XHCI]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0a:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge USB 3.1 xHCI (prog-if 30 [XHCI]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 0b:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge USB 2.0 xHCI (prog-if 30 [XHCI]) LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+For example my HBA controller supports L0s and L1 but nothing gets enabled:01:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3416 Fusion-MPT Tri-Mode I/O Controller Chip (IOC) (rev 01) LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L0s L1, Exit Latency L0s unlimited, L1 <64us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+Of course I ran "powertop --auto-tune" and it shows everything is good, yet my power consumption is around 80W. Spinning down 5 HDDs reduces it a little but not much. I have "power efficient" policy in Unraid settings. I ran "echo -n powersave > /sys/module/pcie_aspm/parameters/policy" to no effect.
March 19Mar 19 @extesy I am having similar issues since I installed a new mainboard. It's that one but I am having the new Version 1.3. My syslog is full of these messages:Mar 17 15:53:20 Tower kernel: igc 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control Mar 17 15:53:20 Tower kernel: igc 0000:05:00.0: can't disable ASPM; OS doesn't have ASPM controlI followed this guide:ASPM is on in BIOSpowertop --auto-tune is executed at every startup of array (via User Scripts)CPU govenor is power save (Tips & Tweaks plugin)dmesg | grep -i aspm [ 0.103679] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.291036] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 0.291274] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 36.450882] igc 0000:04:00.0: can't disable ASPM; OS doesn't have ASPM controllspci -vv | awk '/ASPM/{print $0}' RS= | grep --color -P '(^[a-z0-9:.]+|ASPM )' 00:01.0 PCI bridge: Intel Corporation 6th-10th Gen Core Processor PCIe Controller (x16) (rev 07) (prog-if 00 [Normal decode]) LnkCap: Port #2, Speed 8GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <1us, L1 <8us LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk- 00:1b.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #21 (rev f0) (prog-if 00 [Normal decode]) LnkCap: Port #21, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <1us, L1 <16us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 00:1c.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #1 (rev f0) (prog-if 00 [Normal decode]) LnkCap: Port #1, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <1us, L1 <16us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #10 (rev f0) (prog-if 00 [Normal decode]) LnkCap: Port #10, Speed 8GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <16us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 00:1d.4 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #13 (rev f0) (prog-if 00 [Normal decode]) LnkCap: Port #13, Speed 8GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <16us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 00:1d.5 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port #14 (rev f0) (prog-if 00 [Normal decode]) LnkCap: Port #14, Speed 8GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <16us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 02:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller S4LV008[Pascal] (prog-if 02 [NVM Express]) LnkCap: Port #0, Speed 16GT/s, Width x4, ASPM L1, Exit Latency L1 <64us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 03:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller S4LV008[Pascal] (prog-if 02 [NVM Express]) LnkCap: Port #0, Speed 16GT/s, Width x4, ASPM L1, Exit Latency L1 <64us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 04:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04) LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L1, Exit Latency L1 <4us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 05:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04) LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L1, Exit Latency L1 <4us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+ 06:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04) LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L1, Exit Latency L1 <4us LnkCtl: ASPM L1 Enabled; RCB 64 bytes, LnkDisable- CommClk+Have you found a solution? Thanks a lot.
March 19Mar 19 4 hours ago, EdgarWallace said:Have you found a solution? Thanks a lot.Unfortunately no solution. I think it's Unraid bug, perhaps something about Linux kernel that they are using or its configuration.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.