Reduce power consumption with powertop


Recommended Posts

6 hours ago, dopeytree said:

Broadcom state support of ASPM L1 here: https://docs.broadcom.com/doc/12353246

This is for an older chip so newer is almost guaranteed to support it...

 

1811917425_Screenshot2023-10-15at19_16_32.thumb.png.b0074fd8aad89079a48bb6d58f215f27.png

Yeah, I've seen that in the docs but there is a huge difference between a nominal support claim and real world implementation and interaction with countless hardware configurations.

 

Any tests reports would be welcome.

Link to comment
8 hours ago, mgutt said:

I would try it with Ubuntu. Maybe unRAID is shipped with an older driver.

I've found this informative post on ASPM, in the contest of Debian.

And particularly this quote:

 

"Its normally not a thing an OS plays with but should be handled by BIOS.

The problem is that motherboard vendors mostly only design for windows.

So in case that your motherboard does not have any options, you can at least have linux kernel overpower the BIOS.

A warning though, only do this if you are absolutely sure that your device does support ASPM."

 

https://www.reddit.com/r/debian/comments/8c6ytj/active_state_power_management_aspm/

Link to comment
On 10/15/2023 at 2:45 PM, Lolight said:

Apparently there isn't one.

But there are reports of at least some SATA expansion cards playing nice with C-states.

To bad  i can't use sata my case have hot swap disque with direct sff port...

I will follow this thread in hoping someone will come up with a solution 

  • Like 1
Link to comment

Hi! So i'm using AsRock Z390m-itx/ac.
For last 2 hours i was trying to reach higher than C3 state, but with no luck.
Every C-State enabled.

Every ASPM enabled (first L1 then L0sL1, no difference)
Audio disabled.

No pci-e devices. Only ASM1166 on M.2 slot.

Other parts:
MOBO: AsRock Z390m-itx/ac
CPU: i5-9400
PSU: Corsair RM550x (2018)
RAM: 2x Corsair Vengeance LPX, DDR4, 8 GB, 3000MHz, CL16

I was testing with stopped array.
My go file:

# -------------------------------------------------
# Set power-efficient CPU governor
# -------------------------------------------------
#/etc/rc.d/rc.cpufreq powersave

# -------------------------------------------------
# Disable CPU Turbo
# -------------------------------------------------
#[[ -f /sys/devices/system/cpu/intel_pstate/no_turbo ]] && echo "1" > /sys/devices/system/cpu/intel_pstate/no_turbo
#[[ -f /sys/devices/system/cpu/cpufreq/boost ]] && echo "0" > /sys/devices/system/cpu/cpufreq/boost

# -------------------------------------------------
# Enable power-efficient ethernet
# -------------------------------------------------

# enable IEEE 802.3az (Energy Efficient Ethernet): Could be incompatible to LACP bonds!
for i in /sys/class/net/eth?; do dev=$(basename $i); [[ $(echo $(ethtool --show-eee $dev 2> /dev/null) | grep -c "Supported EEE link modes: 1") -eq 1 ]] && ethtool --set-eee $dev eee on; done

# Disable wake on lan
for i in /sys/class/net/eth?; do ethtool -s  $(basename $i) wol d; done

# -------------------------------------------------
# powertop tweaks
# -------------------------------------------------

# Enable SATA link power management
echo med_power_with_dipm | tee /sys/class/scsi_host/host*/link_power_management_policy

# Runtime PM for I2C Adapter (i915 gmbus dpb)
echo auto | tee /sys/bus/i2c/devices/i2c-*/device/power/control

# Autosuspend for USB device
echo auto | tee /sys/bus/usb/devices/*/power/control

# Runtime PM for disk
echo auto | tee /sys/block/sd*/device/power/control

# Runtime PM for PCI devices
echo auto | tee /sys/bus/pci/devices/????:??:??.?/power/control

# Runtime PM for ATA devices
echo auto | tee /sys/bus/pci/devices/????:??:??.?/ata*/power/control

# VM writeback timeout
for i in /proc/sys/vm/dirty_writeback_centisecs; do
    echo '1500' > $i
done

echo powersupersave > /sys/module/pcie_aspm/parameters/policy


image.thumb.png.c01e9ff9fc654302fca116595315c9c4.pngimage.thumb.png.a952ed5502ff2fd9de2a52d048435aac.png

 

EDIT: After reboot with array started i get 0% everywhere.
image.thumb.png.4d01c0c7f372954dd13b965f8f09972b.png

Edited by Vrozaksen
Link to comment

lspci -vvvnnPPDq | grep -B 30 ':[[:space:]]ASPM'

 

0000:00:01.0/02:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 [1000:0087] (rev 05)
        Subsystem: Broadcom / LSI 9207-8i SAS2.1 HBA [1000:3020]
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 16
        IOMMU group: 15
        Region 0: I/O ports at 3000 [disabled] [size=256]
        Region 1: Memory at 80b40000 (64-bit, non-prefetchable) [size=64K]
        Region 3: Memory at 80b00000 (64-bit, non-prefetchable) [size=256K]
        Expansion ROM at 80a00000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [68] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0W
                DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
                        MaxPayload 256 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L0s, Exit Latency L0s <64ns
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
--
                HeaderLog: 04000001 00000003 02080000 6ee9d365
        Capabilities: [1e0 v1] Secondary PCI Express
                LnkCtl3: LnkEquIntrruptEn- PerformEqu-
                LaneErrStat: 0
        Capabilities: [1c0 v1] Power Budgeting <?>
        Capabilities: [190 v1] Dynamic Power Allocation <?>
        Capabilities: [148 v1] Alternative Routing-ID Interpretation (ARI)
                ARICap: MFVC- ACS-, Next Function: 0
                ARICtl: MFVC- ACS-, Function Group: 0
        Kernel driver in use: mpt3sas
        Kernel modules: mpt3sas

 

From this I would presume my LSI card doesn't support ASPM L1 but will support L0s so I should go back to bios and change it so will be enabled on next boot. 

 

What does your LSI card report?

Link to comment
On 10/17/2023 at 8:56 PM, Vrozaksen said:

Hi! So i'm using AsRock Z390m-itx/ac.
For last 2 hours i was trying to reach higher than C3 state, but with no luck.

 

Hi,

I have the same MB, same generation CPU, no PCI but an an nvme SSD (Samsung) and didn't succeed either. (see my post p20)

Tries to boot with unbuntu with the same results.

Might be an issue with the BIOS or the nvme ssd prevent for going lower than c3.

Tell me if you try without it.

Thank you,

 

Link to comment

Hi, 

Today I've installed in my server an Intel X710DA2 10Gb network card.

I haven't plug any cable into the card yet but I see that the power raysed by 5-6W

There's a way to reduce the power from that board? Or this is the best I can have.

Thank you!

 

P.S. running Powertop now I see that my system only goes into C3, before it goes to C6/C7...

 

Edited by Simone Valmacco
Link to comment

Hi all, I'm starting my power saving journey and feel very in over my head.

 

Motherboard: Asus Prime B660M-A AC D4 (with updated bios)

CPU: 12th Gen Intel® Core™ i3-12100

Memory: Silicon Power 16GB (2 x 8GB) 288-Pin PC RAM DDR4 3200

PSU: EVGA SuperNOVA 650 GT, 80 Plus Gold 650W

Hard Drives: 3x HDD, 1x SSD, all SATA

 

According to my Kill-A-Watt, I'm idling at 20-28w, depending on if the drives are spun down or not.

 

I'd *love* to lower that by 5 or 10.

 

After running powertop, I've managed to reach C3, but no lower. Anyone have any ideas? Happy to provide whatever other info!

 

PXL_20231026_192517153.jpg

PXL_20231026_192616796.jpg

PXL_20231026_192632404.jpg

PXL_20231026_192307696.jpg

PXL_20231026_192333010.jpg

2023-10-26 15_39_57-root@Unraid_ ~ _ bash --login (Unraid) — Mozilla Firefox.png

2023-10-26 15_40_13-root@Unraid_ ~ _ bash --login (Unraid) — Mozilla Firefox.png

Link to comment
19 hours ago, mgutt said:

The ASM1061 is probably the problem. 

 

And this isn't efficient in low power scenarios.

 

Is ASM1061 on every SATA port on this board? If so, I guess i'd be looking at an add-on card at some point.

 

Also, I believe you on the power supply, but I'm curious how you know that. Is it missing some sort of feature i should have been looking for?

Link to comment
6 minutes ago, theothermatt_b said:

but I'm curious how you know that.

That's because only a tiny amount of recent power supplies are very efficient in low power scenarios. They are mentioned in the first post. 

 

7 minutes ago, theothermatt_b said:

Is ASM1061 on every SATA port on this board? If so, I guess i'd be looking at an add-on card at some point.

Does not help I think as the problem is not the usage of the controller. It kills your C-States because of its pure existence 🤪

 

 

 

 

Link to comment

So this looks like it was moved to Nerdtools, yeah? That's how I installed it and I'm not 100% sure if that applies in this thread. If it doesn't could someone point me to the correct thread?

 

However, assuming I'm in the right place, this is what I see. I have a Xeon E5-2630L v4 running in a Supermicro X10SRL-F w/64GB of ECC RAM.

 

When I go to the Tunables tab, this is what I see:

PowerTOP 2.15     Overview   Idle stats   Frequency stats   Device stats   Tunables   WakeUp                            


>> Bad           Enable SATA link power management for host4                                                            
   Bad           Enable SATA link power management for host5
   Bad           Enable SATA link power management for host6
   Bad           Enable SATA link power management for host7
   Bad           Enable SATA link power management for host3
   Bad           Enable SATA link power management for host1
   Bad           Enable SATA link power management for host8
   Bad           Enable SATA link power management for host9
   Bad           Enable SATA link power management for host2
   Bad           VM writeback timeout
   Bad           Enable SATA link power management for host10
   Bad           Runtime PM for I2C Adapter i2c-1 (AST i2c bit bus)
   Bad           Autosuspend for USB device Cruzer [SanDisk]
   Bad           Runtime PM for I2C Adapter i2c-4 (NVIDIA i2c adapter 7 at 3:00.0)
   Bad           Autosuspend for USB device CP1500PFCLCD [CPS]
   Bad           Runtime PM for I2C Adapter i2c-2 (NVIDIA i2c adapter 4 at 3:00.0)
   Bad           Autosuspend for unknown USB device 3-12.1 (0557:2419)
   Bad           Runtime PM for I2C Adapter i2c-3 (NVIDIA i2c adapter 5 at 3:00.0)
   Bad           Runtime PM for disk sde
   Bad           Runtime PM for port ata2 of PCI device: Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 6
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset MEI Controller #2
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #2
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode]
   Bad           Runtime PM for port ata1 of PCI device: Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode]
   Bad           Runtime PM for disk sdb
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset PCI Express Root Port #1
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 7
   Bad           Runtime PM for port ata4 of PCI device: Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 2
   Bad           Runtime PM for port ata3 of PCI device: Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 5
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
   Bad           Runtime PM for port ata9 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 3
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Thermal Control
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO Hot Plug
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Error
   Bad           Runtime PM for PCI Device Intel Corporation I210 Gigabit Network Connection
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
   Bad           Runtime PM for disk sdc
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset USB xHCI Host Controller
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link Debug
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO RAS/Control Status/Global Errors
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Thermal Control
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Map/VTd_Misc/System Management
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Error
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset SPSR
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Thermal Control
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Error
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 1
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Thermal Control
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 1 - Channel 0 Thermal Control
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
   Bad           Runtime PM for port ata7 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset LPC Controller
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for port ata10 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for disk sdg
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 4
   Bad           Runtime PM for port ata6 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device ASPEED Technology, Inc. ASPEED Graphics Family
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
   Bad           Runtime PM for disk sdd
   Bad           Runtime PM for disk sdf
   Bad           Runtime PM for port ata8 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device NVIDIA Corporation GP107GL [Quadro P400]
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #1
   Bad           Runtime PM for disk sda
   Bad           Runtime PM for port ata5 of PCI device: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode]
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 2/3 Interface
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Broadcast
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 2/3 Broadcast
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DMI2
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Crystal Beach DMA Channel 0
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 2/3 Interface
   Bad           Runtime PM for PCI Device Intel Corporation I210 Gigabit Network Connection
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 2/3 Interface
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
   Bad           Runtime PM for PCI Device Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 2/3 Interface
   Bad           Runtime PM for PCI Device ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
   Bad           Runtime PM for PCI Device Intel Corporation C610/X99 series chipset MEI Controller #1
   Bad           Runtime PM for PCI Device Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Target Address/Thermal/RAS
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Error
   Bad           Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
   Good          Autosuspend for USB device xHCI Host Controller [usb3]
   Good          Autosuspend for unknown USB device 1-1 (8087:800a)
   Good          Autosuspend for USB device EHCI Host Controller [usb1]
   Good          Autosuspend for unknown USB device 3-12 (0557:7000)
   Good          Autosuspend for USB device xHCI Host Controller [usb4]
   Good          Autosuspend for USB device EHCI Host Controller [usb2]
   Good          Autosuspend for unknown USB device 2-1 (8087:8002)
   Good          Runtime PM for I2C Adapter i2c-0 (SMBus I801 adapter at 0580)
   Good          Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 1
   Good          Runtime PM for PCI Device Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 1

 <ESC> Exit | <Enter> Toggle tunable | <r> Window refresh                                                               

 

Can I just toggle these from "bad" to "good?"

 

It looks like my system spends much of it's time in C6 (I only see C3 and C6):

C3 (pc3)    0.0%
C6 (pc6)   25.9%

 

Link to comment
18 hours ago, mgutt said:

Does not help I think as the problem is not the usage of the controller. It kills your C-States because of its pure existence 🤪

Yeah, but his board's manual doesn't mention anything about its existence.

According to the manual all SATA ports are connected to the chipset.

Link to comment
18 hours ago, theothermatt_b said:

 

Is ASM1061 on every SATA port on this board? If so, I guess i'd be looking at an add-on card at some point.

According to the manual, all your SATA ports are connected to the chipset.

I'd recommend downloading the board's BIOS manual and studying all power related settings.

Link to comment
10 hours ago, mgutt said:

Reading the first post is essential.

Your post says to use an autotune command. I asked if you could toggle them, a different question that is not answered in the first post.

 

In addition, your warning about SATA controllers... the link doesn't go anywhere except to the top of the first post which does not explain anything about SATA controllers.

 

I'd not have asked these questions otherwise.

Link to comment
2 minutes ago, aidenpryde said:

the link doesn't go anywhere except to the top of the first post

Scroll down to "Sata Controller". The link should work except with Firefox.

 

7 minutes ago, aidenpryde said:

I asked if you could toggle them

No as long you don't build your own list of commands (some examples in the first post, but those influence usually all devices of a specific type like "enable standby for all sata ports").

Link to comment

Before:


So i managed to get this:
obraz.thumb.png.cb7f532f0a073f1640c02b597433eece.png

 

00:01.0 now have ASPM Enabled using https://gist.github.com/baybal/b499fc5811a7073df0c03ab8da4be904 

Still getting only to C3...
In this post https://libreddit.proxy.vrozaksen.eu/r/homelab/comments/130ly7h/cant_achieve_lower_cstates_stuck_at_c3_despite/

OP says his issue was on-board network card and AsRock Z390m-itx/ac uses 2 different on-board LAN cards. I211 and I219.
Maybe one of those cards generates this issue? I can't test that right now, but maybe u got any information about those cards.

  • Like 1
Link to comment
5 hours ago, mgutt said:

Scroll down to "Sata Controller". The link should work except with Firefox.

 

No as long you don't build your own list of commands (some examples in the first post, but those influence usually all devices of a specific type like "enable standby for all sata ports").

So, I did the autotune command and everything shows as "good" in powertop>tunables, unless I restart the server. I assume I have to edit the go file it to apply after a restart?

 

I get some messages in Terminal about not being able to load files from Cannot load from file /var/cache/powertop/saved_results.powertop
Cannot load from file /var/cache/powertop/saved_parameters.powertop

 

Not sure if that's relevant or not.

Edited by aidenpryde
Link to comment

Hi,

I don't have the exact same motherboard, mine is the Z390 phantom gaming ITC/ac https://pg.asrock.com/mb/Intel/Z390 Phantom Gaming-ITXac/index.asp#Specification

 

Bios Version is 4.40 (no beta)

Only have one Intel LAN I219.

 

 

 

I have one question regarding your last post : 

On 10/28/2023 at 7:48 PM, Vrozaksen said:


What parameters did you use for the script for Endpoint and Root_Complex to have ASPM enabled on 00:01.0 ?
 

ENDPOINT="00:1c.5"
ROOT_COMPLEX="00:1c.4"



Thanks,

Louis.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.