Reduce power consumption with powertop

[frodr]

10 minutes ago, mgutt said:

 

Yes. The version you have installed seems to detect the package c-states but has problem with the cpu c-states:

 

 

Is this a problem? No. Powertop is only a monitoring tool or sets some power state functions of the hardware. So if it displays "C3_ACPI" it means something between C3 and C10, but they still work.

Thanks. OK.

10 minutes ago, mgutt said:

 

Did you install the Intel GPU top plugin to install the Intel iGPU drivers? Package C-States won't work on some hardware as long the iGPU driver is not installed and the iGPU is not in RC6 state. Scroll down the "Idle stats" page. At the bottom you find the iGPU status.

Yes Intel GPU Top plugin installed. I can not see any reference to iGPU stat at the bottom, see picture.

 

 

 

 

10 minutes ago, mgutt said:

 

I'd say the BIOS settings look good. I think the problem is the board itself. I suggest:

- remove all disks

- boot Ubuntu through USB flash drive

- execute powertop --auto-tune

- execute powertop

- confront Asus with the results

 

 

I see. I will test that one day. After I get this mobo working correctly. It has a lot of issues, boot stops at F6, AO, looses IPMI card physical connection (often needs to remove the card, start mobo, stop mobo, insert IPMI to get it ip again). So I'm wrestling Asus support already.  

 

 

[mgutt]

3 minutes ago, frodr said:

I can not see any reference to iGPU stat at the bottom, see picture.

Ah yes. I think the most recent iGPUs aren't recognized by powertop, too ^^

But if you have installed the driver, it should sleep as long no monitor is connected / active.

 

4 minutes ago, frodr said:

looses IPMI card physical connection

I think I read 2 or 3 times in the past from people complaining about ASUS' IPMI solution. It seems its crap. But ASUS isn't alone:

https://geizhals.de/?sr=2829037,-1

 

I would go with Supermicro.

 

 

[dopeytree]

Anyone else get kworker at 100% cpu? 

 

 

Now fixed and am noticing reaching C7.

 

To find the culprit then..

grep . -r /sys/firmware/acpi/interrupts/

 

Quote

Instead I think this CPU usage is not normal and is related to the well-known kworker bug:https://bugs.launchpad.net/ubuntu/+source/linux/+bug/887793

 

The solution for me and for many others was, first of all, find out the "gpe" that is causing the bad stuff with something like:

grep . -r /sys/firmware/acpi/interrupts/

 

and check for an high value (mine was gpe13 - with a value like 200K - so, you have to change it accordingly, if differs). After that:

 

Fixed with the following inserted into config go file

 

# ------------------------------------------------- 
# CPU bug fix 
# ------------------------------------------------- 

echo disable > /sys/firmware/acpi/interrupts/gpe69 2>/dev/null

 

[frodr]

I think I saw a recommondation on a 10 port Sata pcie card in the tread. But now I can´t find it. Anyone?

[mathiasdoe]

Hey, setting the CPU Scaling Governor to Power Save seems to lock it at 799 ghz and on demand locks it at 2. Only conservative seems to work somewhat well. Any clue why that might be? My CPU is an intel j4125.

[dopeytree]

Should power management report be blank?

 

Quote

cat /proc/cpuinfo

 

cat /proc/cpuinforoot@Moulin-rouge:~# cat /proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 0
cpu cores       : 8
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 1
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1099.984
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 1
cpu cores       : 8
apicid          : 2
initial apicid  : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 2
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 2
cpu cores       : 8
apicid          : 4
initial apicid  : 4
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 3
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 3
cpu cores       : 8
apicid          : 6
initial apicid  : 6
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 4
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.013
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 4
cpu cores       : 8
apicid          : 8
initial apicid  : 8
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 5
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1099.965
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 5
cpu cores       : 8
apicid          : 10
initial apicid  : 10
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 6
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1099.961
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 6
cpu cores       : 8
apicid          : 12
initial apicid  : 12
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 7
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 7
cpu cores       : 8
apicid          : 14
initial apicid  : 14
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 8
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 0
cpu cores       : 8
apicid          : 1
initial apicid  : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 9
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.067
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 1
cpu cores       : 8
apicid          : 3
initial apicid  : 3
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 10
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1099.981
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 2
cpu cores       : 8
apicid          : 5
initial apicid  : 5
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 11
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 3
cpu cores       : 8
apicid          : 7
initial apicid  : 7
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 12
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 4
cpu cores       : 8
apicid          : 9
initial apicid  : 9
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 13
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.067
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 5
cpu cores       : 8
apicid          : 11
initial apicid  : 11
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 14
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.065
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 6
cpu cores       : 8
apicid          : 13
initial apicid  : 13
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor       : 15
vendor_id       : GenuineIntel
cpu family      : 6
model           : 167
model name      : Genuine Intel(R) 0000 @ 1.10GHz
stepping        : 0
microcode       : 0x2c
cpu MHz         : 1100.000
cache size      : 16384 KB
physical id     : 0
siblings        : 16
core id         : 7
cpu cores       : 8
apicid          : 15
initial apicid  : 15
fpu             : yes
fpu_exception   : yes
cpuid level     : 27
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap avx512ifma clflushopt intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm md_clear flush_l1d arch_capabilities
vmx flags       : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml tsc_scaling
bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs mmio_stale_data retbleed eibrs_pbrsb gds
bogomips        : 2208.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

 

[dopeytree]

Quote

cat /sys/devices/system/cpu/intel_pstate/turbo_pct

 

90%

 

Quote

cat /sys/devices/system/cpu/intel_pstate/max_perf_pct

 

100%

 

Quote

cat /sys/devices/system/cpu/intel_pstate/min_perf_pct

 

18%

 

Quote

cat /sys/devices/system/cpu/intel_pstate/num_pstates

 

37

[ishbuggy]

I am having trouble getting below C2 on my server. My system hardware is: 

Motherboard: MSI MPG B760I EDGE WIFI DDR4 Mini ITX

CPU: i5-13500

RAM: Corsair Vengeance LPX 64 GB (2 x 32 GB) DDR4-3200 CL16 Memory

NVME: 2x Samsung 970 EVO 1 TB

SATA SSD: 2x Samsung 870 EVO 2 TB (connected to MB SATA5, SATA6)

PCIe HBA: Broadcom 9500-8i (SAS3808)

HDDs (connected to HBA)

2x Seagate Exos X20 20 TB

2x Seagate Exos X16 16 TB

1x Western Digital Red 8 TB

PSU: Corsair RM750x (2021) (Not the 550x, but so far seems only slightly worse)

 

I have configured everything I know how to in the BIOS and run all the powertune commands in this post to try to allow all the devices to get to a higher C-State. I previously had a LSI-9207-8i that I sold before rebuilding this with the 9500-8i. The 9207-8i definitely did not support L0 or L1 states, and I narrowed down to be the cause of my system never going higher than C2. The command mgutt gave to list which devices supported L1/L0 link states reported that the 9207-8i did not have any support, as expected as it is an old device. 

 

I expected the 9500-8i would be better. It does have much lower power consumption itself, but it seems to be still the cause of my system not getting any better than C2. When I remove it, I can reach C6, but with it installed it can reach only C2. The link state support listed (and in the broadcom documentation), shows that it should support at least L0, and I should have enabled it in the BIOS. Yet still, the system cannot get there. Does anyone here have an idea why not? I have updated the firmware on the HBA, but that so far did not change the behavior. Is it something to do with the mainboard? I didn't realize until recently that MSI has a bad reputation here, but I still don't think this is on MSI for sure. I am not sure why it doesn't get higher than C6... but that can be a problem for another day haha. I would really like to get to C6 at least to start. My idle consumption right now is around 33 W (drives spun down), and I'm sure it can go much lower if the package can sleep properly.

 

With the 9500-8i attached:

 

Without the 9500-8i attached:

 

 

Edited September 27, 2023 by ishbuggy

[DrBlokmeister]

I also recently started the journey of reducing the idle power usage of my NAS/server. I find that the power usage during the day with Transmission running is around 50W. In the evening I shut down Transmission, allowing my 3 active drives to go idle and sleep, reducing the power to around 38W. My cores are reacing ~C7 and full package around C2.

 

Yesterday I did some more experiments with my 10GBe NIC. I removed all drives, booted Unraid and measured the power usage. I then removed the NIC, booted Unraid and found that the power usage dropped by 15W! It's an old Dell Broadcom 57810S Dual-Port 10GBASE-T Converged Network Adapter, modded with two 40mm Noctua fans for cooling. So I'm thinking about swapping that out. I saw that @mgutt was using an Intel X550-T1 10GbE (also using RJ45 connection, same as I have). I might be able to get one second-hand for around €120, so if it can save me at least ~8W, it should pay back in a few years, also allowing me to run without fans, which is nice. Do you think that will reduce average load significantly?

 

Another thing is that even without my PCIe NIC, MB network disabled, no hard drives, my NAS still pulls around 15W from the wall. The specs are:

• Gigabyte Technology Co., Ltd. B560M DS3H V
• Intel® Core™ i3-10105 CPU running stock settings
• 32 GiB DDR4, I'll need to check the brand
• Samsung 980 1TB NVME
• ~300W 80 Bronze PSU, I think Corsair, but I'd need to check. It's ~10 years old.
• 4x 18TB WD Ultrastar DC HC550, 7200RPM
• 2x4TB WD Red Plus, 99% of the time spun down

I already followed the guide. Most motherboard settings are set to power saving. Turbo boost disabled, max sleep state set to S10. Onboard audio disabled, aggressive power management options all on. I do notice that the heatsink on the motherboard can become quite warm to the touch, even when fully idle. It's the heat sink labeled UD in this picture. Any more suggestions, things I can try, components I could swap?

Edited September 28, 2023 by DrBlokmeister

[frodr]

Then I have changed to Supermicro X13SAE-F (W680 chipset). No more problems with IPMI and other things. Power usage seems 1-3W lower the the Asus Pro WS W680-ACE IPMI. But I had to add a HBA (LSI 9400-8i) to hold 10x SSD´s. I have ordered a 10 port Sata pcie card, maybe that reduces power usage a little bit.

 

Another 15-20W power usage comes from the Intel E810-XXVDA2 NIC. The hba and nics cards makes it impossible to come in power usage. The server is 58-62W.

 

Running the lspcie command it seems that the LnkCtl ASPM is disabled on a few items.

 

PCI bridge: Intel Corporation Device a70d (rev 01) (prog-if 00 [Normal decode])
                LnkCap: Port #2, Speed 32GT/s, Width x8, ASPM L1, Exit Latency L1 <16us
                LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+

 

WHat does the sentence in italic mean?

 

ASPM not Supported is only the NIC if I understands the read out correct?

 

[Lolight]

On 9/28/2023 at 7:26 PM, DrBlokmeister said:

• ~300W 80 Bronze PSU, I think Corsair, but I'd need to check. It's ~10 years old.

Any more suggestions, things I can try, components I could swap?

The PSU.

You'd need to replace it anyways. Soon.

[JamesAdams]

Hi, 

 

i enable the Global c-state control in the bios but i only have c1 and c2 in powertop any idea ?

 

cpu : Ryzen 9 3950x

Thanks

 

[Lolight]

On 9/27/2023 at 2:07 PM, ishbuggy said:

 I have updated the firmware on the HBA, but that so far did not change the behavior. Is it something to do with the mainboard?

It's been concluded on this thread that a mere presence of an HBA in the system would generally prevent the CPU from reaching anything higher than C2.

As opposed to SATA cards that don't present the same limitation.

Edited October 4, 2023 by Lolight

[ishbuggy]

10 hours ago, Lolight said:

It's been concluded on this thread that a mere presence of an HBA in the system would generally prevent the CPU from reaching anything higher than C2.

As opposed to SATA cards that don't present the same limitation.

Ah okay. That sucks, I was hoping the newer ones would help the system get to higher C-States than C2. Maybe at some point I'll look into switching it for a SATA expander. 

[dopeytree]

Anyone been able to get any data on their NVMe power states?

[frodr]

The power usage reduction was about 15W removing LSI 9400-8i and add a 10 port Sata pcie card.

[awediohead]

On 10/2/2023 at 3:16 PM, JamesAdams said:

Hi, 

 

i enable the Global c-state control in the bios but i only have c1 and c2 in powertop any idea ?

 

cpu : Ryzen 9 3950x

Thanks

 

I have much the same question - though with a Ryzen 3600 on x570.

I'm really unclear as to what powertop can usefully/safely do for AMD CPU's? What it can't do and where to draw the line?

 

The OP states it is useable, and warns that only getting C1, C2 and C3 is normal for new Intel and all AMD CPUs, however the guidance that follows assumes a fairly deep familiarity with Linux CLI that's way over my head. It's clear that I can't use autotune safely because of having a JMicron PCIe SATA card and the 'tunables' are 90% all 'Bad' apart from a dozen or so 'Goods' at the bottom of a very long list. No idea where to start!

 

I also have a query about how you'd go about doing what's suggested in the OP without the config file editor which is now deprecated ?

 

After messing about with BIOS setting for a few days at least I now have my system going to sleep when not in active use and responding to WOL to wake up again - this is pretty crude in terms of power efficiency but a big step in the right direction for me. I just went through every setting I could find in the ASUS x570 BIOS relating to C states and energy efficiency and turned it on or off - even something minor such as the onboard LEDs makes a huge difference to this stability IME.

 

I'll research this more but maybe someone can chime in on the difference between the apparently problematic PCIe SATA cards mentioned in the OP (like my JMicron) and getting a PCIe SAS HBA card - I assume the latter does not have an onboard SATA controller chip and would therefore respond better to "instruction" from the OS directly in terms of power management?

 

Probably wishful thinking but it'd be great if someone with the know how could do a guide for AMD power efficiency.

[Louisgaga]

Hi,
Thanks for this topic! I try to reduce the consumption of my setup and have found many answers here.
My server currently idle at 21w (from wall) when HDD off.

Motherboard : asrock z390 phantom gaming-itx/ac

Proc : i7 9700k

Memory : Corsair Vengeance LPX 2x8 16GB Dual Channel DDR4 Kit 3200MHz
HDD1 : WD 8TO
HDD2 : Seagate 3TB
HDD3 : WD 8TO
SSD 1 : Samsung 860EVO 500GB

NVME 1 : Samsung 970 EVO plus 500GB

In Bios 

- all C state enabled in Bios

- ASPM LOs&L1 activated

- Desactivated TB, Wifi, unused usb3 ports

 

I added Powertop autotune plus extra command lines at startup.

 

In Powertop i can see that

CPU is going up to C10

Core is going up to c7

Package is not going further (or lower) than C3... (sum of percentage doen't sum up to 100% I understand this is because C0/C1 is not displayed)

 

ASPM is enabled for everything BUT "PCI bridge: Intel Corporation 6th-10th Gen Core Processor PCIe Controller (x16)"

 

but in the idle stat I can see that this doesn't prevent desactivation of the card, and I don't have anything plug to it (unfortunately I don't see any setup to desactivate this in BIOS)

Why is my setup not going lower than C3?

Is 21w ok for an i7 9700k and a Z390 with nothing else than a 1GB ethernet and 2 USB (unraid usb and a wireless keyboard (currently used for Bios set up)?

Is there anything I miss? 

 

Thank you.
 

Edited October 12, 2023 by Louisgaga

[inquiring-dearie7570]

Hello I'm a user using an i7 12700 and the msi board doesn't show c3 or more so I'm looking to buy a new 700 chipset board. I need to support ddr5, but usually the "asus, gigabit" brand seems to reach c10. Can anyone recommend a board

[JamesAdams]

Stuck in c3 cause of sas 9211-8i 😢

[JamesAdams]

You know if there are LSI card compatible with c-states ?

[Lolight]

4 hours ago, JamesAdams said:

You know if there are LSI card compatible with c-states ?

Apparently there isn't one.

But there are reports of at least some SATA expansion cards playing nice with C-states.

Edited October 15, 2023 by Lolight

[dopeytree]

Found this thread on homelab saying on truenass it IS possible to reach c6 with a LSI card.... so possibly solely an unraid issues??

 

Quote

Therefore I need a PCIe SAS HBA card but I found out that those cause the CPU to not go into C-States deeper than 2.

 

This is not necessarily the case. For example, one of my backup servers is a Dell R720 connected to a NetApp DS4246, running TrueNAS SCALE.

 

The R720 has two LSI HBAs in it: the onboard H310 Mini Mono flashed to IT mode firmware and a 9205-8e.

PowerTOP output shows the CPU is hitting its deepest available PC and C states (PC6 and C6) for the 2695 v2 (see page 21 of the E5 v2 reference).

 

What HBA were you thinking about getting, and where did you find that it wouldn't allow the system to go to deeper C states?

 

https://www.reddit.com/r/homelab/comments/14s2hzg/sas_hba_and_cstates/

 

 

Edited October 15, 2023 by dopeytree

[Lolight]

3 hours ago, dopeytree said:

Found this thread on homelab saying on truenass it IS possible to reach c6 with a LSI card.... so possibly solely an unraid issues??

That's an interesting claim.

Too bad there was no much info provided on the setup and settings.

There are so many variances involved - no way to know how it was achieved on that particular system.

 

As an example here's a very good write up on what is involved in trying to determine system behavior under various component setups.

Scroll down to "Power Consumption Puzzles – Swapping from the JMB585 to the ASM1166"

 

https://mattgadient-com.translate.goog/7-watts-idle-on-intel-12th-13th-gen-the-foundation-for-building-a-low-power-server-nas/?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en-US&_x_tr_pto=wapp

[dopeytree]

Broadcom state support of ASPM L1 here: https://docs.broadcom.com/doc/12353246

This is for an older chip so newer is almost guaranteed to support it...

 

 

The ultimate test would be to boot an ubuntu live usb key and see if you reach any c state with an LSI card. Then you will know if it just unraid or the hardware & bios limiting.

Edited October 15, 2023 by dopeytree