unRAID 6 NerdPack - CLI tools (iftop, iotop, screen, kbd, etc.)


jonp

1586 posts in this topic Last Reply

Recommended Posts



Hi dmacias,
 
Can you please add the newest (2.10) version of rmlint?  We're using it to get CoW convergence on our caches
 
Edit:  It looks like the other option for this, jdupes, was built without btrfs support.  For those who need it, can you please enable that flag in the makefile and republish?
 
I'm not sure if it's in the works to configure where Nerdpack is pointed, but if it is, I'd be willing to open my own packages to lend a hand.  I imagine most others feel similarly.


I updated to a precompiled version of jdupes. Let me know if it has btrfs support. If not I can compile it. NerdPack points to my github. So you could make a pull request for any package. https://github.com/dmacias72/unRAID-NerdPack/tree/master/packages it's sorted by unraid version since some packages have to be recompiled for different unraid versions due to dependencies.
Link to post
  • Replies 1.6k
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

From discussion that start in this thread, we decided to create a simple plugin that installs a set of additional command line tools onto your unRAID server.   WARNING:  These tools are for

Lol, are we going to petition the willy wonka company to change the name of their candy too?  I guess its not a big deal to change the name, I just have to laugh at the thought of someone honestly bei

I had the same issue... re-linking/aliasing to the existing libraries (libssl.so.1.1 and libcrypto.so.1.1) fixed the issue. A simple `ls -la` helped me figure out what libraries I had... root@Towe

Posted Images

On 9/6/2020 at 10:19 AM, mika91 said:

Hello,
Do you think it's possible to add [url=https://slackware.pkgs.org/14.2/slackware-x86_64/powertop-2.8-x86_64-1.txz.html]powertop[/url] package ?

It would be usefull to reduce unraid box power consumptions.
Thanks

Did you test powertop? I'm a little bit confused. Why are the Pkg(HW) stats and frequency stats empty?

 

2025547438_2020-09-1723_52_51.png.0526dc59b3df55e7066d557ada9fd6a5.png

 

70771709_2020-09-1723_52_59.png.0abf3072e05c1da953e234f84fef1d56.png

Link to post
6 minutes ago, dmacias said:
21 minutes ago, Squid said:
As an aside, there is a docker container already available in Apps that is this precise thing.

Does that work if you already using it for transcoding in another container?

I would think that is the point of the container...

Link to post
39 minutes ago, Lavoslav said:

Could you add edac_mce_amd module since mcelog module does not support AMD processor family 23.

That module was added in quite a number of releases of the OS ago.

 

Effectively what the message means from mcelog is that the stock mce module (ie: Intel) isn't support, and the system is switching to using the edac_mce_amd module instead.

Link to post
On 9/10/2020 at 11:35 AM, dmacias said:
On 8/31/2020 at 11:57 AM, IamSpartacus said:
Has anyone gotten fio to successfully run?  I just get "illegal instruction" even with --disable-native set.  I've tried this in both 6.9 beta 25 and 6.8.3 stable.

I updated fio. Try again and let me know

This worked, thank you!

Link to post
On 9/17/2020 at 11:56 PM, mgutt said:

Did you test powertop? I'm a little bit confused. Why are the Pkg(HW) stats and frequency stats empty?

Hello.

I have a very simple usage of powertop 

I just extracted a report, then add the tweaks in go files.

My idle power consumptions is now very low, as it was with OMV.

Link to post

Sure, nothing complex.
Just run

powertop -r powertop.html

Then you move the file wherever you can open it with a web brower.
Go to the 'tuning' tab, and copy/paste the tweaks  you want to apply in the /etc/boot/go file

My go file looks like

#!/bin/bash

# -------------------------------------------------
# Start the Management Utility
# -------------------------------------------------
/usr/local/sbin/emhttp &

# -------------------------------------------------
# enable jellyfin hardware transcoding on intel
# -------------------------------------------------
modprobe i915
chown -R nobody:users /dev/dri
chmod -R 777 /dev/dri

# -------------------------------------------------
# fix seagate not stay spun-down
# -------------------------------------------------
#hdparm -B 255 /dev/disks/by-id/ata-ST3000DM001-1CH166_Z1F59K90

# -------------------------------------------------
# powertop tweaks
# -------------------------------------------------
# Enable SATA link power management
for i in /sys/class/scsi_host/host*/link_power_management_policy
#do echo 'min_power' > $i;
do echo 'med_power_with_dipm' > $i;
done
# NMI watchdog should be turned off
# echo '0' > '/proc/sys/kernel/nmi_watchdog';

# VM writeback timeout
echo '1500' > '/proc/sys/vm/dirty_writeback_centisecs';

# Runtime PM for I2C Adapter (i915 gmbus dpb)
for i in /sys/bus/i2c/devices/i2c-*/device/power/control
do echo 'auto' > $i;
done

# Autosuspend for USB device
for i in echo /sys/bus/usb/devices/*/power/control
do echo 'auto' > $i;
done

# Runtime PM for disk
for i in /sys/block/sd*/device/power/control
do echo 'auto' > $i;
done

# Runtime PM for PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/power/control;
do echo 'auto' > $i;
done

# Runtime PM for port ata od PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/ata*/power/control;
do echo 'auto' > $i;
done

# Disable wake on lan
ethtool -s eth0 wol d


Finally, export another report and verify all tweaks are applied.

Edited by mika91
Link to post

Thanks for the explanation

 

1.) Did you create the for-loops by yourself? Because my tuning results are only single scripts like:

echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata1/power/control';
echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata2/power/control';
echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata3/power/control';
...

2.) This script is extremely flexible:

for i in /sys/bus/pci/devices/????:??:??.?/power/control;

I mean, it covers more pci devices than returned through powertop. Don't you think it will cause errors?

 

3.) Another thing are my usb devices. I have connected in total 4. It suggests the following settings in the top:

Autosuspend for USB device PROTECT [AEG PS]echo 'auto' > '/sys/bus/usb/devices/1-5/power/control';
Autosuspend for USB device External Disk 3.0 [JMicron]echo 'auto' > '/sys/bus/usb/devices/2-3/power/control';
Autosuspend for USB device External Disk 3.0 [JMicron]echo 'auto' > '/sys/bus/usb/devices/2-4/power/control';
Autosuspend for USB device Mass Storage Device [JetFlash]echo 'auto' > '/sys/bus/usb/devices/1-6/power/control';

Under "Optimal Tuned" it returned:

Autosuspend for USB device xHCI Host Controller [usb1]
Autosuspend for USB device xHCI Host Controller [usb2]

And at the bottom this:

Wake status for USB device usb1echo 'enabled' > '/sys/bus/usb/devices/usb1/power/wakeup';
Wake status for USB device 1-5echo 'enabled' > '/sys/bus/usb/devices/1-5/power/wakeup';
Wake status for USB device usb2echo 'enabled' > '/sys/bus/usb/devices/usb2/power/wakeup';

If I understand this correct, then "usb1" and "usb2" are "USB-Hubs" and "1-5" is my UPS unit connected to "usb1". Doesn't it make sense to set "1-6" to "enabled" as its the Unraid Flash Drive? And finally I ask myself if it is really needed to set "usb2" to "enabled" as it is "disabled" since I setup my server and it did never produce problems.

 

EDIT: After applying the script my build (8 sleeping HDDs, 1 active NVMe, active 10G) went down by 4W to 19.59W! 

554074845_2020-09-2800_13_05.png.224249c513cec051b618d6ec5ebc515a.png

 

As you can see I used effectively your script:

#!/bin/bash

# -------------------------------------------------
# Start the Management Utility
# -------------------------------------------------
/usr/local/sbin/emhttp &

# -------------------------------------------------
# enable jellyfin hardware transcoding on intel
# -------------------------------------------------
modprobe i915
chown -R nobody:users /dev/dri
chmod -R 777 /dev/dri

# -------------------------------------------------
# powertop tweaks
# -------------------------------------------------

# Enable SATA link power management
for i in /sys/class/scsi_host/host*/link_power_management_policy
    do echo 'med_power_with_dipm' > $i;
done

# VM writeback timeout
echo '1500' > '/proc/sys/vm/dirty_writeback_centisecs';

# Runtime PM for I2C Adapter (i915 gmbus dpb)
for i in /sys/bus/i2c/devices/i2c-*/device/power/control
    do echo 'auto' > $i;
done

# Autosuspend for USB device
for i in echo /sys/bus/usb/devices/*/power/control
    do echo 'auto' > $i;
done

# Runtime PM for disk
for i in /sys/block/sd*/device/power/control
    do echo 'auto' > $i;
done

# Runtime PM for PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/power/control;
    do echo 'auto' > $i;
done

# Runtime PM for port ata od PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/ata*/power/control;
    do echo 'auto' > $i;
done

# Disable wake on lan
#ethtool -s eth0 wol d #unsupported by 10g network adapter
ethtool -s eth1 wol d
ethtool -s eth2 wol d

 

Edited by mgutt
Link to post
  • 2 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.