unRAID 6 NerdPack - CLI tools (iftop, iotop, screen, kbd, etc.)

jonp

By jonp
in Plugin Support

Recommended Posts

Recommended

Posted by Kilrah,

EDIT: Nerdtools is now available as a replacement, you might want to check that first: Some tools like iperf3 and perl are now included in the base unraid release, hence them not being present in there. If it doesn't have what you need request it in the thread, and in the meantime the manual install below is still available in the original text below:   ----------------------   Nerdpack is deprecated in 6.11.   For the record, since it was unfortunately o

Package install intructiosn for v6.11.0+

Recommended by JorgeB

  • Upvote
  • Thanks
  • Like

23 reactions

Go to this post
dmacias Proficient

dmacias

Posted
Posted



Hi dmacias,
 
Can you please add the newest (2.10) version of rmlint?  We're using it to get CoW convergence on our caches
 
Edit:  It looks like the other option for this, jdupes, was built without btrfs support.  For those who need it, can you please enable that flag in the makefile and republish?
 
I'm not sure if it's in the works to configure where Nerdpack is pointed, but if it is, I'd be willing to open my own packages to lend a hand.  I imagine most others feel similarly.


I updated to a precompiled version of jdupes. Let me know if it has btrfs support. If not I can compile it. NerdPack points to my github. So you could make a pull request for any package. https://github.com/dmacias72/unRAID-NerdPack/tree/master/packages it's sorted by unraid version since some packages have to be recompiled for different unraid versions due to dependencies.
Link to comment
  • Replies 2k
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

Kilrah
Kilrah

EDIT: Nerdtools is now available as a replacement, you might want to check that first: Some tools like iperf3 and perl are now included in the base unraid release, hence them not being present i

jonp
jonp

Lol, are we going to petition the willy wonka company to change the name of their candy too?  I guess its not a big deal to change the name, I just have to laugh at the thought of someone honestly bei

jonp
jonp

From discussion that start in this thread, we decided to create a simple plugin that installs a set of additional command line tools onto your unRAID server.   WARNING:  These tools are for

Posted Images

Squid Grand Master

Squid

Posted
Posted
6 minutes ago, dmacias said:
21 minutes ago, Squid said:
As an aside, there is a docker container already available in Apps that is this precise thing.

Does that work if you already using it for transcoding in another container?

I would think that is the point of the container...

  • Like 1
Link to comment
Squid Grand Master

Squid

Posted
Posted
39 minutes ago, Lavoslav said:

Could you add edac_mce_amd module since mcelog module does not support AMD processor family 23.

That module was added in quite a number of releases of the OS ago.

 

Effectively what the message means from mcelog is that the stock mce module (ie: Intel) isn't support, and the system is switching to using the edac_mce_amd module instead.

Link to comment
mika91 Noob

mika91

Posted
Posted
On 9/17/2020 at 11:56 PM, mgutt said:

Did you test powertop? I'm a little bit confused. Why are the Pkg(HW) stats and frequency stats empty?

Hello.

I have a very simple usage of powertop 

I just extracted a report, then add the tweaks in go files.

My idle power consumptions is now very low, as it was with OMV.

Link to comment
mika91 Noob

mika91

Posted
Posted (edited)

Sure, nothing complex.
Just run 

powertop -r powertop.html

Then you move the file wherever you can open it with a web brower.
Go to the 'tuning' tab, and copy/paste the tweaks  you want to apply in the /etc/boot/go file

My go file looks like 

#!/bin/bash

# -------------------------------------------------
# Start the Management Utility
# -------------------------------------------------
/usr/local/sbin/emhttp &

# -------------------------------------------------
# enable jellyfin hardware transcoding on intel
# -------------------------------------------------
modprobe i915
chown -R nobody:users /dev/dri
chmod -R 777 /dev/dri

# -------------------------------------------------
# fix seagate not stay spun-down
# -------------------------------------------------
#hdparm -B 255 /dev/disks/by-id/ata-ST3000DM001-1CH166_Z1F59K90

# -------------------------------------------------
# powertop tweaks
# -------------------------------------------------
# Enable SATA link power management
for i in /sys/class/scsi_host/host*/link_power_management_policy
#do echo 'min_power' > $i;
do echo 'med_power_with_dipm' > $i;
done
# NMI watchdog should be turned off
# echo '0' > '/proc/sys/kernel/nmi_watchdog';

# VM writeback timeout
echo '1500' > '/proc/sys/vm/dirty_writeback_centisecs';

# Runtime PM for I2C Adapter (i915 gmbus dpb)
for i in /sys/bus/i2c/devices/i2c-*/device/power/control
do echo 'auto' > $i;
done

# Autosuspend for USB device
for i in echo /sys/bus/usb/devices/*/power/control
do echo 'auto' > $i;
done

# Runtime PM for disk
for i in /sys/block/sd*/device/power/control
do echo 'auto' > $i;
done

# Runtime PM for PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/power/control;
do echo 'auto' > $i;
done

# Runtime PM for port ata od PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/ata*/power/control;
do echo 'auto' > $i;
done

# Disable wake on lan
ethtool -s eth0 wol d

Finally, export another report and verify all tweaks are applied.

Edited by mika91
Link to comment
mgutt Veteran

mgutt

Posted
Posted (edited)

Thanks for the explanation

 

1.) Did you create the for-loops by yourself? Because my tuning results are only single scripts like: 

echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata1/power/control';
echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata2/power/control';
echo 'auto' > '/sys/bus/pci/devices/0000:00:17.0/ata3/power/control';
...

2.) This script is extremely flexible: 

for i in /sys/bus/pci/devices/????:??:??.?/power/control;

I mean, it covers more pci devices than returned through powertop. Don't you think it will cause errors?

 

3.) Another thing are my usb devices. I have connected in total 4. It suggests the following settings in the top: 

Autosuspend for USB device PROTECT [AEG PS]echo 'auto' > '/sys/bus/usb/devices/1-5/power/control';
Autosuspend for USB device External Disk 3.0 [JMicron]echo 'auto' > '/sys/bus/usb/devices/2-3/power/control';
Autosuspend for USB device External Disk 3.0 [JMicron]echo 'auto' > '/sys/bus/usb/devices/2-4/power/control';
Autosuspend for USB device Mass Storage Device [JetFlash]echo 'auto' > '/sys/bus/usb/devices/1-6/power/control';

Under "Optimal Tuned" it returned: 

Autosuspend for USB device xHCI Host Controller [usb1]
Autosuspend for USB device xHCI Host Controller [usb2]

And at the bottom this: 

Wake status for USB device usb1echo 'enabled' > '/sys/bus/usb/devices/usb1/power/wakeup';
Wake status for USB device 1-5echo 'enabled' > '/sys/bus/usb/devices/1-5/power/wakeup';
Wake status for USB device usb2echo 'enabled' > '/sys/bus/usb/devices/usb2/power/wakeup';

If I understand this correct, then "usb1" and "usb2" are "USB-Hubs" and "1-5" is my UPS unit connected to "usb1". Doesn't it make sense to set "1-6" to "enabled" as its the Unraid Flash Drive? And finally I ask myself if it is really needed to set "usb2" to "enabled" as it is "disabled" since I setup my server and it did never produce problems.

 

EDIT: After applying the script my build (8 sleeping HDDs, 1 active NVMe, active 10G) went down by 4W to 19.59W! 

554074845_2020-09-2800_13_05.png.224249c513cec051b618d6ec5ebc515a.png

 

As you can see I used effectively your script: 

#!/bin/bash

# -------------------------------------------------
# Start the Management Utility
# -------------------------------------------------
/usr/local/sbin/emhttp &

# -------------------------------------------------
# enable jellyfin hardware transcoding on intel
# -------------------------------------------------
modprobe i915
chown -R nobody:users /dev/dri
chmod -R 777 /dev/dri

# -------------------------------------------------
# powertop tweaks
# -------------------------------------------------

# Enable SATA link power management
for i in /sys/class/scsi_host/host*/link_power_management_policy
    do echo 'med_power_with_dipm' > $i;
done

# VM writeback timeout
echo '1500' > '/proc/sys/vm/dirty_writeback_centisecs';

# Runtime PM for I2C Adapter (i915 gmbus dpb)
for i in /sys/bus/i2c/devices/i2c-*/device/power/control
    do echo 'auto' > $i;
done

# Autosuspend for USB device
for i in echo /sys/bus/usb/devices/*/power/control
    do echo 'auto' > $i;
done

# Runtime PM for disk
for i in /sys/block/sd*/device/power/control
    do echo 'auto' > $i;
done

# Runtime PM for PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/power/control;
    do echo 'auto' > $i;
done

# Runtime PM for port ata od PCI devices
for i in /sys/bus/pci/devices/????:??:??.?/ata*/power/control;
    do echo 'auto' > $i;
done

# Disable wake on lan
#ethtool -s eth0 wol d #unsupported by 10g network adapter
ethtool -s eth1 wol d
ethtool -s eth2 wol d

 

Edited by mgutt
Link to comment
  • 2 weeks later...
  • Squid unpinned this topic

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing