unRAID 6 NerdPack - CLI tools (iftop, iotop, screen, kbd, etc.)


jonp

Recommended Posts

I've requested 'anacron' in the unRAID 'feature request' sub-forum, well i added mine to someones pre-existing request for it. That request dates back to 2016 so it doesn't appear likely to be added, and as 6.8 has only just landed without it, i doubt it's arrive any time soon... or ever.

 

Can we please have anacron? It's ideal for systems that are not on 24/7.

 

Thank you.

Link to comment

any idea why im getting this error?


 

$ borg mount ./ mount

borg mount not available: loading FUSE support failed [ImportError: No module named 'llfuse']

 

i def have llfuse installed and up-to-date in nerd pack

 

Tower nerdpack: llfuse-1.1 package up to date, checksum ok.

 

Would it be better to use a docker container to do this instead of user scripts then?

Link to comment
4 hours ago, coffeepen said:

any idea why im getting this error?


 


$ borg mount ./ mount

borg mount not available: loading FUSE support failed [ImportError: No module named 'llfuse']

 

i def have llfuse installed and up-to-date in nerd pack

 


Tower nerdpack: llfuse-1.1 package up to date, checksum ok.

 

Would it be better to use a docker container to do this instead of user scripts then?

We tried making mount command work earlier in the thread, 

but I gave up :( Please do tell if you find out some way to make it work!

 

Link to comment
15 minutes ago, Nischi said:

We tried making mount command work earlier in the thread, 

but I gave up :( Please do tell if you find out some way to make it work!

 

I tried following what you guys did, but I got this error:

pip3 install pyfuse3
Collecting pyfuse3
  Using cached https://files.pythonhosted.org/packages/0e/f6/fd90c178fd2e3a7db9744769c70ee8c88ce83140580508bcc964f1614b7f/pyfuse3-2.0.0.tar.gz
Requirement already satisfied: trio in /usr/lib64/python3.7/site-packages (from pyfuse3) (0.13.0)
Requirement already satisfied: attrs>=19.2.0 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (19.3.0)
Requirement already satisfied: outcome in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.0.1)
Requirement already satisfied: idna in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.8)
Requirement already satisfied: sortedcontainers in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.1.0)
Requirement already satisfied: async-generator>=1.9 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.10)
Requirement already satisfied: sniffio in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.1.0)
Installing collected packages: pyfuse3
  Running setup.py install for pyfuse3 ... error
    ERROR: Complete output from command /usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile:
    ERROR: running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.7
    copying src/_pyfuse3.py -> build/lib.linux-x86_64-3.7
    copying src/pyfuse3_asyncio.py -> build/lib.linux-x86_64-3.7
    running build_ext
    building 'pyfuse3' extension
    creating build/temp.linux-x86_64-3.7
    creating build/temp.linux-x86_64-3.7/src
    gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -I/usr/include/python3.7m -c src/pyfuse3.c -o build/temp.linux-x86_64-3.7/src/pyfuse3.o -I/usr/include/fuse3 -DFUSE_USE_VERSION=32 -Wall -Wextra -Wconversion -Wsign-compare -DPYFUSE3_VERSION="2.0.0" -Wno-unused-function -Wno-implicit-fallthrough -Wno-unused-function -Wno-unused-parameter
    In file included from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/syslimits.h:7,
                     from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:34,
                     from /usr/include/python3.7m/Python.h:11,
                     from src/pyfuse3.c:4:
    /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:194:15: fatal error: limits.h: No such file or directory
     #include_next <limits.h>  /* recurse down to the real one */
                   ^~~~~~~~~~
    compilation terminated.
    error: command 'gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command "/usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-pr93ncth/pyfuse3/

I installed gcc from the Unraid dev pack plugin, and installed fuse3 using installpkg like you guys discussed.

 

Is it possible to roll back to a previous version of borg in nerd pack? I cant recover documents I need.

 

Edited by coffeepen
Link to comment
I tried following what you guys did, but I got this error:
pip3 install pyfuse3Collecting pyfuse3 Using cached https://files.pythonhosted.org/packages/0e/f6/fd90c178fd2e3a7db9744769c70ee8c88ce83140580508bcc964f1614b7f/pyfuse3-2.0.0.tar.gzRequirement already satisfied: trio in /usr/lib64/python3.7/site-packages (from pyfuse3) (0.13.0)Requirement already satisfied: attrs>=19.2.0 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (19.3.0)Requirement already satisfied: outcome in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.0.1)Requirement already satisfied: idna in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.8)Requirement already satisfied: sortedcontainers in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.1.0)Requirement already satisfied: async-generator>=1.9 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.10)Requirement already satisfied: sniffio in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.1.0)Installing collected packages: pyfuse3 Running setup.py install for pyfuse3 ... error   ERROR: Complete output from command /usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile:   ERROR: running install   running build   running build_py   creating build   creating build/lib.linux-x86_64-3.7   copying src/_pyfuse3.py -> build/lib.linux-x86_64-3.7   copying src/pyfuse3_asyncio.py -> build/lib.linux-x86_64-3.7   running build_ext   building 'pyfuse3' extension   creating build/temp.linux-x86_64-3.7   creating build/temp.linux-x86_64-3.7/src   gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -I/usr/include/python3.7m -c src/pyfuse3.c -o build/temp.linux-x86_64-3.7/src/pyfuse3.o -I/usr/include/fuse3 -DFUSE_USE_VERSION=32 -Wall -Wextra -Wconversion -Wsign-compare -DPYFUSE3_VERSION="2.0.0" -Wno-unused-function -Wno-implicit-fallthrough -Wno-unused-function -Wno-unused-parameter   In file included from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/syslimits.h:7,                    from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:34,                    from /usr/include/python3.7m/Python.h:11,                    from src/pyfuse3.c:4:   /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:194:15: fatal error: limits.h: No such file or directory    #include_next   /* recurse down to the real one */                  ^~~~~~~~~~   compilation terminated.   error: command 'gcc' failed with exit status 1   ----------------------------------------ERROR: Command "/usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-pr93ncth/pyfuse3/

I installed gcc from the Unraid dev pack plugin, and installed fuse3 using installpkg like you guys discussed.
 
Is it possible to roll back to a previous version of borg in nerd pack? I cant recover documents I need.
 

Try it now. I recompiled borgbackup and compiled llfuse myself
Link to comment
35 minutes ago, dmacias said:

Try it now. I recompiled borgbackup and compiled llfuse myself

Something happened - no idea what. Any suggestions? :P

 

Traceback (most recent call last):
  File "/usr/bin/borg", line 6, in <module>
    from pkg_resources import load_entry_point
ModuleNotFoundError: No module named 'pkg_resources'

 

Link to comment
26 minutes ago, dmacias said:

You need setuptools

Setuptools grabbed and a new error appears.

Traceback (most recent call last):
  File "/usr/lib64/python3.8/site-packages/borg/archiver.py", line 41, in <module>
    from .archive import Archive, ArchiveChecker, ArchiveRecreater, Statistics, is_special
  File "/usr/lib64/python3.8/site-packages/borg/archive.py", line 20, in <module>
    from . import xattr
  File "/usr/lib64/python3.8/site-packages/borg/xattr.py", line 9, in <module>
    from ctypes import CDLL, create_string_buffer, c_ssize_t, c_size_t, c_char_p, c_int, c_uint32, get_errno
  File "/usr/lib64/python3.8/ctypes/__init__.py", line 7, in <module>
    from _ctypes import Union, Structure, Array
ImportError: libffi.so.7: cannot open shared object file: No such file or directory

 

Link to comment
I tried following what you guys did, but I got this error:
pip3 install pyfuse3Collecting pyfuse3 Using cached https://files.pythonhosted.org/packages/0e/f6/fd90c178fd2e3a7db9744769c70ee8c88ce83140580508bcc964f1614b7f/pyfuse3-2.0.0.tar.gzRequirement already satisfied: trio in /usr/lib64/python3.7/site-packages (from pyfuse3) (0.13.0)Requirement already satisfied: attrs>=19.2.0 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (19.3.0)Requirement already satisfied: outcome in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.0.1)Requirement already satisfied: idna in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.8)Requirement already satisfied: sortedcontainers in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (2.1.0)Requirement already satisfied: async-generator>=1.9 in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.10)Requirement already satisfied: sniffio in /usr/lib64/python3.7/site-packages (from trio->pyfuse3) (1.1.0)Installing collected packages: pyfuse3 Running setup.py install for pyfuse3 ... error   ERROR: Complete output from command /usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile:   ERROR: running install   running build   running build_py   creating build   creating build/lib.linux-x86_64-3.7   copying src/_pyfuse3.py -> build/lib.linux-x86_64-3.7   copying src/pyfuse3_asyncio.py -> build/lib.linux-x86_64-3.7   running build_ext   building 'pyfuse3' extension   creating build/temp.linux-x86_64-3.7   creating build/temp.linux-x86_64-3.7/src   gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -I/usr/include/python3.7m -c src/pyfuse3.c -o build/temp.linux-x86_64-3.7/src/pyfuse3.o -I/usr/include/fuse3 -DFUSE_USE_VERSION=32 -Wall -Wextra -Wconversion -Wsign-compare -DPYFUSE3_VERSION="2.0.0" -Wno-unused-function -Wno-implicit-fallthrough -Wno-unused-function -Wno-unused-parameter   In file included from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/syslimits.h:7,                    from /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:34,                    from /usr/include/python3.7m/Python.h:11,                    from src/pyfuse3.c:4:   /usr/lib64/gcc/x86_64-slackware-linux/8.3.0/include-fixed/limits.h:194:15: fatal error: limits.h: No such file or directory    #include_next   /* recurse down to the real one */                  ^~~~~~~~~~   compilation terminated.   error: command 'gcc' failed with exit status 1   ----------------------------------------ERROR: Command "/usr/bin/python3 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pr93ncth/pyfuse3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-15ssg5gi/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-pr93ncth/pyfuse3/

I installed gcc from the Unraid dev pack plugin, and installed fuse3 using installpkg like you guys discussed.
 
Is it possible to roll back to a previous version of borg in nerd pack? I cant recover documents I need.
 

I ended up needing fuse2 to compile llfuse but seems to be working now. I tried compiling the alpha version of borgbackup because the change log looked like they fixed some of these dependency errors but kept getting an openssl error.
Link to comment
16 hours ago, dmacias said:

Just a heads up you'll need ncurses-terminfo for screen and tmux. This includes all the terms they rip out of ncurses so I don't have to manually add them to packages.

I'm attempting to install ncurses-terminfo but it just won't install.

 

Get an output that looks like this:

Processing Packages...

bash-completion-2.8 package up to date, checksum ok.

iftop-1.0pre4 package up to date, checksum ok.

iotop-0.6 package up to date, checksum ok.

iperf-3.1.6 package up to date, checksum ok.

lftp-4.8.4 package up to date, checksum ok.

mediainfo-17.12 package up to date, checksum ok.

Downloading ncurses-terminfo-6.1_20191130-x86_64-1.txz package...

ncurses-terminfo-6.1_20191130-x86_64-1.txz package download sucessful!

Installing ncurses-terminfo-6.1.20191130 package...

perl-5.30.0 package up to date, checksum ok.

python3-3.8.1 package up to date, checksum ok.

python-2.7.17 package up to date, checksum ok.

vim-8.1.0727 package up to date, checksum ok.

Cleaning up packages...

All packages processed...

But ncurses-terminfo then still shows as not installed, there is no .txz file in /boot/config/plugins/NerdPack/packages/6.8 and no added files in /usr/share/terminfo

 

Am I doing something wrong?

Link to comment
1 hour ago, dedwardsdale said:

I'm attempting to install ncurses-terminfo but it just won't install.

 

Get an output that looks like this:


Processing Packages...

bash-completion-2.8 package up to date, checksum ok.

iftop-1.0pre4 package up to date, checksum ok.

iotop-0.6 package up to date, checksum ok.

iperf-3.1.6 package up to date, checksum ok.

lftp-4.8.4 package up to date, checksum ok.

mediainfo-17.12 package up to date, checksum ok.

Downloading ncurses-terminfo-6.1_20191130-x86_64-1.txz package...

ncurses-terminfo-6.1_20191130-x86_64-1.txz package download sucessful!

Installing ncurses-terminfo-6.1.20191130 package...

perl-5.30.0 package up to date, checksum ok.

python3-3.8.1 package up to date, checksum ok.

python-2.7.17 package up to date, checksum ok.

vim-8.1.0727 package up to date, checksum ok.

Cleaning up packages...

All packages processed...

But ncurses-terminfo then still shows as not installed, there is no .txz file in /boot/config/plugins/NerdPack/packages/6.8 and no added files in /usr/share/terminfo

 

Am I doing something wrong?

No, I did. I removed the underscore. Should work now.

Link to comment
On 11/24/2019 at 4:41 AM, Derek_ said:

Hiya, i'm looking at backup options and found BorgBackup is in the Nerd Pack, so this is probably my go-to. But in researching, BorgMatic appears to be a very popular "addition" to BorgBackup. It does seem to be a little easier to setup (and copy for modification and re-use on multiple machines). Another popular addition to Borg is "Emborg".

 

https://torsion.org/borgmatic/

https://emborg.readthedocs.io/en/latest/

 

With BorgBackup already included, what do you think the chances are you might include BorgMatic / Emborg? :) :)

 

Thanks.

BorgMatic and/or Emborg in Nerd Pack would be great! 

Did you manage to install it? 

Link to comment
On 1/3/2020 at 4:07 AM, vakilando said:

BorgMatic and/or Emborg in Nerd Pack would be great! 

Did you manage to install it? 

No, i haven't tried. I've only set up Borg on my desktop to backup to unRAID, i haven't yet tackled the server-side. There are... complications :(. Seems that doing everything as root is how unRAID works, including using SSH as root (only as root). There's a plugin that allows SSH as other users mentioned in that thread which i haven't tried yet, but even if that works - Cron operations will run as root which as i mention in the thread screw the permissions on the backup set (if the backups 'belong' to a different user. I'm new to unRAID and this approach (root all the things) really took me by surprise. I have to decide what i'm going to do.

 

 

 

Link to comment
On 12/31/2019 at 1:17 PM, coffeepen said:

Is it possible to roll back to a previous version of borg in nerd pack? I cant recover documents I need.

I'm not sure if this relates - were those documents backed up in an old version of Borg? I have no experience with this command option, if it were me, i'd backup my Repository before trying it:

https://borgbackup.readthedocs.io/en/stable/usage/upgrade.html

 

Link to comment
BorgMatic and/or Emborg in Nerd Pack would be great! 
Did you manage to install it? 
I won't be including this because it requires a bunch of other packages. Any python package that doesn't need to be compiled can be installed with pip. E.g. pip3 install borgmatic. I just tried it. You just need python3, setuptools, pip and libffi. There are also dockers available.
  • Thanks 1
Link to comment
3 minutes ago, Skipdog said:

Apologies i did search for a solution!

 

I've installed and reinstalled the nerd pack but when I attempt to execute iperf3 it doesn't seem to find it.  Looked in various directories.

 

What rookie mistake am I making?

 

Skip

Did you actually go into nerdpack settings and install iperf3?

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.