overbyrn

Community Developer
  • Posts

    582
  • Joined

  • Last visited

Posts posted by overbyrn

  1. Hi all,

    I put together a simple docker container as a wrapper around Bulk Downloader for Reddit, the tool for downloading submissions. The container also has options to run several supporting tools; detox to clean filenames, rdfind to delete dupes or convert to symbolic links, clean messy symlnks & create relative versions.

     

    I'm currently using it as a personal docker template.  I'd prefer not to support it as a fully fledged CA app. If there's a dev out there that wants to take over, please go for it

     

    You can find it here:

    Github  |  Dockerhub

     

    Regards,

    overbyrn

  2. The SMB share permissions are set on a global basis, not by UD device.  I can do the same thing for NFS shares.  UD was not designed to allow per device share permissions.

     

    2016.12.04

     

    Add: Ability to make NFS shares private.

     

    Awesome, thanks Dan.  That'll be a huge help.  Now, if you ever feel the desire to give UD the option to have per-device SMB and NFS share permissions, you can have my first born.  Well, no... no you can't, it's a bit late for that.  But you'll have my undying gratitude  ;) 

     

    Big overhaul to the code there though, so do understand if you don't have the time or inclination. 

     

    Thanks once again,

    overbyrn

  3. Hi Dan,

     

    Is it possible with UD as it stands to export a mount as NFS but with specific parameters, much like can be done with regular shares when exporting as NFS?  I'm guessing not, but figured I'd ask.  Admittedly it's a bit of an edge-case scenario, but would be very helpful to me at least if it was possible to tweak the NFS export parameters, rather than standard Public with read/write access.

     

    I guess also that would mean having to change NFS export from a global setting to per-mount, as I notice that /etc/exports- get's populated with all mounted devices once NFS export is set to enabled.

     

    I was going to take a look under the hood at your code and see if I could find where /etc/exports- gets written.  Before using UD, I used to have a manually created exports- at /boot/config which got auto-added to /etc/export when exportfs was called.  Is there something similar perhaps, whereby you store a copy of exports- or do you generate during plugin run only?

     

    I could go out an manually change /etc/exports- myself, but that's messy for all kinds of reasons. 

     

    Would appreciate your thoughts.

     

     

    Regards,

    overbyrn

  4. I compiled it, but zero clue if it's what you need or will help. Was built against Slackware Current, which I think is what 6.2 is based on.

     

    ./configure --prefix=/usr
    
    Configuration on Mon Aug  1 20:38:13 EDT 2016:
    
      Host:                       i686-pc-linux-gnu -- slackware Slackware 14.2
      Apcupsd version:            0.7.5 (13 June 2016)
      Source code location:       .
      Install binaries:           /sbin
      Install config files:       /etc/apcupsd
      Install man files:          ${prefix}/share/man
      Nologin file in:            /etc
      PID directory:              /var/run
      LOG dir (events, status)    /var/log
      LOCK dir (for serial port)  /var/lock
      Power Fail dir              /etc/apcupsd
      Compiler:                   g++ 5.3.0
      Preprocessor flags:          -I/usr/local/include
      Compiler flags:             -g -O2 -fno-exceptions -fno-rtti -Wall
      Linker:                     gcc
      Linker flags:                -L/usr/local/lib
      Host and version:           slackware Slackware 14.2
      Shutdown Program:           /sbin/shutdown
      Port/Device:                /dev/ttyS0
      Network Info Port (CGI):    3551
      UPSTYPE                     brazil
      UPSCABLE                    simple
    
      drivers (no-* are disabled): apcsmart dumb net no-usb snmp no-net-snmp pcnet modbus no-modbus-usb no-test brazil
    
      enable-nis:                 yes
      with-nisip:                 0.0.0.0
      enable-cgi:                 no
      with-cgi-bin:               /etc/apcupsd
      with-libwrap:
      enable-pthreads:            yes
      enable-dist-install:        yes
      enable-gapcmon:             no
      enable-apcagent:            no
    

     

     

    https://dl.dropboxusercontent.com/u/572553/apcctrl-0.7.5-x86_64-1rj.txz

     

    Send me a PM if you need to get in touch as I rarely check the forum these days.

     

     

    Regards,

    overbyrn

     

  5. I'm studiously avoiding naming the person since I don't know if there are political mines that I'm stepping around but will say I am very grateful for his initial work on creating the plugin.  Without that effort I am sure I would not have forked the copy and started maintaining it.

     

    It's okay, you can name the original person. He won't mind ;)

     

    I'm glad someone took up the mantle to make the plugins work for later unRAID versions.  Good job!

  6. No dice, still did the same thing, here's what I did:

    In the plugins page your ssh plugin offered an update (to 2015.04.25  - now shows up to date), hit update, it was successful.

    Rebooted (using GUI)

    Came back up and I can see that sshd started and was listening on 22 prior to the sshd plugin starting.

    Can you tell me if you have "sshd_config" in /boot/config/ssh ?

     

    If not, assuming you've been able to get ssh working on your chosen non standard port, can you (from command line) copy /etc/ssh/sshd_config to /boot/config/ssh and when the opportunity permits reboot your system once more to see if the non-std port will kick in without any extra steps.

     

  7. I like to put this in a bit wider discussion, inevitably at some point some package is required (though admittedly with Dockers this is less likely going to happen).

     

    We have learned from v5 that it isn't a good idea to let plugins install themselves other packages, different package versions and conflicts are the result. Thinking out loud - one approach maybe a central repository which can be used by plugins to get/install the required package(s), as opposed to a master plugin getting the packages instead. Or a combination of both - a master plugin retrieving packages from a central repository.

     

    The crux here is - who is going to maintain all of this and make sure that things stay up to date and complete ?

     

    Something outdated or incomplete, soon is doomed to be ignored and people follow their own road, that will be history repeating itself as seen with v5.

     

    Maybe I am a bit too skeptical here and the situation isn't that bad, at this point in time Dockers still need to prove they are better/easer/faster to setup and use than traditional plugins, which I hope will happen, but until then people will continue using plugins (these are still actively developped) and only switch when benefits are clear to everyone.

     

    I think the situation is far better than you think.  Look at the sheer number of available containers at this point that our community has created in < 1 year compared to how many plugins exist.  Yes, there are probably some containers that aren't up to snuff totally just yet, but most definitely are.  And for those that don't want containers, VMs are available and still a better solution than Plugins.

     

    I realize that Plugins are what brought us Dynamix to begin with, but your use case is a rare one compared to the majority of plugins that are essentially just installing 3rd party apps like Plex, Dropbox, etc.

     

    We already have enough packages to maintain on our own with the OS itself, we don't need to be maintaining even more that have nothing to do with unRAID OS.  If someone wants to carry that torch, great, we won't stop them, but it won't be Lime Technology.  The only packages we want to support are those required by the OS to support the functionality we deliver.

     

    A step in the wrong direction in my opinion. 

     

    JonP, it's very clear from this thread that you're a big proponent of Docker containers over plugins. Fair enough, that's your prerogative. Others may not wish to embrace that aspect yet and perhaps would rather stick to plugins. If you're going to do a 180 on what Limetech currently bakes into the build, then perhaps you go the whole hog and remove the plugin architecture altogether? Too strong? Probably, but it feels as though Limetech is doing an about face from what it previously recognized as an in issue in v5.

     

    I agree with Bonienl, the problem with maintaining Python and Perl outside core unRAID is the possibilities of one plugin clashing with another. If we ignore the 'use containers instead' argument for a moment, I'd like to give an example of one such case...

     

    At the point which most plugins standardized on Python 2.7, there came an issue where a number of plugins were using a build of Python widely distributed by forum member piotrasd. One the one hand this worked well as the build contained a few extras over a native python package from more traditional channels.  But the other side of the coin was that it caused headaches for other plugin authors who chose to use python packages from more regular distribution channels. Do a search for python-2.7.3-i686-5PTr.txz. You'll soon see what I mean. The piotrasd version contained python-cheetah, which would usually be a separate dependency. Easy enough to fix, but a pain all the same.

     

    I think expecting someone in the community to maintain a master plugin is the wrong way to go about it. I understand you do not wish to bloat the unRAID image and only want to bundle what is needed for unRAID to function, but a balance has to be found and currently it feels as this action is as much about engineering folks onto containers as it is anything else. 

     

  8. Hello Overbryn and thanks for some great plugins!

     

    I'm seeing a small issue with ssh2015.02.26 on 6.0-beta14b.

    I run ssh on a none standard port, but after an unraid reboot, it runs ssh on port 22 despite the config showing my none standard port.

    Even the plugin web gui page confirms my none standard port yet ssh is still bound to 22 on startup.

     

    Hitting "restart" doesn't make any difference but Stop followed by a start does cause it to bind to my preferred port.

     

    Think I've fixed this. The problem was that when unRAID comes up after a reboot, the baked in ssh automatically starts but doesn't take account of the settings in the ssh plugin. So until you go into the ssh settings page, stop and start, the settings aren't applied and made live. Thankfully Limetech were good enough to script it such that it uses a wildcard to copy all files in /boot/ssh (the baked in ssh directory on flash which holds the server keys) upon a reboot. I was able to use this to my advantage by storing a copy of the config there also. This way when unRAID reboots, it'll bring the config over during starting ssh and your settings will be live. Should save you having to go into the plugin webgui page and re-applying them.

     

    I've pushed an update to the plugin to github. You should be able to go to Plugins in the unRAID webgui, click check for update where it'll show there's an update to the ssh plugin. Update, then go into the ssh webgui setting page. Stop ssh, start ssh and that action will copy the config file also. You shouldn't need to do that again.

     

    Reboot your unRAID to test.

     

     

    Regards,

    overbyrn

     

     

  9. Added pyload plugin for v5 and v6.  This one may still be a bit buggy. Report issues here and I'll try to resolve if I can. The v6 version has a tendency for the pyload webgui to not start upon first install. If that happens, do a restart of pyload from the unRAID webgui page and that generally fixes it.  I'll look into that as and when time permits.

     

    Updated first post with links to the plugins on github.

     

  10. Great, thanks overbyrn.

     

    I've been using your older LMS plugin for some time - very successfully I might add. I am currently on Unraid v5 and have upgraded to this version successfully.

     

    I was planning to move to Unraid v6 soon, so are there any tips for upgrading the plugin or is it just a case of disabling, upgrading Unraid and then installing the new one in-place?

     

    Thanks for your work on these.

     

    ctrlbreak

    You should be okay just to remove the old lms.plg and replace with the newer v6 variant. unRAID v6 comes with Perl pre-baked, so you can also remove the perl package that'll be in /boot/packages.  I don't believe I made any changes to the way the plugin manages LMS and its config.  All the same, for safety sake I'd suggest taking a backup of /boot/config/plugins/lms and also where-ever you have your LMS installation stored.

     

     

     

  11. Done!  Anything else?

     

    I'm sure I speak for many when I say Thank You, for so much accomplished!  Life does get in the way though, doesn't it?  Happy you are still around and helping when you can!

    Thanks for your help RobJ, tis appreciated. Yep, life went from zero to 100 this past year or so. Moved to US from UK last Jun, moved from NH to WI for new job. Now a little more settled but still got lots to learn about living here. US driving road test next week, filing taxes etc. Not a lot of room for plugins, but it's my guilty pleasure and I still tinker whenever I get a chance.

     

    All the best,

    overbyrn

  12. first time trying to install OpenSSH.  wasnt able to do it by reboot the server.  So i manually type the command, and i got this error.      I'm using Openssh for UnRaid v5.  Help!!!

    Delete the ssh.plg file, re-download and try again.  There was an error in the plugin code. Fixed now.

     

    Please don't use this thread for support.  Report any further issues on this one please... http://lime-technology.com/forum/index.php?topic=39169.0

     

     

     

    Thanks,

    overbyrn

  13. the ability to choose from any/all of these:  http://beets.readthedocs.org/en/latest/plugins/index.html

     

     

    i messed around with config.yaml in past plugin iterations in order to enable additional plugins and it jacked up my install - so i'm hesitant to do it again.

    Yeah, 'fraid that's not going to happen.  Wanting all 43 existing plugins supported is pushing it.

     

    Yes the config file is picky. For instance it doesn't like tabs.  That's just how the yaml format is, nothing I can do about it.  Suggest you have a go at editing the config.yaml once again, and reach out to me if you get horribly stuck.

     

     

  14. There's quite an extensive list of Beets plugins now. Is there any way you can add in support and configuration for those? Thanks for filling the gap with these.. Dockers just don't seem like the way to go.

    The plugin currently contains the following;

    fetchart

    embedart

    convert

    scrub

    replaygain

    lastgenre

    chroma

    discogs

     

    Which plugins were you thinking of?

     

    Also, it's worth noting that if a plugin doesn't need anything extra installing, it's possible to add it in yourself. For instance, in the case of BPM, nothing new is needed to be done other than to enable it in the config.  You can do this manually by editing the config.yaml file in /boot/config/plugins/beets.  So long as you don't hack the file around, the plugin shouldn't have a problem. It will only change those entries that are exposed in the unRAID webgui settings page..  So you could simply add "bpm" to the "plugins: " line file and you'd be all set.  I'd prefer not to add anything into the webgui settings page as it's already pretty busy in there.

     

    You can check what plugins beets is configured from command line.  They'll show up under the "Commands" section;

     

    root@unraid5:~# beet --help

    Warning: top-level configuration of `color` is deprecated. Configure color use under `ui`. See documentation for more info.

    Usage:

      beet COMMAND [ARGS...]

      beet help COMMAND

     

    Options:

      --format-item=FORMAT_ITEM

                            print with custom format

      --format-album=FORMAT_ALBUM

                            print with custom format

      -l LIBRARY, --library=LIBRARY

                            library database file to use

      -d DIRECTORY, --directory=DIRECTORY

                            destination music directory

      -v, --verbose        print debugging information

      -c CONFIG, --config=CONFIG

                            path to configuration file

      -h, --help            how this help message and exit

     

    Commands:

      clearart          remove images from file metadata

      config            show or edit the user configuration

      convert          convert to external location

      embedart          embed image files into file metadata

      extractart        extract an image from file metadata

      fetchart          download album art

      fields            show fields available for queries and format strings

      fingerprint      generate fingerprints for items without them

      help (?)          give detailed help on a specific sub-command

      import (imp, im)  import new music

      lastgenre        fetch genres

      list (ls)        query the library

      modify (mod)      change metadata fields

      move (mv)        move or copy items

      remove (rm)      remove matching items from the library

      replaygain        analyze for ReplayGain

      scrub            clean audio tags

      stats            show statistics about the library or a query

      submit            submit Acoustid fingerprints

      update (upd, up)  update the library

      version          output version information

      write            write tag information to files

     

     

  15. Hello All,

     

    I wanted to create a single thread to cover plugins which I have available but that have not been re-worked by PhAzE.  He continues to do a great job in supporting many of the common plugins and I expect when time permits he will take these on also.  I do not have much time to support plugins these days and over the last 6-12 months my GitHub repo and Dropbox public storage locations have not been very well maintained.

     

    A few people have shown they still use these plugins, so I chose to update them and have all the code including package dependencies hosted on GitHub.  I did not have the time to create a single v5/v6 unified plugin, but instead there are working v5 and v6 versions of the plugins for each of the applications mentioned.

     

    I will pretty up this post when time permits, but I wanted to get it published so that I can ask one of the mods to close the other threads and as a result end some of the confusion about what is available / working.

     

    Plugin Downloads:  (Right-Click -> Save Link As)

     

    NZBGet  v5 | v6

    SSH (brings SSH to v5 and enhances the default SSH in v6 by allowing multiple users and finer access control)  v5 | v6

    Denyhosts  v5 | v6

    Dropbox  v5 | v6

    Beets  v5 | v6

    LMS v5 | v6

    pyload v5 | v6

     

    Usage (Unraid 6):

    - Navigate to the Plugins tab on the Unraid interface

    - Click the 'install plugin' sub tab

    - Either paste the LINK or navigate to the .PLG file and press install

    - Go to the Unraid Settings page, click on the app icon, setup the way you want, and hit apply.

     

    Usage (Unraid 5):

    - Place .PLG file in /config/plugins/ folder on your USB stick

    - Reboot OR run installplg /boot/config/plugins/pluginname.plg from prompt on the server

    - Go to the Unraid Settings page, click on the app icon, setup the way you want, and hit apply.

     

     

     

     

    Regards,

    overbyrn

  16.  

    I have been working on ssh and denyhosts in the background to create working v5 and v6 plugins which I felt comfortable sharing. The link above is correct and points to what I believe is a working stable v6 version of my ssh plugin. There is also an equivalent v5 version here

     

    I plan to open a new thread which consolidates those plugins I still have and that have not (yet) been reworked by Phaze. So far SSH, Denyhosts, Dropbox, Beets and NZBGet are all complete for v5 and v6. 

     

    For the moment, if you need a v5 of any of the above go here, and for v6, go here