[Support] binhex - NZBGet


Recommended Posts

@binhex I've been seeing more than usual of the unrar hanging lately, so I thought I'd try to get to the bottom of it again.

Unfortunatly, I wasn't able to.

But just in case it gives you any new ideas, here's what I found.

  • When a file is stuck in unpacking, the docker console shows an unrar process running for a few seconds, then re-spawning with a new PID. This never ends. During this statem, Sys load in TOP is consistently high (4+) and so is CPU usage for both nzbget and unrar.
  • If I kill the main nzbget process, it restart itself and spawns a new unrar process that finishes quickly. This is consistent with the docker restart workaround.
  • I didn't test running the exact same unrar command outside of the docker, but will next time the unpacking hangs.
  • It seems SAB had a similar issue when using Direct Unpack, https://forums.sabnzbd.org/viewtopic.php?p=117607#p117607
    I
    t quickly got above my skill level, but I don't think they got to the bottom of it either, if it is the same underlying problem...

 

sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25776 ?        S    16:17   0:00 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3736 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 87.2  0.4 4137240 69104 ?       Sl   16:17  17:31 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1248 11.2  0.0  10976  5212 ?        Rs   16:37   0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1251  0.0  0.0  10240  3308 pts/0    R+   16:37   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25588 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3732 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 94.0  0.6 4137240 108424 ?      Sl   16:17  39:20 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1630  1.0  0.0   9944  4056 ?        Ss   16:59   0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1632  0.0  0.0  10240  3384 pts/0    R+   16:59   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25588 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3732 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 94.1  0.6 4137240 108424 ?      Sl   16:17  39:34 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1633 55.5  0.0  10976  5172 ?        Rs   16:59   0:03 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1638  0.0  0.0  10240  3484 pts/0    R+   16:59   0:00 ps aux


sh-5.1# kill -9 61


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25592 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1719  0.5  0.0   7336  3780 ?        S    17:04   0:00 /bin/bash /home/nobody/start.sh
nobody    1722 21.2  0.1 3278280 20192 ?       Sl   17:04   0:00 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
nobody    1771 68.2  0.0  10956  5260 ?        Rs   17:04   0:02 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1777  0.0  0.0  10240  3464 pts/0    R+   17:04   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25592 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1719  0.0  0.0   7336  3780 ?        S    17:04   0:00 /bin/bash /home/nobody/start.sh
nobody    1722 23.2  0.3 4102664 49804 ?       Sl   17:04   0:05 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root      1880  0.0  0.0  10240  3308 pts/0    R+   17:04   0:00 ps aux

 

Link to comment

Got another hang. Strangely, this command does not work outside the docker (from within the movies subfolder inside the "inter" directory of nzbget appdata)
 

# unrar x -y -p- -o+ *.rar
UNRAR 5.80 freeware      Copyright (c) 1993-2019 Alexander Roshal
Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar
Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar
...
Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar
No files to extract

 

While this works without problems:
 

# unrar x -y -p- -o+ 22397053c75341bca318684f2bb5b77f.part01.rar 
UNRAR 5.80 freeware      Copyright (c) 1993-2019 Alexander Roshal
Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar
Extracting  22397053c75341bca318684f2bb5b77f.mkv                       1%
Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar
...         22397053c75341bca318684f2bb5b77f.mkv                       3%
...
Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar
...         22397053c75341bca318684f2bb5b77f.mkv                      OK 
All OK

 

Either way, I don't think it's the command that is wrong, and the archive unpacks correctly so it's not a corrupted file.

The container unrar version is slightly older (5.60 beta 3 freeware) but I don't think that would be it either?

 

So I guess we're back to "don't know what's going on here".

Link to comment
  • 1 month later...
  • 1 month later...

Hi binhex,

 

I'm having SSL errors due to the recent  lets encrypt root certificate expiration. I am trying to figure out how to update the cert as laid out in the top comment on this thread, but haven't been able to figure out how to do it. Where is the cert saved on unraid?

 

  • Like 1
Link to comment
On 10/1/2021 at 1:52 PM, MacRips said:

Hi binhex,

 

I'm having SSL errors due to the recent  lets encrypt root certificate expiration. I am trying to figure out how to update the cert as laid out in the top comment on this thread, but haven't been able to figure out how to do it. Where is the cert saved on unraid?

 

use this

 

find . -name "cacert.pem"

 

it should be under /usr/local/bin/nzbget/

  • Like 1
Link to comment

Hey guys,

 

Currently and recently I am getting the following errors while trying to download through NZBGet:

TLS certificate verification failed for news.newshosting.com: certificate has expired. For more info visit http://nzbget.net/certificate-verification

 

Is this because of the above letsencrypt expiration? I would love to know how to renew or get the new cert?

I am also up to date on both dockers.

 

TIA

 

***EDIT*** 

 

I was able to fix my issue.  You can workaround by just downloading the cacert.pem file directly into whatever folder you have mapped to the docker's /data pathway. Make sure the NZBGet's Certstore path is the same location and all works fine.

Edited by lync
fixed my issue.
Link to comment
  • 2 weeks later...
On 10/14/2021 at 12:11 AM, azndjay said:

anyone else having trouble trying update from the gui for 21.1 when prompt for update?

I keep getting this error inside NZBget:

"

Executing update-script /usr/bin/nzbget_bin/install-update.sh

Downloading version information...

Download failed, please try again later

"

I got this to work by running installing it manual mode from:

https://nzbget.net/installation-on-linux

 

I was able to update through GUI after as well.

Link to comment
  • 1 month later...
For anyone experiencing issues with Nzbget hanging whilst unpacking, the blow fixed it for me;
 
Screenshot_20211127-210153_Brave.thumb.jpg.80a6a25b697b4111ccaa2acbb2dcef02.jpg
Thanks for posting this this is very interesting as it has been a long-standing issue. Can anybody still seeing this issue please try the above fix if it works then I can include a sed to change the umask for nzbget

Sent from my CLT-L09 using Tapatalk

  • Thanks 1
Link to comment
On 10/12/2021 at 8:17 PM, toolmanz said:

I just went into the "Paths" setting and changed certstore location to my data directory .... copied the .pem to data and it works. 

 

Easy peasy....

I tried to set the path like you did but I keep getting the file does not exist.  I have put the cacert.pem file in /downloads, /downloads/certs, /appdata/binhex-nzbget, and other locations and cannot get this to work.  Any help would be appreciated.

Link to comment

Hi, I have certification errors with my usenet-server:

 

"TLS certificate verification failed for usenet.premium.to: certificate has expired. For more info visit http://nzbget.net/certificate-verification“

 

The support of my provider said i should replace the "cacert.pem" file. But there is no in my appdata folder. Can i do this somehow?

Or can I turn off the cert-check? (not prefered)

 

best wishes

Link to comment
On 11/28/2021 at 2:19 AM, binhex said:

Thanks for posting this this is very interesting as it has been a long-standing issue. Can anybody still seeing this issue please try the above fix if it works then I can include a sed to change the umask for nzbget

Sent from my CLT-L09 using Tapatalk
 

This is exactly how I have had my NZBGet setup and it always hangs on the unpacking step. Seems to mostly do it with multiple downloads at a time rather than just single downloads. Single episodes of a show at a time seem to generally do fine but if an entire season of something queues up all at once it seems more likely to hang. The only thing that seems to fix it for me is to just keep restarting the container over and over and over again until they all finally unpack. Would be nice not to have to constantly check it though.

Link to comment
9 hours ago, Randomsteve said:
This is exactly how I have had my NZBGet setup and it always hangs on the unpacking step. Seems to mostly do it with multiple downloads at a time rather than just single downloads. Single episodes of a show at a time seem to generally do fine but if an entire season of something queues up all at once it seems more likely to hang. The only thing that seems to fix it for me is to just keep restarting the container over and over and over again until they all finally unpack. Would be nice not to have to constantly check it though.

Sorry so just to be clear, you have umask set in nzbget web ui to 000 (not container env var) and it still hangs on unpack?

Sent from my CLT-L09 using Tapatalk
 

Link to comment
3 hours ago, binhex said:

Sorry so just to be clear, you have umask set in nzbget web ui to 000 (not container env var) and it still hangs on unpack?

Not who you were talking to, but yes, it's still hanging for me. I was so hopeful we had a solution, and at first it seemed to make a difference, but it turned out to be confirmation bias, I've had to clear hangs at least half a dozen times since making the change.

Link to comment
1 minute ago, JonathanM said:

Not who you were talking to, but yes, it's still hanging for me. I was so hopeful we had a solution, and at first it seemed to make a difference, but it turned out to be confirmation bias, I've had to clear hangs at least half a dozen times since making the change.

hmm right 😞 

Link to comment
  • 2 weeks later...

000 Umask didn't work for me either. I just installed not too long ago binhex Sonarr and Nzbget. I thought it was configuration problem at first before I skimmed through this thread.

My NZBGet currently is downloaded to main cache drive (/mnt/user/appdata/data) and Sonarr moves it to (/mnt/user/appdata/media/series) array. It seems un-archiving task keeps looping, it restarts after un-archiving. When restarting container, it's finishes fine. Will probably move over to SabNzbd if other nzbget containers does the same.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.