[Support] binhex - NZBGet


Recommended Posts

@binhex I've been seeing more than usual of the unrar hanging lately, so I thought I'd try to get to the bottom of it again.

Unfortunatly, I wasn't able to.

But just in case it gives you any new ideas, here's what I found.

  • When a file is stuck in unpacking, the docker console shows an unrar process running for a few seconds, then re-spawning with a new PID. This never ends. During this statem, Sys load in TOP is consistently high (4+) and so is CPU usage for both nzbget and unrar.
  • If I kill the main nzbget process, it restart itself and spawns a new unrar process that finishes quickly. This is consistent with the docker restart workaround.
  • I didn't test running the exact same unrar command outside of the docker, but will next time the unpacking hangs.
  • It seems SAB had a similar issue when using Direct Unpack, https://forums.sabnzbd.org/viewtopic.php?p=117607#p117607
    I
    t quickly got above my skill level, but I don't think they got to the bottom of it either, if it is the same underlying problem...

 

sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25776 ?        S    16:17   0:00 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3736 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 87.2  0.4 4137240 69104 ?       Sl   16:17  17:31 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1248 11.2  0.0  10976  5212 ?        Rs   16:37   0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1251  0.0  0.0  10240  3308 pts/0    R+   16:37   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25588 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3732 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 94.0  0.6 4137240 108424 ?      Sl   16:17  39:20 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1630  1.0  0.0   9944  4056 ?        Ss   16:59   0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1632  0.0  0.0  10240  3384 pts/0    R+   16:59   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25588 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
nobody      56  0.0  0.0   7336  3732 ?        S    16:17   0:00 /bin/bash /home/nobody/start.sh
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
nobody      61 94.1  0.6 4137240 108424 ?      Sl   16:17  39:34 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1633 55.5  0.0  10976  5172 ?        Rs   16:59   0:03 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1638  0.0  0.0  10240  3484 pts/0    R+   16:59   0:00 ps aux


sh-5.1# kill -9 61


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25592 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1719  0.5  0.0   7336  3780 ?        S    17:04   0:00 /bin/bash /home/nobody/start.sh
nobody    1722 21.2  0.1 3278280 20192 ?       Sl   17:04   0:00 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
nobody    1771 68.2  0.0  10956  5260 ?        Rs   17:04   0:02 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/
root      1777  0.0  0.0  10240  3464 pts/0    R+   17:04   0:00 ps aux


sh-5.1# ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0   2368   700 ?        Ss   16:17   0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh
root         6  0.0  0.1  31668 25592 ?        S    16:17   0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n
root        57  0.0  0.0   7336  3532 ?        S    16:17   0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget
root        59  0.0  0.0   5356   692 ?        S    16:17   0:00 sleep infinity
root       996  0.0  0.0   7600  4392 pts/0    Ss   16:23   0:00 sh
nobody    1719  0.0  0.0   7336  3780 ?        S    17:04   0:00 /bin/bash /home/nobody/start.sh
nobody    1722 23.2  0.3 4102664 49804 ?       Sl   17:04   0:05 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s
root      1880  0.0  0.0  10240  3308 pts/0    R+   17:04   0:00 ps aux

 

Link to comment

Got another hang. Strangely, this command does not work outside the docker (from within the movies subfolder inside the "inter" directory of nzbget appdata)
 

# unrar x -y -p- -o+ *.rar
UNRAR 5.80 freeware      Copyright (c) 1993-2019 Alexander Roshal
Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar
Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar
...
Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar
No files to extract

 

While this works without problems:
 

# unrar x -y -p- -o+ 22397053c75341bca318684f2bb5b77f.part01.rar 
UNRAR 5.80 freeware      Copyright (c) 1993-2019 Alexander Roshal
Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar
Extracting  22397053c75341bca318684f2bb5b77f.mkv                       1%
Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar
...         22397053c75341bca318684f2bb5b77f.mkv                       3%
...
Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar
...         22397053c75341bca318684f2bb5b77f.mkv                      OK 
All OK

 

Either way, I don't think it's the command that is wrong, and the archive unpacks correctly so it's not a corrupted file.

The container unrar version is slightly older (5.60 beta 3 freeware) but I don't think that would be it either?

 

So I guess we're back to "don't know what's going on here".

Link to comment
  • 1 month later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.