Jorgen Posted July 4, 2021 Share Posted July 4, 2021 @binhex I've been seeing more than usual of the unrar hanging lately, so I thought I'd try to get to the bottom of it again. Unfortunatly, I wasn't able to. But just in case it gives you any new ideas, here's what I found. When a file is stuck in unpacking, the docker console shows an unrar process running for a few seconds, then re-spawning with a new PID. This never ends. During this statem, Sys load in TOP is consistently high (4+) and so is CPU usage for both nzbget and unrar. If I kill the main nzbget process, it restart itself and spawns a new unrar process that finishes quickly. This is consistent with the docker restart workaround. I didn't test running the exact same unrar command outside of the docker, but will next time the unpacking hangs. It seems SAB had a similar issue when using Direct Unpack, https://forums.sabnzbd.org/viewtopic.php?p=117607#p117607 It quickly got above my skill level, but I don't think they got to the bottom of it either, if it is the same underlying problem... sh-5.1# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2368 700 ? Ss 16:17 0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh root 6 0.0 0.1 31668 25776 ? S 16:17 0:00 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n nobody 56 0.0 0.0 7336 3736 ? S 16:17 0:00 /bin/bash /home/nobody/start.sh root 57 0.0 0.0 7336 3532 ? S 16:17 0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget root 59 0.0 0.0 5356 692 ? S 16:17 0:00 sleep infinity nobody 61 87.2 0.4 4137240 69104 ? Sl 16:17 17:31 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s root 996 0.0 0.0 7600 4392 pts/0 Ss 16:23 0:00 sh nobody 1248 11.2 0.0 10976 5212 ? Rs 16:37 0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/ root 1251 0.0 0.0 10240 3308 pts/0 R+ 16:37 0:00 ps aux sh-5.1# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2368 700 ? Ss 16:17 0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh root 6 0.0 0.1 31668 25588 ? S 16:17 0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n nobody 56 0.0 0.0 7336 3732 ? S 16:17 0:00 /bin/bash /home/nobody/start.sh root 57 0.0 0.0 7336 3532 ? S 16:17 0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget root 59 0.0 0.0 5356 692 ? S 16:17 0:00 sleep infinity nobody 61 94.0 0.6 4137240 108424 ? Sl 16:17 39:20 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s root 996 0.0 0.0 7600 4392 pts/0 Ss 16:23 0:00 sh nobody 1630 1.0 0.0 9944 4056 ? Ss 16:59 0:00 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/ root 1632 0.0 0.0 10240 3384 pts/0 R+ 16:59 0:00 ps aux sh-5.1# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2368 700 ? Ss 16:17 0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh root 6 0.0 0.1 31668 25588 ? S 16:17 0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n nobody 56 0.0 0.0 7336 3732 ? S 16:17 0:00 /bin/bash /home/nobody/start.sh root 57 0.0 0.0 7336 3532 ? S 16:17 0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget root 59 0.0 0.0 5356 692 ? S 16:17 0:00 sleep infinity nobody 61 94.1 0.6 4137240 108424 ? Sl 16:17 39:34 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s root 996 0.0 0.0 7600 4392 pts/0 Ss 16:23 0:00 sh nobody 1633 55.5 0.0 10976 5172 ? Rs 16:59 0:03 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/ root 1638 0.0 0.0 10240 3484 pts/0 R+ 16:59 0:00 ps aux sh-5.1# kill -9 61 sh-5.1# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2368 700 ? Ss 16:17 0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh root 6 0.0 0.1 31668 25592 ? S 16:17 0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n root 57 0.0 0.0 7336 3532 ? S 16:17 0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget root 59 0.0 0.0 5356 692 ? S 16:17 0:00 sleep infinity root 996 0.0 0.0 7600 4392 pts/0 Ss 16:23 0:00 sh nobody 1719 0.5 0.0 7336 3780 ? S 17:04 0:00 /bin/bash /home/nobody/start.sh nobody 1722 21.2 0.1 3278280 20192 ? Sl 17:04 0:00 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s nobody 1771 68.2 0.0 10956 5260 ? Rs 17:04 0:02 /usr/bin/unrar x -y -p- -o+ *.rar /downloads/nzbget/tv/Marcella.S01E06.720p.HDTV.x264/_unpack/ root 1777 0.0 0.0 10240 3464 pts/0 R+ 17:04 0:00 ps aux sh-5.1# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2368 700 ? Ss 16:17 0:00 /usr/bin/tini -g -- /bin/bash /usr/local/bin/init.sh root 6 0.0 0.1 31668 25592 ? S 16:17 0:01 /usr/bin/python /usr/bin/supervisord -c /etc/supervisor.conf -n root 57 0.0 0.0 7336 3532 ? S 16:17 0:00 /bin/bash /usr/local/bin/shutdown.sh nzbget root 59 0.0 0.0 5356 692 ? S 16:17 0:00 sleep infinity root 996 0.0 0.0 7600 4392 pts/0 Ss 16:23 0:00 sh nobody 1719 0.0 0.0 7336 3780 ? S 17:04 0:00 /bin/bash /home/nobody/start.sh nobody 1722 23.2 0.3 4102664 49804 ? Sl 17:04 0:05 /usr/local/bin/nzbget/nzbget --option UnrarCmd=/usr/bin/unrar -c /config/nzbget.conf -s root 1880 0.0 0.0 10240 3308 pts/0 R+ 17:04 0:00 ps aux Quote Link to comment
Jorgen Posted July 4, 2021 Share Posted July 4, 2021 Got another hang. Strangely, this command does not work outside the docker (from within the movies subfolder inside the "inter" directory of nzbget appdata) # unrar x -y -p- -o+ *.rar UNRAR 5.80 freeware Copyright (c) 1993-2019 Alexander Roshal Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar ... Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar No files to extract While this works without problems: # unrar x -y -p- -o+ 22397053c75341bca318684f2bb5b77f.part01.rar UNRAR 5.80 freeware Copyright (c) 1993-2019 Alexander Roshal Extracting from 22397053c75341bca318684f2bb5b77f.part01.rar Extracting 22397053c75341bca318684f2bb5b77f.mkv 1% Extracting from 22397053c75341bca318684f2bb5b77f.part02.rar ... 22397053c75341bca318684f2bb5b77f.mkv 3% ... Extracting from 22397053c75341bca318684f2bb5b77f.part63.rar ... 22397053c75341bca318684f2bb5b77f.mkv OK All OK Either way, I don't think it's the command that is wrong, and the archive unpacks correctly so it's not a corrupted file. The container unrar version is slightly older (5.60 beta 3 freeware) but I don't think that would be it either? So I guess we're back to "don't know what's going on here". Quote Link to comment
morreale Posted August 13, 2021 Share Posted August 13, 2021 Having the same hanging issues during unpacking. The container has worked for years properly. what can I provide to assist with troubleshooting? Quote Link to comment
ajgriglak Posted August 13, 2021 Share Posted August 13, 2021 Not sure this will ever get fixed... It's been like this for at least a year if not much longer. Easy fix is to just restart the container hourly. That's what I do, and haven't had to think about it since then. Quote Link to comment
morreale Posted August 20, 2021 Share Posted August 20, 2021 converted to the LSIO container for now. seems to be working correctly Quote Link to comment
MacRips Posted October 1, 2021 Share Posted October 1, 2021 Hi binhex, I'm having SSL errors due to the recent lets encrypt root certificate expiration. I am trying to figure out how to update the cert as laid out in the top comment on this thread, but haven't been able to figure out how to do it. Where is the cert saved on unraid? 1 Quote Link to comment
Megalodon170 Posted October 3, 2021 Share Posted October 3, 2021 On 10/1/2021 at 1:52 PM, MacRips said: Hi binhex, I'm having SSL errors due to the recent lets encrypt root certificate expiration. I am trying to figure out how to update the cert as laid out in the top comment on this thread, but haven't been able to figure out how to do it. Where is the cert saved on unraid? use this find . -name "cacert.pem" it should be under /usr/local/bin/nzbget/ 1 Quote Link to comment
Alkapwn Posted October 6, 2021 Share Posted October 6, 2021 On 10/3/2021 at 3:42 PM, Megalodon170 said: use this find . -name "cacert.pem" it should be under /usr/local/bin/nzbget/ I'm having no luck locating that file. nzbget says it's in ${AppDir}/cacert.pem but I also can't find where that is either. Quote Link to comment
azndjay Posted October 7, 2021 Share Posted October 7, 2021 On 10/5/2021 at 10:32 PM, Alkapwn said: I'm having no luck locating that file. nzbget says it's in ${AppDir}/cacert.pem but I also can't find where that is either. Try: Click on Console for NZBGet cd /sbin/nzbget_bin/ rm cacert.pem && wget https://nzbget.net/info/cacert.pem cacert.pem ----------- The new update should fix this also. 1 Quote Link to comment
Alkapwn Posted October 7, 2021 Share Posted October 7, 2021 36 minutes ago, azndjay said: Try: Click on Console for NZBGet cd /sbin/nzbget_bin/ rm cacert.pem && wget https://nzbget.net/info/cacert.pem cacert.pem ----------- The new update should fix this also. Weird. It says there's no such file or directory and that my app is up to date also. Quote Link to comment
lync Posted October 7, 2021 Share Posted October 7, 2021 (edited) Hey guys, Currently and recently I am getting the following errors while trying to download through NZBGet: TLS certificate verification failed for news.newshosting.com: certificate has expired. For more info visit http://nzbget.net/certificate-verification Is this because of the above letsencrypt expiration? I would love to know how to renew or get the new cert? I am also up to date on both dockers. TIA ***EDIT*** I was able to fix my issue. You can workaround by just downloading the cacert.pem file directly into whatever folder you have mapped to the docker's /data pathway. Make sure the NZBGet's Certstore path is the same location and all works fine. Edited October 8, 2021 by lync fixed my issue. Quote Link to comment
azndjay Posted October 9, 2021 Share Posted October 9, 2021 On 10/7/2021 at 12:15 AM, Alkapwn said: Weird. It says there's no such file or directory and that my app is up to date also. I would check to see where your cacert.pem file is located. Quote Link to comment
Twixii Posted October 11, 2021 Share Posted October 11, 2021 Simple fix for anyone still searching, open console via unraid web-gui, paste the following: cd /usr/local/bin/nzbget/nzbget && curl https://curl.se/ca/cacert.pem > cacert.pem 2 Quote Link to comment
toolmanz Posted October 13, 2021 Share Posted October 13, 2021 I just went into the "Paths" setting and changed certstore location to my data directory .... copied the .pem to data and it works. Easy peasy.... Quote Link to comment
azndjay Posted October 14, 2021 Share Posted October 14, 2021 anyone else having trouble trying update from the gui for 21.1 when prompt for update? I keep getting this error inside NZBget: " Executing update-script /usr/bin/nzbget_bin/install-update.sh Downloading version information... Download failed, please try again later " Quote Link to comment
azndjay Posted October 24, 2021 Share Posted October 24, 2021 On 10/14/2021 at 12:11 AM, azndjay said: anyone else having trouble trying update from the gui for 21.1 when prompt for update? I keep getting this error inside NZBget: " Executing update-script /usr/bin/nzbget_bin/install-update.sh Downloading version information... Download failed, please try again later " I got this to work by running installing it manual mode from: https://nzbget.net/installation-on-linux I was able to update through GUI after as well. Quote Link to comment
ytddewqf Posted November 27, 2021 Share Posted November 27, 2021 (edited) For anyone experiencing issues with Nzbget hanging whilst unpacking, the below fixed it for me; ***Full credit goes to @MagicSG1, found a post of his on reddit. Edited November 28, 2021 by BeardedNoir 1 Quote Link to comment
binhex Posted November 28, 2021 Author Share Posted November 28, 2021 For anyone experiencing issues with Nzbget hanging whilst unpacking, the blow fixed it for me; Thanks for posting this this is very interesting as it has been a long-standing issue. Can anybody still seeing this issue please try the above fix if it works then I can include a sed to change the umask for nzbgetSent from my CLT-L09 using Tapatalk 1 Quote Link to comment
zombie Posted November 28, 2021 Share Posted November 28, 2021 On 10/12/2021 at 8:17 PM, toolmanz said: I just went into the "Paths" setting and changed certstore location to my data directory .... copied the .pem to data and it works. Easy peasy.... I tried to set the path like you did but I keep getting the file does not exist. I have put the cacert.pem file in /downloads, /downloads/certs, /appdata/binhex-nzbget, and other locations and cannot get this to work. Any help would be appreciated. Quote Link to comment
Greyberry Posted November 29, 2021 Share Posted November 29, 2021 Hi, I have certification errors with my usenet-server: "TLS certificate verification failed for usenet.premium.to: certificate has expired. For more info visit http://nzbget.net/certificate-verification“ The support of my provider said i should replace the "cacert.pem" file. But there is no in my appdata folder. Can i do this somehow? Or can I turn off the cert-check? (not prefered) best wishes Quote Link to comment
Randomsteve Posted December 2, 2021 Share Posted December 2, 2021 On 11/28/2021 at 2:19 AM, binhex said: Thanks for posting this this is very interesting as it has been a long-standing issue. Can anybody still seeing this issue please try the above fix if it works then I can include a sed to change the umask for nzbget Sent from my CLT-L09 using Tapatalk This is exactly how I have had my NZBGet setup and it always hangs on the unpacking step. Seems to mostly do it with multiple downloads at a time rather than just single downloads. Single episodes of a show at a time seem to generally do fine but if an entire season of something queues up all at once it seems more likely to hang. The only thing that seems to fix it for me is to just keep restarting the container over and over and over again until they all finally unpack. Would be nice not to have to constantly check it though. Quote Link to comment
binhex Posted December 2, 2021 Author Share Posted December 2, 2021 9 hours ago, Randomsteve said: This is exactly how I have had my NZBGet setup and it always hangs on the unpacking step. Seems to mostly do it with multiple downloads at a time rather than just single downloads. Single episodes of a show at a time seem to generally do fine but if an entire season of something queues up all at once it seems more likely to hang. The only thing that seems to fix it for me is to just keep restarting the container over and over and over again until they all finally unpack. Would be nice not to have to constantly check it though. Sorry so just to be clear, you have umask set in nzbget web ui to 000 (not container env var) and it still hangs on unpack? Sent from my CLT-L09 using Tapatalk Quote Link to comment
JonathanM Posted December 2, 2021 Share Posted December 2, 2021 3 hours ago, binhex said: Sorry so just to be clear, you have umask set in nzbget web ui to 000 (not container env var) and it still hangs on unpack? Not who you were talking to, but yes, it's still hanging for me. I was so hopeful we had a solution, and at first it seemed to make a difference, but it turned out to be confirmation bias, I've had to clear hangs at least half a dozen times since making the change. Quote Link to comment
binhex Posted December 2, 2021 Author Share Posted December 2, 2021 1 minute ago, JonathanM said: Not who you were talking to, but yes, it's still hanging for me. I was so hopeful we had a solution, and at first it seemed to make a difference, but it turned out to be confirmation bias, I've had to clear hangs at least half a dozen times since making the change. hmm right 😞 Quote Link to comment
cxiec Posted December 17, 2021 Share Posted December 17, 2021 000 Umask didn't work for me either. I just installed not too long ago binhex Sonarr and Nzbget. I thought it was configuration problem at first before I skimmed through this thread. My NZBGet currently is downloaded to main cache drive (/mnt/user/appdata/data) and Sonarr moves it to (/mnt/user/appdata/media/series) array. It seems un-archiving task keeps looping, it restarts after un-archiving. When restarting container, it's finishes fine. Will probably move over to SabNzbd if other nzbget containers does the same. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.