December 20, 201213 yr All, I've made more improvements to the cron script, and fixed an issue with running the opt tools properly every N hours. I'll be testing it for a bit on my server and making sure that the timed opt's run..then I'll put a new version up. Any news on the improved script Tybio? I just donated and will be upgrading my classic version, and would love to give your new and improved script a try Cheers, Zenshi.
December 21, 201213 yr Any news on the improved script Tybio? I just donated and will be upgrading my classic version, and would love to give your new and improved script a try Cheers, Zenshi. Whopse, sorry about that! I'm on the road so I haven't been checking in. I've been running it for the past week without issue, the timed optimization works perfectly, as does the import. I've attached the updated version, it does more sanity checking and I've added a End line that shows when the cron job finishes and tells you how long it took. I started calling it with this cron line: */5 * * * * /mnt/cache/AppData/Newznab/misc/update_scripts/nix_scripts/cron_newznab_process.sh -qi It checks for a lock file, so this will run the script very frequently...but while I'm importing I needed that. If you aren't importing you can likely change the 5 to 10 and remove the i flag. cron_newznab_process.sh.zip
December 21, 201213 yr Tybio... Does running the backfill process or importing nzb's manually present any problems when using this cron job?
December 21, 201213 yr How can I install the plugin if I don't user a cache drive? Since the plugin is set to install in /mnt/cache/.... this plugin don't work for me. I need my install to go towards /mnt/disk#
December 21, 201213 yr How can I install the plugin if I don't user a cache drive? Since the plugin is set to install in /mnt/cache/.... this plugin don't work for me. I need my install to go towards /mnt/disk# If you don't have a cache drive, or a drive not in the array I probably wouldn't run this plugin. For it to be worth something, you need it running quite a bit, and with the amount of db writes it does its going to keep your entire server spun up.. my 2 cents
December 21, 201213 yr How can I install the plugin if I don't user a cache drive? Since the plugin is set to install in /mnt/cache/.... this plugin don't work for me. I need my install to go towards /mnt/disk# Well, I made a share called "Applications" set to cache only and used that, ie /mnt/Applications/newznab. Missing the cache you could just assign the share to a single disk, ie set include to diskx where x = disk number you want to use. Know that the disk and parity will always be spinning. If you want to use another drive outside the array then read about the mount any drive plugin and figure out how to mount a drive.
December 21, 201213 yr How can I install the plugin if I don't user a cache drive? Since the plugin is set to install in /mnt/cache/.... this plugin don't work for me. I need my install to go towards /mnt/disk# Well, I made a share called "Applications" set to cache only and used that, ie /mnt/Applications/newznab. Missing the cache you could just assign the share to a single disk, ie set include to diskx where x = disk number you want to use. Know that the disk and parity will always be spinning. If you want to use another drive outside the array then read about the mount any drive plugin and figure out how to mount a drive. thats fine with me, I have another server which has my sbnzb/couchpotato/sickbeard/plex media server. Its quit busy all the time and i have no issues. the performance loss i loose by not having the cache is minimal. Moving 40+ gigs a night onto the raid only to have to read from it anyway later when you want to watch something doesn't really matter. But you know what you just gave me an idea, this server im building is for newznab only. In reality i don't need an array I can just have the 1 disk i have at this time set as the cache. My whole purpose is to check out newzab and see if its feasibly to index myself instead of requiring a index site. I can worry about arrays if i need to protect the database in the future. I went unraid instead of ubunu is because the footprint on the OS is smaller, and i can run it on a piece of crap that don't have much memory. (for testing)
December 21, 201213 yr Tybio... Does running the backfill process or importing nzb's manually present any problems when using this cron job? I asked that question on the IRC channel when I had a quiet minute of BB's time. there is no protection from conflicting DB updates in Newznab code...so it is ALWAYS a risk to do two things at once. Sometimes they will never intersect...but the stand of the devs is "Unsupported and could break things". So I'm going to go with that answer here. To speed things up, I changed nzb-importmodified.php to do 2000 nzbs a run, so I only get an update of headers every 30-45 minutes...but that's acceptable to ME while doing the big import. Having to start importing again with a new DB isn't worth trying to hurry things along too much...again, to me.
December 21, 201213 yr Tybio... Does running the backfill process or importing nzb's manually present any problems when using this cron job? I asked that question on the IRC channel when I had a quiet minute of BB's time. there is no protection from conflicting DB updates in Newznab code...so it is ALWAYS a risk to do two things at once. Sometimes they will never intersect...but the stand of the devs is "Unsupported and could break things". So I'm going to go with that answer here. To speed things up, I changed nzb-importmodified.php to do 2000 nzbs a run, so I only get an update of headers every 30-45 minutes...but that's acceptable to ME while doing the big import. Having to start importing again with a new DB isn't worth trying to hurry things along too much...again, to me. Are you talking importing from nzb's from a folder?
December 21, 201213 yr Are you talking importing from nzb's from a folder? I'm importing from a folder right now...but the warning about having more than one process updating the DB at a time holds for everything. I'm not sure how "real" it is, or if they just don't want to be responsible should it blow up...but honestly, with how long it takes to build the DB...doing things in order so there is no chance of jacking things up makes a lot of sense to me.
December 21, 201213 yr Still no go for me with this plugin. I attempted to start services on their own from mysql and simplefeatures and this is what i get Starting MySQL.. ERROR! the server quit without updating PID file (/var/lib/mysql/NewsNab.pid). and simple features just says can't set home directory. Blah, I guess i have to stop trying to use this plugin and just install each piece manually and pray.
December 21, 201213 yr By the way, if you are trying to see how your server is doing with all the processing that Newznab causes...might want to install this upgraded version of 'top': http://pkgs.org/slackware-13.1/slacky-i486/htop-0.8.3-i486-3sl.txz/download/ Just be sure your Term is set properly: export TERM=linux Or whatever works for your client.
December 22, 201213 yr Tybio, I set your script in root crontab like this: */10 * * * * /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q and I get this everytime: Dec 22 00:10:01 Cell crond[1113]: exit status 127 from user root /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q If I try to run the script manually, it runs. Do I need to edit anything else? Thanks for your help, Zenshi.
December 22, 201213 yr Oh, it is being called directly so it needs to be "X" chmod 744 /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh If that doesn't work, try this to test: */10 * * * * /usr/bin/bash /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q
December 22, 201213 yr Oh, it is being called directly so it needs to be "X" chmod 744 /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh If that doesn't work, try this to test: */10 * * * * /usr/bin/bash /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q I already had added x to the script, that's why I could run in manually. Even with the /usr/bin/bash added to the crontab, it still gives me the same error Dec 22 01:50:01 Cell crond[1113]: exit status 127 from user root /usr/bin/bash /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q Dec 22 01:50:01 Cell crond[14519]: unable to exec /usr/sbin/sendmail: cron output for user root /usr/bin/bash /mnt/cache/.apps/web/misc/update_scripts/nix_scripts/cron_newsnab_process.sh -q to /dev/null I even restarted the server and no dice, cron still can't run the script
December 22, 201213 yr Strange, the only other difference I see is that you use a hidden directory in your path...but that shouldn't be a problem...at least as far as I know. Remove the -q and watch the syslog..lets see what's going on.
December 22, 201213 yr Strange, the only other difference I see is that you use a hidden directory in your path...but that shouldn't be a problem...at least as far as I know. Remove the -q and watch the syslog..lets see what's going on. Oh man, I feel so stupid... cron_newsnab_process-sh != cron_newznab_process.sh Sorry for wasting your time Tybio, it's working perfectly, thanks for the script!!!
December 22, 201213 yr Well, that would do it! By the way, if you want Newznab to try to update the release names for /some/ of those all-number releases, add the -p flag.
December 22, 201213 yr I started a new thread for Newznab Themes. I did not like the default themes, so I made one closer to what I like. Decided to share what I had so far. Hoping some others will get inspired & create some more (I love options). If anyone is really good with graphics, but can't do the css... just post the image in the new thread.
December 22, 201213 yr Hey Influencer, I've sorted out how to get sphinx up and running on unRAID. I'd like to work with you to get a checkbox to "install sphinx and dependencies", would you be willing to help me out? I can offer to do the updates to the plg file if you would be willing to act as a mentor .
December 22, 201213 yr Hi, All plugin have been straight forward to install , but this one .... hmm is very bad and difficult. I have installed SF web and root = /mnt/cache/newznab/www/ on port 81 - and its indicate that is running, but the www folder are empty I have installed MySQL -> /mnt/cache/.app/mysql/ This PLG installed BUT I cant get this to change to installed!, it show in red NOT INSTALLED even if I try to click on install, and I have also try to update the PLG from the GUI, root = /mnt/cache/newznab/ , this folder are also empty I have done chmod -R 777 on these folders, and rebooted several times. I have DL the updated lighttpd.cfg And I cant access tower:81 it says 404 - Not Found I don't know how to get this up and running, so please what shall I do? Please let me know if I shall provide any error logs..... Edit run this command from pytty /etc/rc.d/rc.newznab install, give me this ..... root@tower:~# /etc/rc.d/rc.newznab install + PATH=/usr/local/sbin:/usr/sbin:/sbin:./:/usr/local/bin:/usr/bin:/bin:/usr/kerb eros/bin:/usr/kerberos/sbin + mkdir -p /boot/debug/newznab/ + typeset LOG=/boot/debug/newznab/rc.newznab.out + mv /boot/debug/newznab/rc.newznab.out /boot/debug/newznab/rc.newznab.out.old + [[ -t 1 ]] + echo 'Writing to logfile '\''/boot/debug/newznab/rc.newznab.out'\''.' Writing to logfile '/boot/debug/newznab/rc.newznab.out'. + exec root@tower:~# //Peter
December 22, 201213 yr Author Zip and attach the Newznab directory in /boot/debug/ What is the name of the MySQL plugin you used?
December 22, 201213 yr looks like there where a permission issue ? ;-) I have now everything up and running, I have selected some groups, doing a update as writing, let you know... ;-) I using plugin version of MySQL (mysql 5.5.22 Plugin for unRAID 5b11+ - Unofficial Update) //Peter EDIT It looks like I cant see anything after I have selected some groups ..... Did below commands, any idea why It would show up anything ? cd newznab/misc/update_scripts php update_binaries.php php update_releases.php
December 22, 201213 yr looks like there where a permission issue ? ;-) I have now everything up and running, I have selected some groups, doing a update as writing, let you know... ;-) I using plugin version of MySQL //Peter EDIT It looks like I cant see anything after I have selected some groups ..... Did below commands, any idea why It would show up anything ? cd newznab/misc/update_scripts php update_binaries.php php update_releases.php If you're using the classic version, you won't get many results because the regex is pretty basic and misses all the releases. Try doing this: cd /tmp wget https://raw.github.com/kop1/newznab/master/db/latestregex.sql mysql -u USERNAME -p DATABASENAME < latestregex.sql That will give you more releases, since the regex will be updated. Don't forget to edit your newznab site and remove the content of "Latest Regex Lookup URL:" I did this to test it before I donated to get the nn+ and it worked well. Cheers, Zenshi.
December 22, 201213 yr Anyone install phpMyAdmin? I've been doing database maintenance via command line and I think a GUI would be nice. Maybe a plugin? (Hint)
Archived
This topic is now archived and is closed to further replies.