newznab + unRAID integration?


Recommended Posts

In /misc/update_scripts there is a directory named cron_scripts. You can schedule a cron job to run that script(it includes code to stop the update_binaries from running multiple instances).

 

You can do this by adding a line to the go file to add the cron automatically on boot:

crontab -l > /tmp/file; echo '#Update Newznab' >> /tmp/file; echo '0 * * * * /mnt/cache/server/misc/update_scripts/cron_scripts/newznab.sh 1> /dev/null' >>/tmp/file; crontab /tmp/file; rm /tmp/file

 

That will run the update scripts every hour unless it is currently running. You need to change the directory path to wherever your script is located. Also you need to open up newznab.sh and change the newznab path to reflect your path as well.

 

As for a recommended group list, check out gingadaddy.com since its back up, do some searches for stuff you normally grab, to the left of the results it gives the groups where it was indexed from, :)

Link to comment
  • Replies 254
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Posted Images

Either will work, I'd stick with localhost personally as the local loopback should always be running but you may have NIC issues and not have a eth0 running and therefore wouldn't have a server IP(of course if this is the case newznab wouldn't be doing you much good anyway).

 

That and since mysql and newznab are running on the same machine, localhost will work fine since its only being used by newznab to connect to the mysql database.

Link to comment

Influencer,

 

Thanks for the info...

 

I did finally get releases, but as you mentioned, just with the few regxs I added.

 

I will donate and get the better regx lists

 

On another note,

 

If i am on the admin page i can access an option fine - view releases for example...

 

If i go to the regular user pages - (the main server page) it also comes up fine, but

if I select any option the 404 page not found keeps coming up

 

My install is in /mnt/cache/wwwdocs/nzb/

 

my webserver gui is set for /mnt/cache/wwwdocs/nzb/www/

I tried  /mnt/cache/wwwdocs/nzb/  but same results?

 

Any ideas how to correct this?

 

Thanks again

Joe

 

Link to comment

you need to open the lighttpd.txt found in /misc/urlrewrites/, copy everything in the file and add it to the end of lighttpd.cfg found in /boot/config/plugins/simpleFeatures/

 

Once its added you need to stop/start the webserver for the changes to take effect(actually not sure if you need to but it won't hurt anything to make sure)

Link to comment

you might have to edit your rewrite rule though.

 

I have it installed under /mnt/cache/web/newznab/www/, so this is what my lighttpd.cfg looks like:

 

url.rewrite-once = (
"^/newznab/www/.*\.(css|jpg|jpeg|gif|png|js|ico)" => "$0",
"^/newznab/www/(admin|install).*$" => "$0",
"^/newznab/www/([^/\.]+)/?(?:\?(.*))$" => "/newznab/www/index.php?page=$1&$2",
"^/newznab/www/([^/\.]+)/?$" => "/newznab/www/index.php?page=$1",
"^/newznab/www/([^/\.]+)/([^/]+)/?(?:\?(.*))$" => "/newznab/www/index.php?page=$1&id=$2&$3",
"^/newznab/www/([^/\.]+)/([^/]+)/?$" => "/newznab/www/index.php?page=$1&id=$2",
"^/newznab/www/([^/\.]+)/([^/]+)/([^/]+)/?$" => "/newznab/www/index.php?page=$1&id=$2&subpage=$3"
)

Link to comment

JangJong, Influencer, All

 

 

Thanks for info

I added the the rewrites and restarted the web server

 

In gui plg screen webroot root dir is -----> /mnt/cache/wwwdocs/nzb/www/

 

http://192.168.1.39:86/admin/'>http://192.168.1.39:86/admin/ - works

http://192.168.1.39:86/admin/'>http://192.168.1.39:86/admin/release-list.php -  works and is the url displayed when i select  view releases

all admin selections pages are displayed properly

 

 

http://192.168.1.39:86/ - displays the home page

 

http://192.168.1.39:86/browse is displayed as url when i select browse option on home page - but if i click on browse

it give me a 404

as does every other selection on the home page

 

 

 

These are the rules

 

# newznab rewrite rules

url.rewrite-once = (

"^/nzb/www/.*\.(css|jpg|jpeg|gif|png|js|ico)" => "$0",

"^/nzb/www/(admin|install).*$" => "$0",

"^/nzb/www/([^/\.]+)/?(?:\?(.*))$" => "/nzb/www/index.php?page=$1&$2",

"^/nzb/www/([^/\.]+)/?$" => "/nzb/www/index.php?page=$1",

"^/nzb/www/([^/\.]+)/([^/]+)/?(?:\?(.*))$" => "/nzb/www/index.php?page=$1&id=$2&$3",

"^/nzb/www/([^/\.]+)/([^/]+)/?$" => "/nzb/www/index.php?page=$1&id=$2",

"^/nzb/www/([^/\.]+)/([^/]+)/([^/]+)/?$" => "/nzb/www/index.php?page=$1&id=$2&subpage=$3"

)

 

Any help would be much appreciated

Joe

Link to comment

JangJong, Influencer, All

 

 

Thanks for info

I added the the rewrites and restarted the web server

 

In gui plg screen webroot root dir is -----> /mnt/cache/wwwdocs/nzb/www/

 

http://192.168.1.39:86/admin/'>http://192.168.1.39:86/admin/ - works

http://192.168.1.39:86/admin/'>http://192.168.1.39:86/admin/release-list.php -  works and is the url displayed when i select  view releases

all admin selections pages are displayed properly

 

 

http://192.168.1.39:86/ - displays the home page

 

http://192.168.1.39:86/browse is displayed as url when i select browse option on home page - but if i click on browse

it give me a 404

as does every other selection on the home page

 

 

 

These are the rules

 

# newznab rewrite rules

url.rewrite-once = (

"^/nzb/www/.*\.(css|jpg|jpeg|gif|png|js|ico)" => "$0",

"^/nzb/www/(admin|install).*$" => "$0",

"^/nzb/www/([^/\.]+)/?(?:\?(.*))$" => "/nzb/www/index.php?page=$1&$2",

"^/nzb/www/([^/\.]+)/?$" => "/nzb/www/index.php?page=$1",

"^/nzb/www/([^/\.]+)/([^/]+)/?(?:\?(.*))$" => "/nzb/www/index.php?page=$1&id=$2&$3",

"^/nzb/www/([^/\.]+)/([^/]+)/?$" => "/nzb/www/index.php?page=$1&id=$2",

"^/nzb/www/([^/\.]+)/([^/]+)/([^/]+)/?$" => "/nzb/www/index.php?page=$1&id=$2&subpage=$3"

)

 

Any help would be much appreciated

Joe

 

If your webroot dir is /mnt/cache/wwwdocs/nzb/www/, just ignore my rewrite rule and use the one that's in /misc/urlrewriting/lighthttpd.txt which is

url.rewrite-once = (
"^/.*\.(css|jpg|jpeg|gif|png|js|ico)" => "$0",
"^/(admin|install).*$" => "$0",
"^/([^/\.]+)/?(?:\?(.*))$" => "index.php?page=$1&$2",
"^/([^/\.]+)/?$" => "index.php?page=$1",
"^/([^/\.]+)/([^/]+)/?(?:\?(.*))$" => "index.php?page=$1&id=$2&$3",
"^/([^/\.]+)/([^/]+)/?$" => "index.php?page=$1&id=$2",
"^/([^/\.]+)/([^/]+)/([^/]+)/?$" => "index.php?page=$1&id=$2&subpage=$3"
)

 

 

I had to edit mine becuase my webroot is just "/mnt/cache/web/" and i have newznab installed under "/mnt/cache/web/newznab/www/".

 

sorry for the confusion.

Link to comment

Well I setup newznab last night, and found the regex information online. Works great. However it's just a vm on my pc which is a 4+ year old quad core. The php update scripts being single threaded, seems to take quite a while for processing. Downloading headers is quick as I have Astraweb and that combined with newznab supports compressed headers. Back filling more than several days would take forever. I figure a good week to do 180 days...then however long to get the week you spent backf filling back filled lol.

 

I think I'll just use gingadaddy combined with some pre lists and binsearch to grab shit. I think it will be a while before the matrix is replaced.

 

So I guess I'm not sure if I'll keep playing with my newznab, it works wonders. I think if someone setup a private invite only one where we have to vouch for people, it could grow nice and slow but be quite useful. I have a 50/15 connection but can't run servers (legally and port 80 is blocked).

Link to comment

Well... it all seems to be working... I have added a few groups that I would think have stuff.. I have experienced with backfill from 1 to 100 days...

 

update_binaries looks like it is doing a lot of stuff, but update_releases finishes really quick (not in error) and tells me there are no releases..

 

Any bright ideas?

 

Starting release update process (2012-12-11 21:33:29)
Using latest regex revision 1742
Stage 1 : Applying regex to binaries
Stage 2 : Marking binaries where all parts are available
Stage 3 : Creating releases from complete binaries
Stage 4 : Finished creating 0 releases. Found 0 nfos
Stage 5 : Post processing started
PostPrc : Deleting 0 audio previews older than 60 days
TVRage  : Looking up 0 releases using local and web
Stage 6 : Aggregating Files
Stage 7 : Deleting unused binaries and parts
Done    : Added 0 releases

 

 

Did you go Plus or free version.  If you went plus did you add your ID to your site profile?  If so when you do update release it should download new regexs.  From what I have seen the regex is super important for releases to actually make it in.  Check your regex listings and you should have a ton in there. 

 

Also would encourage to start small on everything. Small amount of groups, small backfill.  Its easier to tweak everything as you go that way vs waiting for days and days to come down.  I am just doing 7 days just to get the hang of it.

 

Thanks, that must be it. I got to the point where I understood that the regex's were the issue, I could however not find how to update them. A lot of info on that they would be updated automatically. I missed the part in the introductionary mail that I needed to enter the id in the site edit page..

 

Am now updating again and am confident it will work now.

 

Now time to add this stuff to cron and find the best newsgroups. Anyone have any idea on what groups are good to use for "filling" couchpotatoe and sickbeard ?

Link to comment

Hi Guys,

 

I've got my Newznab installation up and running. Here are the steps I followed:

  • Install the mysql unraid plugin
  • Install the simple features web server plugin
  • After installation, you should have a /boot/config/plugins/simpleFeatures/lighttpd.cfg file, open it in a text editor of your choice and add the following rewrite rules:

# newznab rewrite rules
url.rewrite-once = (
"^/.*\.(css|jpg|jpeg|gif|png|js|ico)" => "$0",
"^/(admin|install).*$" => "$0",
"^/([^/\.]+)/?(?:\?(.*))$" => "index.php?page=$1&$2",
"^/([^/\.]+)/?$" => "index.php?page=$1",
"^/([^/\.]+)/([^/]+)/?(?:\?(.*))$" => "index.php?page=$1&id=$2&$3",
"^/([^/\.]+)/([^/]+)/?$" => "index.php?page=$1&id=$2",
"^/([^/\.]+)/([^/]+)/([^/]+)/?$" => "index.php?page=$1&id=$2&subpage=$3"
)

  • Download newznab (http://www.newznab.com/download.html) and unzip the contents to were you want your newznab web root (i.e. /mnt/cache/apps/webroot/newznab/)
  • Go to your Unraid Settings page and click Web Server. Enable, set the web root (i.e. /mnt/cache/apps/webroot/newznab/www) and port (i.e. 81) - click Apply
  • Now visit http://tower:81 and you should be able to configure newznab!

 

Let me know if you run into any issues.

 

james

 

Did all this and worked great! Thanks for posting this.

 

I am having one problem though. I downloaded newznab from the link in the e-mail I was sent after I donated. I installed that copy on to my cache drive and am looking at the /admin/site-edit page but I don't have a field to enter my regkey. Does this mean I don't have the "+" version installed? If I don't, how and where do I get the + version?

 

Thanks!

Link to comment

 

 

Did all this and worked great! Thanks for posting this.

 

I am having one problem though. I downloaded newznab from the link in the e-mail I was sent after I donated. I installed that copy on to my cache drive and am looking at the /admin/site-edit page but I don't have a field to enter my regkey. Does this mean I don't have the "+" version installed? If I don't, how and where do I get the + version?

 

Thanks!

 

The link in the email would have been an SVN link (have to run the checkout command).  That gives you the plus version.

Link to comment

 

 

Did all this and worked great! Thanks for posting this.

 

I am having one problem though. I downloaded newznab from the link in the e-mail I was sent after I donated. I installed that copy on to my cache drive and am looking at the /admin/site-edit page but I don't have a field to enter my regkey. Does this mean I don't have the "+" version installed? If I don't, how and where do I get the + version?

 

Thanks!

 

The link in the email would have been an SVN link (have to run the checkout command).  That gives you the plus version.

 

 

Thanks for the quick reply, I figured out what I did wrong.

Link to comment

This is the email you get when you donate. It explains how to upgrade.

 

 

Your newznabID is F22FB8 you can enter it in the site-edit page when you have installed or upgraded to newznab+, the screen looks like this http://dl.dropbox.com/u/6165047/2012-01-29_145321.png

Once entered, the next time you run an update of binaries/releases the latest user contributed regexes will be pulled down into your installation.

 

If you are upgrading from newznab classic and wish to retain your database, you will need to run the patches in the /db/patch/0.2.1-0.2.2, 0.2.2-0.2.3 and 0.2.3 folders.

 

For support or information on how to quickly fill your index grab someone on IRC using the chat link http://newznab.com/chat.html

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.